GPUDirect RDMA and PCIe Topology: The Network Inside the Server
GPUDirect RDMA localityTHE NETWORK PATH STARTS INSIDE THE SERVERX4 NETWORKSGPUDirect and PCIe localityNUMA SOCKET 0PCIe ROOT COMPLEX 0GPU 0NVLinkGPU 1NVLinkNIC 0400GLOCAL PATHPHB NUMA SOCKET 1PCIe ROOT COMPLEX 1GPU 2NVLinkGPU 3NVLinkNIC…