...
Notes:
400 Gb/s IB network interface cards (NIC) are installed on the right side of the network. However, a pair of two nodes shares one Both, the GPU (green) and Genoa (red) sub-network have a Fat Tree topology.
2 spine switches (grey) are linked to 6 storage gateways of the “IBM Spectrum Scale” (GPFS)File Systems: home, scratch, sw.
A pair of two Genoa compute nodes share one 400Gb/s NIC. Hence, per node the effective bandwidth is 200 Gbit200Gb/s (like in the GPU cluster).0
6 storage gateways (Lenovo ThinkSystem SR630 V2) provide access to the storage filesystems: /home, /scratch, and /sw
2 14 LNET gateway servers provide access to the OPA network of the CLX partitioncluster.
Mellanox (acquired by Nvidia) manufactures InfiniBand host bus adapters and network switchesdesigns/manufactures InfiniBand components.