...
Notes:
400 Gb/s IB network interface cards (NIC) are installed on the right side of the network. However, a pair of two nodes shares one Both, the GPU (green) and Genoa (red) sub-network have a Fat Tree topology.
2 spine switches (grey) are linked to 6 storage gateways of the “IBM Spectrum Scale” (GPFS)File Systems: home, scratch, sw.
A pair of two Genoa compute nodes share one 400Gb/s NIC. Hence, per node the effective bandwidth is 200 Gbit200Gb/s .0
6 storage gateways (Lenovo ThinkSystem SR630 V2) provide access from the ‘Spine Stor’ top-level switches to the “Storage Scale” File Systems (/home, /scratch, /sw).
2 (like in the GPU cluster).0
14 LNET gateway servers provide access to the OPA network of the CLX partitioncluster.
Mellanox (acquired by Nvidia) manufactures InfiniBand host bus adapters and network switchesdesigns/manufactures InfiniBand components.