...
Both, the GPU (green) and Genoa (red) sub-network have a Fat Tree topology.
2 spine switches (grey) provide access to 6 storage gateways (Lenovo ThinkSystem SR630 V2) of the “IBM Spectrum Scale” GPFS-File Systems (/home, /scratch, /sw).
400 GbitGb/s IB network interface cards (NICNICs) are installed on in the Genoa network every second Genoa compute node (red). However, a A pair of two Genoa nodes shares share one NIC. Hence, per node the effective bandwidth is 200 GbitGb/s.0
14 LNET gateway servers provide access to the OPA network of the CLX cluster.
Mellanox (acquired by Nvidia) designs/manufactures InfiniBand components.