...
Both, the GPU (green) and Genoa (red) sub-network have a Fat Tree topology.
2 spine switches (grey) provide access to 6 storage gateways (Lenovo ThinkSystem SR630 V2) of the “IBM Spectrum Scale” GPFS-File Systems (/home, /scratch, /sw).
400 Gbit/s IB network interface cards (NIC) are installed on in the Genoa network (red). However, a pair of two nodes shares one NIC. Hence, per node the effective bandwidth is 200 Gbit/s.0
14 LNET gateway servers provide access to the OPA network of the CLX cluster.
Mellanox (acquired by Nvidia) designs/manufactures InfiniBand components.