Notes:
Both, the GPU (green) and Genoa (red) sub-network have a Fat Tree topology.
2 spine switches (grey) provide access to 6 storage gateways (Lenovo ThinkSystem SR630 V2) of the “IBM Spectrum Scale” GPFS-File Systems (/home, /scratch, /sw).
A pair of two Genoa compute nodes share one 400Gb/s NIC. Hence, per node the effective bandwidth is 200Gb/s.0
14 LNET gateway servers provide access to the OPA network of the CLX cluster.
Mellanox (acquired by Nvidia) designs/manufactures InfiniBand components.