Notes:
Both, the GPU (green) and Genoa (red) sub-network have a Fat Tree topology.
2 spine switches (grey) provide access to 6 storage gateways (Lenovo ThinkSystem SR630 V2) of the “IBM Spectrum Scale” GPFS-File Systems (/home, /scratch, /sw).
400 Gb/s network interface cards (NICs) are installed on every second Genoa compute node (red). A pair of two Genoa nodes share one NIC. Hence, per node the effective bandwidth is 200 Gb/s.0
14 LNET gateway servers provide access to the OPA network of the CLX cluster.
Mellanox (acquired by Nvidia) designs/manufactures InfiniBand components.