Notes:
Both, the GPU (green) and Genoa (red) sub-network have a Fat Tree topology.
2 spine switches (grey) provide access to 6 storage gateways (Lenovo ThinkSystem SR630 V2) of the “IBM Spectrum Scale” GPFS-File Systems (/home, /scratch, /sw).
400 Gb/s IB network interface cards (NIC) are installed on in the Genoa network (red). However, a pair of two nodes shares one NIC. Hence, per node the effective bandwidth is 200 Gbit/s.0
2+6 gateway servers (green GPU + red Genoa side, respectively) provide access to the OPA network of the CLX partition.
Mellanox (acquired by Nvidia) designs/manufactures InfiniBand components.