Why it matters

NVLink switch shapes multi-GPU BW. Understanding shapes DGX + NVL72.

Advertisement

The architecture

Switch chip.

Ports connect to GPUs.

Enables non-adjacent GPU comm.

NVLink switch stackSwitch chipsiliconGPU portsNVLink 4/5All-to-allin NVLink domainDGX H100 = 8 GPUs + NVSwitch; NVL72 = 72 GPUs coherent via switches
NVLink switch.
Advertisement

How it works end to end

DGX H100: 4 NVSwitches per node.

NVL72: switches enable 72-GPU coherent domain.

Cross-node NVLink coming.