Why it matters

InfiniBand connects GPU nodes. RDMA + sub-µs latency = training scale.

Advertisement

The architecture

400 Gbps NDR.

RDMA (no CPU).

Fat-tree topology.

InfiniBand fabric400 Gbps NDRper portRDMAno CPU copyFat-treeor dragonflyMellanox NDR 400G; sub-microsecond latency; standard for HPC + LLM
InfiniBand fabric.
Advertisement

How it works end to end

Mellanox NDR 400G.

Sub-µs latency.

Fat-tree common.