Why it matters
Topology awareness cuts perf loss. NCCL uses; app hints help.
Advertisement
The architecture
Detect topology.
Route by hierarchy.
NCCL_TOPO_FILE hints.
Advertisement
How it works end to end
nvidia-smi topo -m.
NCCL_DEBUG=INFO.
Topology file.