Core concept
Automatic. NCCL_TOPO_DUMP_FILE for inspection. NCCL_DEBUG=INFO logs decisions.
Advertisement
How it works
Miscofigured topology can lead to suboptimal paths. Test + validate.
Advertisement
Trade-offs + gotchas
Every distributed workload. Foundation of collective perf.