Core concept
RDMA. GPUDirect for direct GPU-to-network. NVIDIA Quantum switches with SHARP for in-network reductions.
Advertisement
How it works
Expensive. NVIDIA-dominated (via Mellanox acquisition). Alternatives via RoCE Ethernet.
Advertisement
Trade-offs + gotchas
Training clusters. HPC. Any communication-heavy workload.