Core concept

PCIe or SXM. 400W SXM. NVLink 3 (600 GB/s).

Advertisement

How it works

Superseded by H100 for new deployments. Still available cheaper on cloud.

Advertisement

Trade-offs + gotchas

Cost-sensitive training + inference. Legacy fleets. Cheaper cloud options.