Core concept
LLM inference workloads see 40-60% throughput improvement. Amortizes premium.
Advertisement
How it works
Training marginally better. Depends on memory-bound bottlenecks.
Advertisement
Trade-offs + gotchas
LLM inference-heavy workloads. Larger models fitting in fewer H200 vs H100 needed.