Core concept
RTX 4090: 24GB GDDR6X, 1 TB/s. Consumer flagship. L40S: 48GB, workstation/inference.
Advertisement
How it works
No NVLink on consumer 4090 (removed in Ada gen). Multi-GPU via PCIe.
Advertisement
Trade-offs + gotchas
Small ML, workstations, inference, gaming. Not for large training.