LLM Memory Profiling

Why it matters

Memory profiling prevents OOM crashes. Critical for large LLM training.

The architecture

Snapshot allocator; view timeline; find peak.

Attribute to modules and tensors.

How it works end to end

torch.cuda.memory._record_memory_history.

Export snapshot.

View in memory viz.