Core concept
Capture mode records ops. Instantiate graph. Launch graph = single call.
Advertisement
How it works
Static graphs only. Dynamic shapes complicate. Some frameworks (PyTorch) integrate.
Advertisement
Trade-offs + gotchas
Fixed inference shapes. Reduce per-token overhead in LLM inference.