Core concept
Compile phase: analyze graph, optimize for hardware. Runtime schedules ops on Neuron cores.
Advertisement
How it works
Not all ops supported. Compilation can be slow (minutes-hours for large models). Debugging harder than CUDA.
Advertisement
Trade-offs + gotchas
Deploying to Trainium/Inferentia instances. Cost-optimized ML at scale on AWS.