Core concept
Inferentia3 (announced) will further improve perf per dollar.
Advertisement
How it works
Neuron SDK. Not everything supported. LLM inference via Bedrock uses it.
Advertisement
Trade-offs + gotchas
Cost-sensitive LLM inference. AWS-committed teams.