Core concept
Same API across models. Custom fine-tuning. Knowledge Bases (RAG). Agents. Guardrails.
Advertisement
How it works
Regional model availability varies. Provisioned throughput for high-volume + fine-tuned. On-demand for variable.
Advertisement
Trade-offs + gotchas
Enterprise apps wanting managed LLMs. AWS-centric orgs. Multi-model routing without SDK juggling.