LLM Pricing Models

Why it matters

Pricing models shape choices. Understanding shapes cost prediction.

The architecture

Input tokens: cheaper.

Output tokens: costlier.

Cache reads: discount.

Batch API: discount.

How it works end to end

Input : output ratio matters.

Cache discounts (10-90% off).

Batch API often 50% off.

Provisioned throughput for latency.