LLM Routing Strategies

Why it matters

LLM routing shapes cost + quality. Understanding shapes strategy.

The architecture

Classifier / heuristic picks model.

Cheap for easy; large for hard.

Fallback on failure.

How it works end to end

Cascade: small first, fallback large.

Router models (Martian, Not Diamond).

Task classification.

Cost + quality metrics.