OpenTelemetry
Standard traces + metrics + logs. LLM extensions: prompt/response, tokens, cost, model version.
Advertisement
Trace structure
Root span = user request. Child spans per agent step. Nested. Latency + cost per node.
Advertisement
Vendors
LangSmith. Arize Phoenix. Datadog LLM Observability. Honeycomb. OpenTelemetry-based interop.
Sampling
100% for security-sensitive endpoints. Sample high-volume. Always full trace on error/anomaly.