AI runtime infrastructure
AI runtime observability
Inspect traces, latency, cost, routing, outcomes, and safe evidence for every runtime request.
Trace
Follow a request through security, routing, retrieval, tools, and the provider.
Waterfall
Separate queue delay, model time, retrieval time, and total latency.
Outcome
Inspect safe success, block, retry, fallback, cost, and policy metadata.