LLM Observability Design

AdvancedopsMinimum 16K context

Designs traces, metrics, structured events, privacy controls, dashboards, and alerts for LLM applications so teams can diagnose quality, cost, latency, and tool-use behavior.

llmobservabilitytracingmonitoring

Use cases

  • LLM production monitoring
  • Agent trace design
  • Cost and latency dashboards

Example prompt

Design observability for this LLM application. Specify trace spans, events, metrics, redaction rules, dashboards, alerts, sampling, and incident queries.

Recommended models

claude-opus-4-6gpt-5gemini-2-5-pro

Compatible tools

claude-codecursorkiroany

Modalities

Input: text, code
→
Output: text, code

Author

OpenModels Community

@openmodelsrun