LLM Observability Design

advancedopsMin 16K context

Designs traces, metrics, structured events, privacy controls, dashboards, and alerts for LLM applications so teams can diagnose quality, cost, latency, and tool-use behavior.

llmobservabilitytracingmonitoring

Use Cases

  • LLM production monitoring
  • Agent trace design
  • Cost and latency dashboards

Example Prompt

Design observability for this LLM application. Specify trace spans, events, metrics, redaction rules, dashboards, alerts, sampling, and incident queries.

Recommended Models

claude-opus-4-6gpt-5gemini-2-5-pro

Compatible Tools

claude-codecursorkiroany

Modalities

Input: text, code
→
Output: text, code

Author

OpenModels Community

@openmodelsrun