Agentic AI Reference Architecture

Observability & Evaluation · Software component

Agent Performance Dashboard

Software componentObservability & EvaluationObservability & Evaluationarc:AgentPerformanceDashboard

A metrics dashboard presenting aggregate agent outcomes across conversations—resolution rates by issue category, escalation patterns, confidence distributions and trends—with drill-down to individual conversations.

Responsibility. Visualizes aggregate agent effectiveness for service managers.

Also known as: Aggregate dashboard, Manager-facing interface

Variant of Metrics Dashboard abstract

When to choose. Choose when managers must review multi-agent collaboration effectiveness and escalation patterns across thousands of conversations.

readsspecializesis invoked byTrace Store: readsTrace StoreMetrics Dashboard: specializesMetrics DashboardService Owner: is invoked byService Owner
Direct neighbourhood (hover for relationship types)

Relationships

is invoked by dependency

reads dependency

Classification

Patterns
Drill-down from aggregates to examples
Quality attributes
Maintainability (ISO/IEC 25010)
Risks mitigated
Undetected knowledge-base gapsDeclining resolution rates

Sources

  1. Ch10.5: T. Nguyen, "Human-over-the-Loop," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 10.5. ISBN: 9798244538229.