Agentic AI Reference Architecture

Observability & Evaluation · Software component

Streaming Quality Monitor

Software componentObservability & EvaluationObservability & Evaluationarc:StreamingQualityMonitor

A production quality monitor that evaluates each prediction as it occurs and streams metrics continuously to the monitoring system for real-time alerting.

Responsibility. Computes quality metrics per prediction in real time.

Also known as: Real-time streaming monitoring

Variant of Production Quality Monitor abstract

When to choose. Choose for critical or high-volume applications that need real-time alerts.

specializesis target of alternativeToProduction Quality Monitor: specializesProduction Quality MonitorBatch Quality Monitor: is target of alternativeToBatch Quality Monitor
Direct neighbourhood (hover for relationship types)

Relationships

alternative to variability

Classification

Patterns
Per-prediction streaming metrics
Quality attributes
Performance efficiency (ISO/IEC 25010)Reliability (ISO/IEC 25010 | NIST AI RMF: valid and reliable)

Sources

  1. Ref8.02: "Machine Learning Monitoring in Production," unpublished reference note (02-ML-Monitoring-Production.md), Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam supplementary materials, 2026. unpublished note