Agentic AI Reference Architecture

Observability & Evaluation · Data store

Evaluation Result Store

Data storeObservability & EvaluationObservability & Evaluationarc:EvaluationResultStore

A persistent store of evaluation runs, their configurations, metrics and artifacts, queryable to answer when quality changed and which configuration performed best.

Responsibility. Persists evaluation run history as an audit trail.

Also known as: Experiment store, Evaluation history, Uploaded evaluation artifacts, Benchmark history

is written byis read byis read byis written byis read byis read byis read byEvaluation Harness: is written byEvaluation HarnessRegression Gate: is read byRegression GateEvaluation Failure Analyzer: is read byEvaluation Failure Analy…Experiment Tracker: is written byExperiment TrackerControl Effectiveness Evaluator: is read byControl Effectiveness Ev…Model Card Generator: is read byModel Card GeneratorPerformance Trend Analyzer: is read byPerformance Trend Analyzer
Direct neighbourhood (hover for relationship types)

Relationships

is read by dependency

is written by dependency

Classification

Technologies
MLflow
Quality attributes
Transparency and accountability (NIST AI RMF: accountable and transparent)

Sources

  1. Ch3.1A: T. Nguyen, "Implement Evaluation Pipelines and Task Benchmarks," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 3.1A. ISBN: 9798244538229.
  2. Ch3.1B: T. Nguyen, "Implement Evaluation Pipelines and Task Benchmarks - Guided Practice," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 3.1B. ISBN: 9798244538229.
  3. Ch4.2: T. Nguyen, "Deployment and Scaling," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 4.2. ISBN: 9798244538229.
  4. Ch7.3: T. Nguyen, "NeMo Agent Toolkit Profiling," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 7.3. ISBN: 9798244538229.
  5. Ch9.8: T. Nguyen, "Standards and Frameworks for AI Governance," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 9.8. ISBN: 9798244538229.
  6. Ref8.03: "Agent Evaluation Frameworks and Metrics," unpublished reference note (03-Agent-Evaluation-Frameworks.md), Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam supplementary materials, 2026. unpublished note