Agentic AI Reference Architecture

Observability & Evaluation · Software component

Helpfulness Preservation Evaluator

Software componentObservability & EvaluationObservability & Evaluationarc:HelpfulnessPreservationEvaluator

An evaluation component that checks whether alignment reduced harmful outputs without unnecessarily limiting helpful capability, targeting a Pareto improvement in helpfulness and harmlessness.

Responsibility. Detects helpfulness lost to alignment.

Also known as: Helpfulness-harmlessness trade-off evaluation

readsevaluatesEvaluation Dataset: readsEvaluation DatasetConstitutionally Aligned Model: evaluatesConstitutionally Aligned…
Direct neighbourhood (hover for relationship types)

Relationships

reads dependency

evaluates assurance

Classification

Patterns
Pareto improvement assessment
Quality attributes
Functional suitability: correctness and validity (ISO/IEC 25010 | NIST AI RMF: valid)Safety (ISO/IEC 25010 | NIST AI RMF: safe)
Risks mitigated
Over-cautious models refusing legitimate questions

Sources

  1. Ch9.5: T. Nguyen, "Constitutional AI," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 9.5. ISBN: 9798244538229.