Agentic AI Reference Architecture

Observability & Evaluation · Data artifact

Principle Adherence Test Suite

Data artifactObservability & EvaluationObservability & Evaluationarc:PrincipleAdherenceTestSuite

A set of test prompts targeting each constitutional principle, including edge cases, ambiguous scenarios, violations framed as reasonable requests and legitimate near-boundary requests.

Responsibility. Defines per-principle adherence test cases.

Also known as: Per-principle test sets, Value alignment test suite

is configured byreceives data fromis read byConstitution: is configured byConstitutionRed Team Tester: receives data fromRed Team TesterPrinciple Adherence Evaluator: is read byPrinciple Adherence Eval…
Direct neighbourhood (hover for relationship types)

Relationships

is configured by structural

is read by dependency

receives data from dynamic

Design guidance

Classification

Quality attributes
Reliability (ISO/IEC 25010 | NIST AI RMF: valid and reliable)

Sources

  1. Ch9.5: T. Nguyen, "Constitutional AI," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 9.5. ISBN: 9798244538229.
  2. Ch9.6: T. Nguyen, "Value Alignment Frameworks," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 9.6. ISBN: 9798244538229.