Observability & Evaluation · Software component

Rule-Based Compliance Scorer

Software componentObservability & EvaluationObservability & Evaluationarc:RuleBasedComplianceScorer

A response scorer that extracts values (amounts, percentages, dates) from a response and verifies them against configured policy limits, failing on any violation.

Responsibility. Verifies that commitments stated in a response satisfy structured policy constraints.

Also known as: Policy compliance checker

Variant of Response Scorer abstract

When to choose. Choose when success depends on structured constraints such as refund limits, dates or eligibility.

Direct neighbourhood (hover for relationship types)

Relationships

is configured by structural

Compliance Policy Rule Set Ch3.1B

Design guidance

MUST return failure as soon as any violation appears, even if other stated offers comply.

Quantitative guidance

As stated by the sources; verify before use.

Example finding: 15% of responses violating discount limits signals a critical issue (Ch3.1B).

Classification

Patterns: Regex value extraction with rule evaluationFail-on-any-violation
Risks mitigated: Unauthorized discounts or guaranteesLegal liability and revenue loss from policy violations

Sources

Ch3.1B: T. Nguyen, "Implement Evaluation Pipelines and Task Benchmarks - Guided Practice," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 3.1B. ISBN: 9798244538229.