Observability & Evaluation · Software component

Milestone Evaluator

Software componentObservability & EvaluationObservability & Evaluationarc:MilestoneEvaluator

A task success evaluator that decomposes a task into outcome-critical intermediate milestones and credits each one achieved, ignoring inconsequential actions.

Responsibility. Awards partial credit for achieved milestones along a task.

Also known as: Milestone-based scoring, Key-node evaluation, Critical intermediate action scoring

Variant of Task Success Evaluator abstract

When to choose. Choose for complex tasks admitting partial credit, where locating the failing intermediate step guides optimization.

Direct neighbourhood (hover for relationship types)

Relationships

reads dependency

Trace Store Ch3.3

alternative to variability

Design guidance

SHOULD focus on outcome-critical decisions (correct field, accurate data, necessary pages) while being robust to insignificant events.

Classification

Patterns: Partial credit scoring
Technologies: WebCanvas
Quality attributes: Maintainability (ISO/IEC 25010)
Risks mitigated: Opaque binary failures

Sources

Ch3.3: T. Nguyen, "Web Navigation and Interaction Benchmarks," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 3.3. ISBN: 9798244538229.