Observability & Evaluation · Software component

Score-Only Judge

Software componentObservability & EvaluationObservability & Evaluationarc:ScoreOnlyJudge

An LLM judge that returns evaluation scores without exposing any reasoning trace for its verdict.

Responsibility. Grades outputs with bare scores.

Also known as: Black-box judge, Opaque evaluator

Variant of LLM Judge abstract

When to choose. Choose only where lower evaluation accuracy and unverifiable judgments are acceptable; the chapter reports it underperforms explained judges.

specializesis target of alternativeToLLM Judge: specializesLLM JudgeChain-of-Thought Judge: is target of alternativeToChain-of-Thought Judge
Direct neighbourhood (hover for relationship types)

Relationships

alternative to variability

Sources

  1. Ch3.9: T. Nguyen, "Reasoning Quality," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 3.9. ISBN: 9798244538229.