Cognition · Software component
Vote Thought Evaluator
Software componentCognitionCognition & Memoryarc:VoteThoughtEvaluator
A thought state evaluator that presents all candidate states at one tree level together and asks the model to judge comparatively which is most promising.
Responsibility. Selects the most promising state by comparative judgment across candidates.
Also known as: Vote prompt, Comparative judgment evaluator
Variant of Thought State Evaluator abstract
When to choose. Choose when evaluation criteria are subjective or rating scales poorly defined (e.g., narrative coherence), or when a single best candidate must be selected.
Relationships
alternative to variability
Design guidance
- SHOULD be preferred over value estimation for subjective evaluation domains.
- SHOULD be limited to small branching factors, since all candidates share one prompt and may exceed the context window.
Quantitative guidance
As stated by the sources; verify before use.
- Overhead manageable for branching factors of 3-5 candidates (Ch5.2).
Classification
- Patterns
- Voting evaluationComparative judgment
- Risks mitigated
- Non-discriminative absolute ratingsCalibration bias in subjective domains
Sources
- Ch5.2: T. Nguyen, "Tree-of-Thought (ToT) Fundamentals," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 5.2. ISBN: 9798244538229.