Cognition · Software component
Citation Verifier
Software componentCognitionCognition & Memoryarc:GroundingVerifier
An evaluation component that checks whether claims attributed to cited sources actually appear in those sources, detecting fabricated citations and misrepresented content.
Responsibility. Verifies groundedness of cited claims.
Also known as: Source verification, Citation checking, Groundedness check, Hallucination detector, Citation verifier, Tool interpretation checker, Claim verification, Evidence grounding check, Faithfulness checker, Span-level attribution, Entailment-based assessment, Semantic validator, Citation validation, Legal verification agent, Attribution precision check, Claim Grounding Verifier, Citation Verifier, Citation enforcement
Relationships
invokes dependency
- Embedding Service abstract Ch3.10
- External Service API Ch3.10
- NLI Scoring Service Ch3.10
- Retriever abstract Ch3.9
is invoked by dependency
reads dependency
escalates to dynamic
sends data to dynamic
triggers dynamic
guards control
evaluates assurance
Design guidance
- MUST verify assertions about tool results against the actual logged tool outputs.
- SHOULD verify at the granularity of individual factual assertions, not document-level accuracy.
- SHOULD distinguish apparent hallucination from context truncation by checking token accounting.
- MUST verify intermediate premises and citations in reasoning traces, not only final answers.
- SHOULD require explicit source citation for each factual claim, labelling of inferences, and acknowledgment of disagreeing sources.
- SHOULD verify each factual claim against provided context after generation and before presentation to users.
- SHOULD route high-risk (low-faithfulness) outputs to LLM-judge review and add warnings to medium-risk outputs.
- SHOULD check DOI existence, author attribution and whether the cited source contains the claimed information.
- SHOULD route unverifiable citations to human expert review with warnings.
- SHOULD track attribution precision separately from overall hallucination rate.
Quantitative guidance
As stated by the sources; verify before use.
- Healthcare case: hallucinated symptoms found in 12% of cases; diagnostic accuracy +8% after citation verification (Ch3.6).
- Research synthesis agent: 78% of claims were unsourced or attributed to non-existent sources; after claim verification grounding reached 94%; contradiction handling to 89%; evidence hierarchy 86%; assumption transparency 91%; expert-assessed research quality +31% (Ch3.9 case study).
- Faithfulness = grounded statements / total factual claims; >90% indicates tightly grounded output (Ch3.10).
- Risk bands in the case study: >=0.9 low, >=0.7 medium, <0.7 high (Ch3.10).
- Citation fabrication reaches 30-40% in some systems (Ch3.10).
- Legal assistant: citation hallucination 28% reduced to 2.1% with authoritative-source retrieval and verification; attorney confidence 34% to 81% (Ch3.10).
Classification
- Patterns
- Hallucination measurement through source verificationClaim-level evidence cross-referencingSource citation requirementClaim verification for reasoning tracesDefense-in-depth stage 3 (post-generation)Span-level attributionMandatory source verification
- Technologies
- spaCySentence embeddingsWestlawLexisNexis
- Quality attributes
- Functional suitability: correctness and validity (ISO/IEC 25010 | NIST AI RMF: valid)Interaction capability (ISO/IEC 25010)Transparency and accountability (NIST AI RMF: accountable and transparent)
- Risks mitigated
- Fabricated citationsHallucinationHallucinated factsTool output misinterpretationConfidently stated fabricated figuresHallucinated citations in reasoningHallucination blindspotContaminated evaluation datasetsParametric hallucinations in RAG outputsContextual distortionConfabulated citationsProfessional liability from fabricated precedents
Sources
- Ch3.3: T. Nguyen, "Web Navigation and Interaction Benchmarks," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 3.3. ISBN: 9798244538229.
- Ch3.6: T. Nguyen, "Trace Analysis and Execution Debugging," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 3.6. ISBN: 9798244538229.
- Ch3.9: T. Nguyen, "Reasoning Quality," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 3.9. ISBN: 9798244538229.
- Ch3.10: T. Nguyen, "Efficiency Metrics," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 3.10. ISBN: 9798244538229.
- Ch7.1A: T. Nguyen, "Advanced Implementation with Nvidia NEMO Framework and Nvlink," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 7.1A. ISBN: 9798244538229.
- Ch7.1B: T. Nguyen, "Nvidia NIM and Colang," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 7.1B. ISBN: 9798244538229.
- Ch8.2A: T. Nguyen, "Error Rates and Reliability," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 8.2A. ISBN: 9798244538229.