Source Change Detector

Software componentKnowledge & DataKnowledge & Dataarc:SourceChangeDetector

An ingestion component that monitors source systems for modified documents using versions and modification timestamps and queues changed items for reindexing.

Responsibility. Detects changed source content that requires reindexing.

Also known as: Change detection pipeline, Change data capture for knowledge, Timestamp-based change detection, Delta detection, Incremental update tracking, Change Data Capture, File system watch, API webhook receiver, Change detection

Direct neighbourhood (hover for relationship types)

Relationships

is configured by structural

Incremental Refresh Policy Ch6.3B

reads dependency

sends data to dynamic

Data Source Connector abstract Ch6.3A

triggers dynamic

monitors assurance

Knowledge Source System Ch5.8 Ch6.4

Design guidance

SHOULD compare per-record timestamps or version identifiers against the last successful extraction marker to select only new or changed items.

Quantitative guidance

As stated by the sources; verify before use.

Incremental processing reduces runs from hours to minutes (1,000 changed vs 1 million total documents) (Ch6.3A).
Incremental change detection reduces update lag from days (batch) to minutes or seconds (streaming) (Ch6.4).

Classification

Patterns: Version and timestamp trackingReindex queueingTimestamp or version-identifier comparison against last successful extractionChange data capture (CDC)File system watchesAPI webhooksChecksum comparisonModification-timestamp comparison
Quality attributes: Functional suitability: correctness and validity (ISO/IEC 25010 | NIST AI RMF: valid)Cost efficiency
Risks mitigated: Serving stale knowledgeEconomically infeasible full reindexingMissed updatesFull-corpus reprocessing cost

Sources

Ch5.8: T. Nguyen, "Semantic Memory," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 5.8. ISBN: 9798244538229.
Ch6.3A: T. Nguyen, "ETL Pipeline Fundamentals," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 6.3A. ISBN: 9798244538229.
Ch6.4: T. Nguyen, "Data Quality Fundamentals," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 6.4. ISBN: 9798244538229.
Ch6.5: T. Nguyen, "Production RAG Systems," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 6.5. ISBN: 9798244538229.