Source Record Extractor

Software componentKnowledge & DataKnowledge & Dataarc:SourceRecordExtractor

An ingestion component that pulls entity records from multiple operational source systems into a staging area for resolution and graph construction.

Responsibility. Extracts entity records from source systems into staging.

Also known as: Staging extraction, SQL connector, Relational database extractor, PostgreSQL extractor

Variant of Data Source Connector abstract

When to choose. Choose for structured sources (relational/NoSQL databases, warehouses) whose schemas and audit timestamps enable selective, batch delta queries.

Direct neighbourhood (hover for relationship types)

Relationships

invokes dependency

Design guidance

MUST use parameterized queries for extraction predicates, even in trusted environments.
SHOULD iterate large result sets with cursors in bounded batches rather than materializing all rows in memory.
SHOULD index the change-tracking timestamp column so incremental filters avoid full table scans.
SHOULD reuse pooled database connections rather than opening a connection per query.

Quantitative guidance

As stated by the sources; verify before use.

Timestamp-based filtering improved extraction efficiency by 95%, reducing daily ETL runtime from 4 hours to 12 minutes (Ch6.3A).
Large extractions iterate in batches of 10,000 rows (Ch6.3A).

Classification

Patterns: Timestamp-based incremental query (updated_at > watermark)Parameterized queriesExplicit column selectionCursor-based batched iteration
Technologies: PostgreSQLMySQLSQL ServerOracleSQLAlchemyPandas
Quality attributes: Compatibility (ISO/IEC 25010)
Risks mitigated: SQL injectionMemory exhaustion on large extractionsSilent breakage from source schema changes

Sources

Ch5.8: T. Nguyen, "Semantic Memory," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 5.8. ISBN: 9798244538229.
Ch6.3A: T. Nguyen, "ETL Pipeline Fundamentals," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 6.3A. ISBN: 9798244538229.
Ch6.3B: T. Nguyen, "ETL Worked Example - Load Phase & Pipeline Integration," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 6.3B. ISBN: 9798244538229.