Knowledge & Data · Software component

Source Schema Validator

Software componentKnowledge & DataKnowledge & Dataarc:SourceSchemaValidator

A validation component that checks extracted records or API responses against the expected source schema, surfacing source schema or API contract changes before processing.

Responsibility. Detects mismatches between source data and the expected extraction schema.

Also known as: Schema drift detector, API response validator, Startup schema validation

sends data toguardsguardsAlert Manager: sends data toAlert ManagerSource Record Extractor: guardsSource Record ExtractorPaginated API Extractor: guardsPaginated API Extractor
Direct neighbourhood (hover for relationship types)

Relationships

sends data to dynamic

guards control

Design guidance

Classification

Patterns
Explicit column selectionStartup schema validationResponse model validation
Technologies
Pydantic
Quality attributes
Reliability (ISO/IEC 25010 | NIST AI RMF: valid and reliable)
Risks mitigated
Extraction breakage from added/removed/renamed columnsSilent empty results after API contract changesAPI version deprecation

Sources

  1. Ch6.3A: T. Nguyen, "ETL Pipeline Fundamentals," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 6.3A. ISBN: 9798244538229.