Knowledge & Data · Software component
Source Schema Validator
Software componentKnowledge & DataKnowledge & Dataarc:SourceSchemaValidator
A validation component that checks extracted records or API responses against the expected source schema, surfacing source schema or API contract changes before processing.
Responsibility. Detects mismatches between source data and the expected extraction schema.
Also known as: Schema drift detector, API response validator, Startup schema validation
Relationships
sends data to dynamic
guards control
Design guidance
- SHOULD validate source schemas at pipeline startup so mismatches are detected before processing begins.
- SHOULD alert engineers when API response structures change rather than silently returning empty results.
Classification
- Patterns
- Explicit column selectionStartup schema validationResponse model validation
- Technologies
- Pydantic
- Quality attributes
- Reliability (ISO/IEC 25010 | NIST AI RMF: valid and reliable)
- Risks mitigated
- Extraction breakage from added/removed/renamed columnsSilent empty results after API contract changesAPI version deprecation
Sources
- Ch6.3A: T. Nguyen, "ETL Pipeline Fundamentals," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 6.3A. ISBN: 9798244538229.