Orchestration · Data artifact
Extraction Cadence Policy
Data artifactOrchestrationOrchestration & ToolsVariation point (abstract)arc:ExtractionCadencePolicy
An abstract configuration choosing whether a pipeline extracts source data in periodic batches or continuously as it arrives.
Responsibility. Fixes the extraction cadence and hence knowledge freshness of a pipeline.
Also known as: Batch vs streaming extraction decision
Variants
| Variant | When to choose |
|---|---|
| Batch Extraction Policy | Choose for relatively static knowledge bases where daily updates suffice, and for structured sources with efficient timestamp-based change detection. |
| Streaming Extraction Policy | Choose for rapidly changing domains (e.g., news, stock trading) and semi-structured event sources where near-real-time freshness justifies added complexity. |
Relationships
configures structural
Sources
- Ch6.3A: T. Nguyen, "ETL Pipeline Fundamentals," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 6.3A. ISBN: 9798244538229.