Model Serving · Software component

Cache Invalidator

Software componentModel ServingModelsarc:CacheInvalidator

A component that removes specific cache entries when underlying data changes, driven by database triggers, broadcast events, webhooks or operator commands.

Responsibility. Removes stale cache entries when source data changes.

Also known as: Event-driven invalidation, Cache admin purge, Dependency-aware invalidator, Event-based cache invalidation, invalidate_pattern

Direct neighbourhood (hover for relationship types)

Relationships

is configured by structural

is invoked by dependency

Platform Operator Ch1.8

reads dependency

Cache Dependency Index Ch4.7

writes dependency

is triggered by dynamic

Design guidance

SHOULD map source-data changes to affected cache keys for fine-grained invalidation where hit rate matters.
SHOULD provide operators manual purge as a last resort when automated invalidation fails.
MUST treat write-invalidation failures as correctness bugs, invalidating affected entries atomically with the source write.
SHOULD combine event-driven invalidation with a TTL bound so staleness stays bounded even when invalidation fails.
SHOULD account for writers outside the application (manual edits, batch ETL, third parties) via CDC streams or conservative TTLs, since cache-aside assumes a single coordinated writer.
SHOULD invalidate related cached queries, contexts and responses when documents are added, modified or deleted.

Classification

Patterns: Event-driven invalidationCoarse vs. fine-grained invalidationManual invalidationDependency-aware invalidationChange data capture (CDC) invalidationWrite-invalidateWrite-through
Quality attributes: Functional suitability: correctness and validity (ISO/IEC 25010 | NIST AI RMF: valid)
Risks mitigated: Serving stale or incorrect cached answers

Sources

Ch1.8: T. Nguyen, "Scalability and Production Deployment," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 1.8. ISBN: 9798244538229.
Ch3.4: T. Nguyen, "Tuning Model Parameters for Production Performance," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 3.4. ISBN: 9798244538229.
Ch4.7: T. Nguyen, "Scaling Strategies," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 4.7. ISBN: 9798244538229.
Ch6.5: T. Nguyen, "Production RAG Systems," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 6.5. ISBN: 9798244538229.
Ch7.3: T. Nguyen, "NeMo Agent Toolkit Profiling," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 7.3. ISBN: 9798244538229.