Model Serving · Data store
Database Response Cache
Data storeModel ServingModelsarc:DatabaseResponseCache
A cache stored as relational table records with ACID properties, enabling transactional invalidation, SQL querying and durable history of cached outputs.
Responsibility. Persists cached responses durably with transactional consistency.
Also known as: Database caching, SQL cache table
Variant of Response Cache abstract
When to choose. Choose when audit requires persisting all outputs, capacity exceeds practical RAM, cache updates must be atomic with other data, or SQL querying of cached data is needed.
Relationships
alternative to variability
Design guidance
- SHOULD NOT be used for latency-sensitive real-time paths.
Quantitative guidance
As stated by the sources; verify before use.
- 10-50 ms query latency, an order of magnitude above Redis (Ch1.8).
Classification
- Patterns
- Trigger-based invalidationMaterialized viewsScheduled TTL deletion
- Technologies
- PostgreSQLMySQL
- Quality attributes
- Reliability (ISO/IEC 25010 | NIST AI RMF: valid and reliable)Transparency and accountability (NIST AI RMF: accountable and transparent)
- Risks mitigated
- Inconsistent cache vs. transactional stateLoss of output history for audit
Sources
- Ch1.8: T. Nguyen, "Scalability and Production Deployment," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 1.8. ISBN: 9798244538229.