Agentic AI Reference Architecture

Model Serving · Software component

Cache Warmer

Software componentModel ServingModelsarc:CacheWarmer

A batch job that preloads responses for popular queries into the cache before traffic arrives.

Responsibility. Preloads popular query responses into the cache ahead of demand.

Also known as: Cache preloading

invokeswritesLLM Inference Service: invokesLLM Inference ServiceResponse Cache: writesResponse Cache
Direct neighbourhood (hover for relationship types)

Relationships

invokes dependency

writes dependency

Classification

Patterns
Cache warming
Quality attributes
Performance efficiency (ISO/IEC 25010)
Risks mitigated
Cold-start cache misses

Sources

  1. Ch1.8: T. Nguyen, "Scalability and Production Deployment," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 1.8. ISBN: 9798244538229.