Agentic AI Reference Architecture

Infrastructure · Infrastructure resource

CPU Compute Node

Infrastructure resourceInfrastructureInfrastructurearc:CPUNode

A general-purpose compute host without accelerators, used for lighter workloads such as optimized embedding encoders or overflow agent replicas.

Responsibility. Hosts workloads that do not require GPU acceleration.

Also known as: CPU-only instance

hostshostshostshostsis scaled byhostshostsis monitored byAgent Controller: hostsAgent ControllerRetriever: hostsRetrieverEmbedding Service: hostsEmbedding ServiceRule-Based Decision Engine: hostsRule-Based Decision EngineInstance Group Autoscaler: is scaled byInstance Group AutoscalerCPU Dataframe Engine: hostsCPU Dataframe EngineCPU Embedding Service: hostsCPU Embedding ServiceHost Resource Monitor: is monitored byHost Resource Monitor
Direct neighbourhood (hover for relationship types)

Relationships

hosts structural

is scaled by control

is monitored by assurance

Quantitative guidance

As stated by the sources; verify before use.

Classification

Patterns
Hardware right-sizingOverflow capacity
Technologies
ONNX Runtime (optimized encoders)
Quality attributes
Cost efficiency
Risks mitigated
Running lightweight tasks on expensive GPUs

Sources

  1. Ch4.7: T. Nguyen, "Scaling Strategies," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 4.7. ISBN: 9798244538229.
  2. Ch5.13: T. Nguyen, "Hybrid Decision Systems Fundamentals," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 5.13. ISBN: 9798244538229.
  3. Ch6.1: T. Nguyen, "Embeddings and RAG Fundamentals," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 6.1. ISBN: 9798244538229.
  4. Ch6.3B: T. Nguyen, "ETL Worked Example - Load Phase & Pipeline Integration," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 6.3B. ISBN: 9798244538229.
  5. Ch6.5: T. Nguyen, "Production RAG Systems," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 6.5. ISBN: 9798244538229.