Agentic AI Reference Architecture

Infrastructure · Software component

Stateless Workload Controller

Software componentInfrastructureInfrastructurearc:StatelessWorkloadController

A workload controller that manages interchangeable replicas with no stable identity, any of which can serve any request.

Responsibility. Maintains a pool of interchangeable stateless agent replicas.

Also known as: Deployment

Variant of Workload Controller abstract

When to choose. Choose for stateless agent replicas that load the same model, keep no local state and execute tasks independently (most worker agents).

orchestratesis scaled byspecializesis target of alternativeToWorker Agent: orchestratesWorker AgentMetric-Driven Autoscaler: is scaled byMetric-Driven AutoscalerWorkload Controller: specializesWorkload ControllerStateful Workload Controller: is target of alternativeToStateful Workload Contro…
Direct neighbourhood (hover for relationship types)

Relationships

is scaled by control

orchestrates control

alternative to variability

Design guidance

Classification

Patterns
Horizontal scaling of stateless replicas
Technologies
Kubernetes Deployment
Quality attributes
Performance efficiency (ISO/IEC 25010)Maintainability (ISO/IEC 25010)

Sources

  1. Ch4.3: T. Nguyen, "Container Orchestration and Edge Deployment," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 4.3. ISBN: 9798244538229.
  2. Ref7.17: "Scaling Agentic AI Systems: Patterns and Strategies," unpublished reference note (17-Scalability-Patterns.md), Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam supplementary materials, 2026. unpublished note