Agentic AI Reference Architecture

Infrastructure · Software component

Stateful Workload Controller

Software componentInfrastructureInfrastructurearc:StatefulWorkloadController

A workload controller that gives each replica a stable network identity and its own persistent volume, starting replicas in order and stopping them in reverse order.

Responsibility. Maintains replicas that need persistent identity, ordered lifecycle and per-replica storage.

Also known as: StatefulSet

Variant of Workload Controller abstract

When to choose. Choose when agents or stores need persistent identity, ordered initialization (e.g., coordinator before workers) or reconnection to specific persistent volumes.

hostsorchestratesspecializesalternative toVector Index Store: hostsVector Index StoreSupervisor Agent: orchestratesSupervisor AgentWorkload Controller: specializesWorkload ControllerStateless Workload Controller: alternative toStateless Workload Contr…
Direct neighbourhood (hover for relationship types)

Relationships

hosts structural

orchestrates control

alternative to variability

Classification

Patterns
Ordered, graceful scalingStable network identities
Technologies
Kubernetes StatefulSet
Quality attributes
Reliability (ISO/IEC 25010 | NIST AI RMF: valid and reliable)
Risks mitigated
Lost state or identity on pod rescheduling

Sources

  1. Ch4.3: T. Nguyen, "Container Orchestration and Edge Deployment," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 4.3. ISBN: 9798244538229.