Orchestration · Data store

Task Queue

Data storeOrchestrationOrchestration & Toolsarc:TaskQueue

A shared queue that holds pending jobs and tasks so stateless replicas and specialised agent pools can coordinate work without affinity.

Responsibility. Buffers pending jobs for pickup by any available replica.

Also known as: Job queue, Queue system, Shared task queue, Request queue

Direct neighbourhood (hover for relationship types)

Relationships

is read by dependency

Agent Controller abstract Ch1.8
Worker Agent abstract Ch1.8

is written by dependency

Supervisor Agent Ch1.8

is monitored by assurance

Queue-Depth Autoscaler Ch4.7

Design guidance

SHOULD be shared by all replicas so coordination does not require session affinity.

Classification

Patterns: Work queueCompeting consumers
Quality attributes: Performance efficiency (ISO/IEC 25010)Reliability (ISO/IEC 25010 | NIST AI RMF: valid and reliable)
Risks mitigated: Coordination overhead between replicas

Sources

Ch1.8: T. Nguyen, "Scalability and Production Deployment," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 1.8. ISBN: 9798244538229.
Ch4.7: T. Nguyen, "Scaling Strategies," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 4.7. ISBN: 9798244538229.