Agentic AI Reference Architecture

Tools & Integration · Interface

REST Agent API

InterfaceTools & IntegrationOrchestration & Toolsarc:RESTAgentAPI

A resource-oriented, stateless HTTP/JSON API exposing agent capabilities as endpoints manipulated with standard HTTP methods.

Responsibility. Exposes agent capabilities as stateless HTTP resources.

Also known as: Chain serving endpoints (/invoke, /batch, /stream, /stream_log), Workflow serving endpoint (/generate, /chat, /chat/stream), REST RAG API

Variant of Agent Service API abstract

When to choose. Choose when human readability matters, clients are diverse (any HTTP client), performance requirements are moderate, and REST infrastructure can be reused.

is exposed byis invoked byis exposed byis guarded byspecializeshas access controlled byis routed to byis target of alternativeTois constrained byAgent Controller: is exposed byAgent ControllerEvaluation Harness: is invoked byEvaluation HarnessRAG Query Orchestrator: is exposed byRAG Query OrchestratorRate Limiter: is guarded byRate LimiterAgent Service API: specializesAgent Service APIIdentity Provider: has access controlled byIdentity ProviderAPI Gateway Proxy: is routed to byAPI Gateway ProxygRPC Agent API: is target of alternativeTogRPC Agent APIRAG Query API Schema: is constrained byRAG Query API Schema
Direct neighbourhood (hover for relationship types)

Relationships

is exposed by structural

is invoked by dependency

is routed to by dynamic

has access controlled by control

is constrained by control

is guarded by control

alternative to variability

Design guidance

Classification

Technologies
HTTP/1.1JSONLangServeFastAPI
Quality attributes
Interaction capability (ISO/IEC 25010)Maintainability (ISO/IEC 25010)Performance efficiency (ISO/IEC 25010)

Sources

  1. Ch1.3: T. Nguyen, "Multi-Agent Systems," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 1.3. ISBN: 9798244538229.
  2. Ch2.9: T. Nguyen, "Streaming and Real-Time Responses," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 2.9. ISBN: 9798244538229.
  3. Ch6.5: T. Nguyen, "Production RAG Systems," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 6.5. ISBN: 9798244538229.
  4. Ref3.01: NVIDIA, "Agent Evaluation in NVIDIA NeMo Agent Toolkit," NVIDIA NeMo Agent Toolkit Documentation, v1.8. Accessed: Sep. 27, 2026. [Online]. Available: https://docs.nvidia.com/nemo/agent-toolkit/latest/improve-workflows/evaluate.html
  5. Ref3.06: NVIDIA, "Launching the NVIDIA Agent Intelligence Toolkit API server and user interface," NVIDIA Agent Intelligence Toolkit Documentation, v1.1. Accessed: Sep. 27, 2026. [Online]. Available: https://docs.nvidia.com/nemo/agent-toolkit/1.1/quick-start/launching-ui.html