Agentic AI Reference Architecture

Tools & Integration · Interface

External Service API

InterfaceTools & IntegrationOrchestration & Toolsarc:ExternalServiceAPI

An external API (search, weather, flight search, database) that a tool wraps to give the agent current information or actions.

Responsibility. Provides an external capability that tools call.

Also known as: External tool API, Search API, Weather API, Flight search API, Credit check / income verification / fraud detection API, Academic database search, Web search API, Academic database API, SEC EDGAR API, Notification service, Calculator tool, Map tool, Offline Wikipedia, Market data API, SEC filings source, Legal research database, Credit bureau API, Conference management platform, Email platform, ArXiv search API, Legacy warehouse management API, Backend system, External credit scoring API, Third-party data processor (payment, shipping, analytics, advertising), Order management API, Financial transaction system

is guarded by; is routed to byis invoked byis invoked byis invoked byis invoked byis invoked byis invoked byhas access controlled byis invoked byis guarded byis constrained byis cached byis invoked byis guarded byreceives data fromreceives data fromis monitored byis invoked byPolicy Plugin Gateway: is guarded by; is routed to byPolicy Plugin GatewayWorker Agent: is invoked byWorker AgentTool Executor: is invoked byTool ExecutorRetry Handler: is invoked byRetry HandlerWorkflow Orchestrator: is invoked byWorkflow OrchestratorTool Integration Adapter: is invoked byTool Integration AdapterWeb Navigation Agent: is invoked byWeb Navigation AgentAuthorization Policy Decision Point: has access controlled byAuthorization Policy Dec…Citation Verifier: is invoked byCitation VerifierCircuit Breaker: is guarded byCircuit BreakerRate Limiter: is constrained byRate LimiterTool Result Cache: is cached byTool Result CacheDialog Rail: is invoked byDialog RailExecution Rail: is guarded byExecution RailTree Search Controller: receives data fromTree Search ControllerErasure Orchestrator: receives data fromErasure OrchestratorDependency Health Monitor: is monitored byDependency Health MonitorREST API Adapter: is invoked byREST API Adapter+7 more (see relationships)
Direct neighbourhood (hover for relationship types)

Relationships

is cached by dependency

is invoked by dependency

is routed to by dynamic

receives data from dynamic

has access controlled by control

is constrained by control

is guarded by control

is monitored by assurance

Quantitative guidance

As stated by the sources; verify before use.

Classification

Technologies
arXivPubMedGoogle ScholarSEC EDGARWestlawLexisNexis

Sources

  1. Ch1.5A: T. Nguyen, "Stateful Orchestration - Introduction and Core Concepts," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 1.5A. ISBN: 9798244538229.
  2. Ch1.5B: T. Nguyen, "Stateful Orchestration - Worked Examples," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 1.5B. ISBN: 9798244538229.
  3. Ch1.6: T. Nguyen, "Stateful Orchestration - Pitfalls, Integration, and Synthesis," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 1.6. ISBN: 9798244538229.
  4. Ch2.1: T. Nguyen, "Framework Landscape and Selection," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 2.1. ISBN: 9798244538229.
  5. Ch2.3: T. Nguyen, "LangChain Sequential Frameworks," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 2.3. ISBN: 9798244538229.
  6. Ch2.4: T. Nguyen, "Multi-Agent Frameworks," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 2.4. ISBN: 9798244538229.
  7. Ch2.6: T. Nguyen, "Tool Integration and Function Calling," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 2.6. ISBN: 9798244538229.
  8. Ch2.8: T. Nguyen, "Error Handling and Resilience," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 2.8. ISBN: 9798244538229.
  9. Ch3.3: T. Nguyen, "Web Navigation and Interaction Benchmarks," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 3.3. ISBN: 9798244538229.
  10. Ch3.10: T. Nguyen, "Efficiency Metrics," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 3.10. ISBN: 9798244538229.
  11. Ch4.2: T. Nguyen, "Deployment and Scaling," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 4.2. ISBN: 9798244538229.
  12. Ch4.7: T. Nguyen, "Scaling Strategies," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 4.7. ISBN: 9798244538229.
  13. Ch5.1: T. Nguyen, "Chain-of-Thought (CoT) Fundamentals," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 5.1. ISBN: 9798244538229.
  14. Ch5.2: T. Nguyen, "Tree-of-Thought (ToT) Fundamentals," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 5.2. ISBN: 9798244538229.
  15. Ch6.3A: T. Nguyen, "ETL Pipeline Fundamentals," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 6.3A. ISBN: 9798244538229.
  16. Ch7.1A: T. Nguyen, "Advanced Implementation with Nvidia NEMO Framework and Nvlink," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 7.1A. ISBN: 9798244538229.
  17. Ch7.1B: T. Nguyen, "Nvidia NIM and Colang," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 7.1B. ISBN: 9798244538229.
  18. Ch7.3: T. Nguyen, "NeMo Agent Toolkit Profiling," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 7.3. ISBN: 9798244538229.
  19. Ch8.1: T. Nguyen, "Latency Metrics," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 8.1. ISBN: 9798244538229.
  20. Ch8.2A: T. Nguyen, "Error Rates and Reliability," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 8.2A. ISBN: 9798244538229.
  21. Ch8.2B: T. Nguyen, "NeMo Guardrails Integration," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 8.2B. ISBN: 9798244538229.
  22. Ch9.2: T. Nguyen, "Action Constraints and Permission Models," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 9.2. ISBN: 9798244538229.
  23. Ch9.4: T. Nguyen, "Fairness and Bias Mitigation," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 9.4. ISBN: 9798244538229.
  24. Ch9.7: T. Nguyen, "GDPR and Data Protection Regulations," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 9.7. ISBN: 9798244538229.
  25. Ch10.1: T. Nguyen, "Conversational UI," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 10.1. ISBN: 9798244538229.