Agentic AI Reference Architecture

Human Oversight · Software component

Escalation Handler

Software componentHuman OversightExperience & Human Oversightarc:EscalationHandler

A workflow node that hands an inquiry to human staff, creating a case number, setting an expected response time, notifying on-call staff, and marking the case escalated in state.

Responsibility. Hands inquiries that need a human over to on-call staff.

Also known as: Escalation node, Human handoff node, Escalation coordinator service, Human appeal pathway, Escalation handoff, Clinical symptom escalation, Coordination agent (human handoff)

receives escalation fromemits telemetry towritesreadsdeployed onis orchestrated byis invoked byreceives escalation fromescalates tois routed to byinvokesreceives escalation fromis triggered byis triggered byis routed to byescalates toinvokesis triggered byAgent Controller: receives escalation fromAgent ControllerMetrics Collector: emits telemetry toMetrics CollectorWorking Memory Buffer: writesWorking Memory BufferConversation State Store: readsConversation State StoreContainer Orchestrator: deployed onContainer OrchestratorState-Graph Orchestrator: is orchestrated byState-Graph OrchestratorEnd User: is invoked byEnd UserAction Policy Engine: receives escalation fromAction Policy EngineHuman Specialist: escalates toHuman SpecialistIntent Router: is routed to byIntent RouterAuthorization Policy Decision Point: invokesAuthorization Policy Dec…Dialog Rail: receives escalation fromDialog RailEscalation Agent: is triggered byEscalation AgentAgent Behavior Anomaly Detector: is triggered byAgent Behavior Anomaly D…Rule-Based Transition Router: is routed to byRule-Based Transition Ro…Service Owner: escalates toService OwnerHandoff Context Packager: invokesHandoff Context PackagerDecision Override Control: is triggered byDecision Override Control+6 more (see relationships)
Direct neighbourhood (hover for relationship types)

Relationships

deployed on structural

is configured by structural

invokes dependency

is invoked by dependency

reads dependency

writes dependency

emits telemetry to dynamic

escalates to dynamic

is routed to by dynamic

is triggered by dynamic

receives escalation from dynamic

is orchestrated by control

is monitored by assurance

produces lifecycle

Design guidance

Classification

Patterns
Human-in-the-loop escalation
Quality attributes
Safety (ISO/IEC 25010 | NIST AI RMF: safe)Interaction capability (ISO/IEC 25010)
Risks mitigated
Automated handling of frustrated customers or legal concernsFriction-based escalation suppression

Sources

  1. Ch1.5B: T. Nguyen, "Stateful Orchestration - Worked Examples," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 1.5B. ISBN: 9798244538229.
  2. Ch2.3: T. Nguyen, "LangChain Sequential Frameworks," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 2.3. ISBN: 9798244538229.
  3. Ch3.8: T. Nguyen, "Action Accuracy Metrics," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 3.8. ISBN: 9798244538229.
  4. Ch4.2: T. Nguyen, "Deployment and Scaling," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 4.2. ISBN: 9798244538229.
  5. Ch8.4: T. Nguyen, "Success Metrics and Multi-Dimensional Measurement," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 8.4. ISBN: 9798244538229.
  6. Ch9.3: T. Nguyen, "Sandboxing and Transparency Foundations," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 9.3. ISBN: 9798244538229.
  7. Ch9.5: T. Nguyen, "Constitutional AI," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 9.5. ISBN: 9798244538229.
  8. Ch10.1: T. Nguyen, "Conversational UI," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 10.1. ISBN: 9798244538229.
  9. Ch10.2: T. Nguyen, "Proactive Agents," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 10.2. ISBN: 9798244538229.
  10. Ch10.5: T. Nguyen, "Human-over-the-Loop," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 10.5. ISBN: 9798244538229.