Agentic AI Reference Architecture

Orchestration · Software component

LLM Transition Router

Software componentOrchestrationOrchestration & Toolsarc:LLMTransitionRouter

A transition router that asks an LLM to reason about which operation to perform next given current state.

Responsibility. Uses LLM reasoning to choose the next workflow operation.

Variant of Transition Router abstract

When to choose. Choose when deciding what to do next requires reasoning, e.g., tasks without predetermined solution paths.

invokesalternative tospecializesis target of alternativeToLLM Inference Service: invokesLLM Inference ServiceRule-Based Transition Router: alternative toRule-Based Transition Ro…Transition Router: specializesTransition RouterHybrid Transition Router: is target of alternativeToHybrid Transition Router
Direct neighbourhood (hover for relationship types)

Relationships

invokes dependency

alternative to variability

Classification

Quality attributes
Flexibility (ISO/IEC 25010)

Sources

  1. Ch1.5A: T. Nguyen, "Stateful Orchestration - Introduction and Core Concepts," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 1.5A. ISBN: 9798244538229.
  2. Ch2.2: T. Nguyen, "LangGraph," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 2.2. ISBN: 9798244538229.