Agentic AI Reference Architecture

Orchestration · Data store

In-Memory State Store

Data storeOrchestrationOrchestration & Toolsarc:InMemoryStateStore

A state checkpoint store that keeps workflow state in the agent process's memory for the duration of a task.

Responsibility. Keeps workflow state in process memory for short-lived tasks.

Also known as: Agent-local state

Variant of State Checkpoint Store abstract

When to choose. Choose for short-lived, agent-local workflows that complete in seconds to minutes on a single instance; state is lost if the instance fails.

specializesis target of alternativeTois target of alternativeTois target of alternativeToalternative toState Checkpoint Store: specializesState Checkpoint StoreDatabase State Store: is target of alternativeToDatabase State StoreDistributed Cache State Store: is target of alternativeToDistributed Cache State …Graph State Store: is target of alternativeToGraph State StoreSerialized File State Store: alternative toSerialized File State St…
Direct neighbourhood (hover for relationship types)

Relationships

alternative to variability

Classification

Quality attributes
Performance efficiency (ISO/IEC 25010)

Sources

  1. Ch1.5A: T. Nguyen, "Stateful Orchestration - Introduction and Core Concepts," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 1.5A. ISBN: 9798244538229.
  2. Ch1.6: T. Nguyen, "Stateful Orchestration - Pitfalls, Integration, and Synthesis," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 1.6. ISBN: 9798244538229.
  3. Ch1.7B: T. Nguyen, "Relational Reasoning with Knowledge Graphs - Hybrid RAG+KG Integration," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 1.7B. ISBN: 9798244538229.