Orchestration · Data store

State Checkpoint Store

Data storeOrchestrationOrchestration & ToolsVariation point (abstract)arc:StateCheckpointStore

A database to which a checkpointer persists agent/thread state so conversations can resume across sessions, restarts and idle periods.

Responsibility. Persists agent state snapshots for thread resumption.

Also known as: Checkpointer, State storage, State persistence, Agent State Store, Memory Backend, Shared coordination state database, Workflow state database, State snapshots, Checkpointer backend, Persistence layer, thread_id-keyed checkpoints, Serverless workflow checkpoint store, Asynchronous HITL checkpoint

is written by; is read byis written by; is read byis read by; is written byis read by; is written byis written byis read byis read byis read byis written byis read byis written byis specialized byis read byis specialized byis specialized byis written byis specialized byis specialized byAgent Controller: is written by; is read byAgent ControllerState-Graph Orchestrator: is written by; is read byState-Graph OrchestratorEvent-Triggered Agent: is read by; is written byEvent-Triggered AgentWorkflow Execution Debugger: is read by; is written byWorkflow Execution Debug…Worker Agent: is written byWorker AgentSupervisor Agent: is read bySupervisor AgentRetry Handler: is read byRetry HandlerExecution Monitor Console: is read byExecution Monitor ConsoleGraph-of-Thought Controller: is written byGraph-of-Thought Control…Handoff Context Packager: is read byHandoff Context PackagerState Concurrency Controller: is written byState Concurrency Contro…In-Memory State Store: is specialized byIn-Memory State StoreStalled Workflow Resumer: is read byStalled Workflow ResumerDatabase State Store: is specialized byDatabase State StoreDistributed Cache State Store: is specialized byDistributed Cache State …Durable State Machine Orchestrator: is written byDurable State Machine Or…Graph State Store: is specialized byGraph State StoreSerialized File State Store: is specialized bySerialized File State St…+1 more (see relationships)
Direct neighbourhood (hover for relationship types)

Variants

VariantWhen to choose
Database State StoreChoose for long-running processes (hours or days) whose state must survive instance failure and be resumable by any instance.
Distributed Cache State StoreChoose for multi-agent or multi-instance systems needing shared, low-latency state for horizontal scaling.
Graph State StoreChoose when state needs both persistence and relational context (e.g., ticket, related tickets, consulted articles).
In-Memory State StoreChoose for short-lived, agent-local workflows that complete in seconds to minutes on a single instance; state is lost if the instance fails.
Serialized File State StoreChoose when persistence is needed but relational queries over state are not.

Relationships

is read by dependency

is written by dependency

is constrained by control

Design guidance

Quantitative guidance

As stated by the sources; verify before use.

Classification

Patterns
Checkpoint and resumeReplayExternalized stateCheckpoint after every nodeResume from last checkpointTime-travel debuggingHuman-in-the-loop interruption
Technologies
LangGraph checkpointersPostgreSQLLangGraphLangGraph checkpointerSQLiteRedisPineconeAmazon S3Amazon DynamoDB
Quality attributes
Reliability (ISO/IEC 25010 | NIST AI RMF: valid and reliable)Performance efficiency (ISO/IEC 25010)
Risks mitigated
Lost conversation threads on service restartFull-workflow restart after partial failureWasted API calls from full restartsLoss of workflow progress on replica failureRe-execution of expensive LLM calls after mid-workflow failureTimeout failures in long-running workflows

Sources

  1. Ch1.4: T. Nguyen, "Memory and Perception Systems," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 1.4. ISBN: 9798244538229.
  2. Ch1.5A: T. Nguyen, "Stateful Orchestration - Introduction and Core Concepts," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 1.5A. ISBN: 9798244538229.
  3. Ch1.5B: T. Nguyen, "Stateful Orchestration - Worked Examples," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 1.5B. ISBN: 9798244538229.
  4. Ch1.6: T. Nguyen, "Stateful Orchestration - Pitfalls, Integration, and Synthesis," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 1.6. ISBN: 9798244538229.
  5. Ch1.7B: T. Nguyen, "Relational Reasoning with Knowledge Graphs - Hybrid RAG+KG Integration," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 1.7B. ISBN: 9798244538229.
  6. Ch1.8: T. Nguyen, "Scalability and Production Deployment," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 1.8. ISBN: 9798244538229.
  7. Ch2.1: T. Nguyen, "Framework Landscape and Selection," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 2.1. ISBN: 9798244538229.
  8. Ch2.2: T. Nguyen, "LangGraph," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 2.2. ISBN: 9798244538229.
  9. Ch2.3: T. Nguyen, "LangChain Sequential Frameworks," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 2.3. ISBN: 9798244538229.
  10. Ch2.4: T. Nguyen, "Multi-Agent Frameworks," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 2.4. ISBN: 9798244538229.
  11. Ch3.6: T. Nguyen, "Trace Analysis and Execution Debugging," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 3.6. ISBN: 9798244538229.
  12. Ch4.2: T. Nguyen, "Deployment and Scaling," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 4.2. ISBN: 9798244538229.
  13. Ch5.2: T. Nguyen, "Tree-of-Thought (ToT) Fundamentals," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 5.2. ISBN: 9798244538229.
  14. Ch10.2: T. Nguyen, "Proactive Agents," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 10.2. ISBN: 9798244538229.
  15. Ch10.4: T. Nguyen, "Human-in-the-Loop," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 10.4. ISBN: 9798244538229.