Agentic AI Reference Architecture

Memory · Data store

Graph Reasoning State Store

Data storeMemoryCognition & Memoryarc:GraphReasoningStateStore

Working-memory store holding all generated thoughts of a reasoning episode as DAG vertices with dependency edges, scores and transformation history, queryable and serializable.

Responsibility. Maintains the explicit reasoning DAG for the current problem.

Also known as: Graph Reasoning State (GRS), Reasoning graph, System non-parametric short-term memory

Variant of Working Memory Buffer abstract

When to choose. Choose when thoughts need multiple parents so independent reasoning chains can merge.

is read by; is written byis written byspecializesis written byis read byalternative tois read byis read byGraph-of-Thought Controller: is read by; is written byGraph-of-Thought Control…Worker Agent: is written byWorker AgentWorking Memory Buffer: specializesWorking Memory BufferThought State Evaluator: is written byThought State EvaluatorPlan Template Extractor: is read byPlan Template ExtractorThought Tree Store: alternative toThought Tree StoreReasoning Graph Analyzer: is read byReasoning Graph AnalyzerReasoning Strategy Refiner: is read byReasoning Strategy Refiner
Direct neighbourhood (hover for relationship types)

Relationships

is read by dependency

is written by dependency

alternative to variability

Design guidance

Classification

Patterns
Graph-of-ThoughtReasoning as explicit working memory
Quality attributes
Explainability (NIST AI RMF: explainable and interpretable)Maintainability (ISO/IEC 25010)
Risks mitigated
Circular reasoningOpaque reasoning processes

Sources

  1. Ch5.2: T. Nguyen, "Tree-of-Thought (ToT) Fundamentals," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 5.2. ISBN: 9798244538229.