Agentic AI Reference Architecture

Cognition · Software component

CoT Rationale Generator

Software componentCognitionCognition & Memoryarc:CoTRationaleGenerator

A generator that produces intermediate reasoning chains for selected demonstration questions via zero-shot chain-of-thought prompting, replacing manual authoring of reasoning exemplars.

Responsibility. Generates reasoning-chain demonstrations automatically.

Also known as: Auto-CoT demonstration generation, Reasoning chain generator

invokeswritesreceives data fromreadsLLM Inference Service: invokesLLM Inference ServicePrompt Exemplar Set: writesPrompt Exemplar SetCluster-Diverse Exemplar Selector: receives data fromCluster-Diverse Exemplar…Zero-Shot CoT Prompt: readsZero-Shot CoT Prompt
Direct neighbourhood (hover for relationship types)

Relationships

invokes dependency

reads dependency

writes dependency

receives data from dynamic

Classification

Patterns
Automatic chain-of-thought (Auto-CoT)Zero-shot CoT ('Let's think step by step')Auto-CoTZero-shot CoT bootstrapping
Quality attributes
Maintainability (ISO/IEC 25010)Performance efficiency (ISO/IEC 25010)
Risks mitigated
Labor-intensive manual reasoning-chain creation

Sources

  1. Ch3.5: T. Nguyen, "Prompt Optimization, Few-Shot Learning, Fine-Tuning," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 3.5. ISBN: 9798244538229.
  2. Ch5.1: T. Nguyen, "Chain-of-Thought (CoT) Fundamentals," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 5.1. ISBN: 9798244538229.