Agentic AI Reference Architecture

Infrastructure · Software component

Edge Device Agent

Software componentInfrastructureInfrastructurearc:EdgeDeviceAgent

An on-device management agent that applies updates, maintains the local version manifest, buffers results while offline and reports version and status telemetry when connectivity permits.

Responsibility. Represents the device to central fleet management.

Also known as: Device-side agent, Edge node agent, Edge Sync Agent

is orchestrated by; receives data fromemits telemetry to; receives data fromemits telemetry tosends data todeployed ondeployed onreadsmonitorswriteshas access controlled byemits telemetry toinvokesEdge Update Orchestrator: is orchestrated by; receives data fromEdge Update OrchestratorEdge Fleet Manager: emits telemetry to; receives data fromEdge Fleet ManagerMetrics Collector: emits telemetry toMetrics CollectorData Curator: sends data toData CuratorEdge GPU Device: deployed onEdge GPU DeviceEdge Device: deployed onEdge DeviceContainer and Model Artifact Registry: readsContainer and Model Arti…Edge Inference Runtime: monitorsEdge Inference RuntimeEncrypted Model Volume: writesEncrypted Model VolumeCertificate Authority: has access controlled byCertificate AuthorityRegional Edge Relay: emits telemetry toRegional Edge RelayEdge Provisioning Service: invokesEdge Provisioning Service
Direct neighbourhood (hover for relationship types)

Relationships

deployed on structural

invokes dependency

reads dependency

writes dependency

emits telemetry to dynamic

receives data from dynamic

sends data to dynamic

has access controlled by control

is orchestrated by control

monitors assurance

Design guidance

Classification

Patterns
Local version manifestStore-and-forwardStore-and-forward synchronisationOffline-first edge autonomy
Technologies
NVIDIA Fleet Command
Quality attributes
Transparency and accountability (NIST AI RMF: accountable and transparent)Reliability (ISO/IEC 25010 | NIST AI RMF: valid and reliable)
Risks mitigated
Unknown device state under intermittent connectivityEdge operations halting during network outages

Sources

  1. Ch4.3: T. Nguyen, "Container Orchestration and Edge Deployment," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 4.3. ISBN: 9798244538229.
  2. Ch4.6: T. Nguyen, "TensorRT-LLM and NVIDIA Fleet Command," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 4.6. ISBN: 9798244538229.