Agentic AI Reference Architecture

Infrastructure · Data store

Container and Model Artifact Registry

Data storeInfrastructureInfrastructurearc:ContainerImageRegistry

An authenticated, access-controlled repository that stores tagged container images and optimized model weights and serves them to deployment targets.

Responsibility. Holds versioned deployable images for retrieval by deployments and rollbacks.

Also known as: Container registry, NGC private registry, Private container registry, Fleet Command private application registry, Private Artifact Registry

is read byis read byis read byis read byis written byis read byhas access controlled byLLM Inference Service: is read byLLM Inference ServiceRollout Manager: is read byRollout ManagerEdge Device Agent: is read byEdge Device AgentContainer Image Scanner: is read byContainer Image ScannerContainer Image Builder: is written byContainer Image BuilderInference Service Operator: is read byInference Service OperatorCertificate Authority: has access controlled byCertificate Authority
Direct neighbourhood (hover for relationship types)

Relationships

is read by dependency

is written by dependency

has access controlled by control

Design guidance

Classification

Patterns
Semantic and commit-derived tags
Technologies
Docker HubGitHub Container RegistryAWS ECRGoogle Artifact RegistryGitHub Container Registry (ghcr.io)NVIDIA NGC (nvcr.io)
Quality attributes
Reliability (ISO/IEC 25010 | NIST AI RMF: valid and reliable)Transparency and accountability (NIST AI RMF: accountable and transparent)Privacy (NIST AI RMF: privacy-enhanced)Security (ISO/IEC 25010 | NIST AI RMF: secure and resilient)
Risks mitigated
Unauthorised access to proprietary or fine-tuned modelsModel leakage from public registries

Sources

  1. Ch4.1: T. Nguyen, "Introduction to AI Agent Deployment and Scaling," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 4.1. ISBN: 9798244538229.
  2. Ch4.2: T. Nguyen, "Deployment and Scaling," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 4.2. ISBN: 9798244538229.
  3. Ch4.5: T. Nguyen, "NVIDIA NIM and Triton Inference Server," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 4.5. ISBN: 9798244538229.
  4. Ch4.6: T. Nguyen, "TensorRT-LLM and NVIDIA Fleet Command," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 4.6. ISBN: 9798244538229.