Agentic AI Reference Architecture

Infrastructure · Interface

Readiness Endpoint

InterfaceInfrastructureInfrastructurearc:ReadinessEndpoint

A health endpoint reporting whether a replica can serve traffic (e.g., model fully loaded); failure removes it from load-balancer rotation without restart.

Responsibility. Reports whether the replica is ready to receive traffic.

Also known as: Readiness probe endpoint, /v1/health/ready, /v1/.well-known/ready, Health check endpoint, /v1/models

is monitored by; is invoked byis monitored by; is invoked byis exposed byis exposed byis exposed byis monitored byis invoked byis exposed byis monitored byLoad Balancer: is monitored by; is invoked byLoad BalancerContainer Health Prober: is monitored by; is invoked byContainer Health ProberAgent Controller: is exposed byAgent ControllerLLM Inference Service: is exposed byLLM Inference ServiceInference Server: is exposed byInference ServerRollout Manager: is monitored byRollout ManagerContinuous Integration Runner: is invoked byContinuous Integration R…RAG Query Orchestrator: is exposed byRAG Query OrchestratorGitOps Reconciler: is monitored byGitOps Reconciler
Direct neighbourhood (hover for relationship types)

Relationships

is exposed by structural

is invoked by dependency

is monitored by assurance

Quantitative guidance

As stated by the sources; verify before use.

Classification

Patterns
Readiness probe
Technologies
NVIDIA NIM /v1/health/ready
Quality attributes
Reliability (ISO/IEC 25010 | NIST AI RMF: valid and reliable)
Risks mitigated
Routing traffic to replicas still loading models

Sources

  1. Ch1.8: T. Nguyen, "Scalability and Production Deployment," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 1.8. ISBN: 9798244538229.
  2. Ch2.7: T. Nguyen, "Multimodal RAG Approaches," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 2.7. ISBN: 9798244538229.
  3. Ch4.1: T. Nguyen, "Introduction to AI Agent Deployment and Scaling," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 4.1. ISBN: 9798244538229.
  4. Ch4.3: T. Nguyen, "Container Orchestration and Edge Deployment," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 4.3. ISBN: 9798244538229.
  5. Ch4.4: T. Nguyen, "Performance Profiling and Optimization," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 4.4. ISBN: 9798244538229.
  6. Ch4.5: T. Nguyen, "NVIDIA NIM and Triton Inference Server," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 4.5. ISBN: 9798244538229.
  7. Ch4.7: T. Nguyen, "Scaling Strategies," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 4.7. ISBN: 9798244538229.
  8. Ch6.2B: T. Nguyen, "Production Vector Database Deployment," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 6.2B. ISBN: 9798244538229.
  9. Ch6.5: T. Nguyen, "Production RAG Systems," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 6.5. ISBN: 9798244538229.
  10. Ref7.04: NVIDIA, "NVIDIA NIM," NVIDIA Docs. Accessed: Sep. 27, 2026. [Online]. Available: https://docs.nvidia.com/nim/