Agentic AI Reference Architecture

Infrastructure · Interface

Liveness Endpoint

InterfaceInfrastructureInfrastructurearc:LivenessEndpoint

A health endpoint reporting whether a replica process is alive; repeated failure causes the orchestrator to restart it.

Responsibility. Reports whether the replica process is alive.

Also known as: Liveness probe endpoint, /healthz, /health endpoint, /v1/health

is monitored by; is invoked byis exposed byis exposed byis exposed byis invoked byContainer Health Prober: is monitored by; is invoked byContainer Health ProberAgent Controller: is exposed byAgent ControllerLLM Inference Service: is exposed byLLM Inference ServiceInference Server: is exposed byInference ServerSmoke Tester: is invoked bySmoke Tester
Direct neighbourhood (hover for relationship types)

Relationships

is exposed by structural

is invoked by dependency

is monitored by assurance

Classification

Patterns
Liveness probe
Quality attributes
Reliability (ISO/IEC 25010 | NIST AI RMF: valid and reliable)
Risks mitigated
Hung or deadlocked replicas

Sources

  1. Ch1.8: T. Nguyen, "Scalability and Production Deployment," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 1.8. ISBN: 9798244538229.
  2. Ch2.7: T. Nguyen, "Multimodal RAG Approaches," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 2.7. ISBN: 9798244538229.
  3. Ch4.2: T. Nguyen, "Deployment and Scaling," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 4.2. ISBN: 9798244538229.
  4. Ch4.3: T. Nguyen, "Container Orchestration and Edge Deployment," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 4.3. ISBN: 9798244538229.
  5. Ch4.5: T. Nguyen, "NVIDIA NIM and Triton Inference Server," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 4.5. ISBN: 9798244538229.
  6. Ch4.7: T. Nguyen, "Scaling Strategies," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 4.7. ISBN: 9798244538229.
  7. Ref7.04: NVIDIA, "NVIDIA NIM," NVIDIA Docs. Accessed: Sep. 27, 2026. [Online]. Available: https://docs.nvidia.com/nim/