Infrastructure · Software component

Cluster Consensus Coordinator

Software componentInfrastructureInfrastructurearc:ClusterConsensusCoordinator

A replicated coordination component that maintains consistent cluster state by majority quorum and elects a leader node, redistributing workloads when the leader or a node fails.

Responsibility. Provides quorum-based leader election and automatic failover for a small on-site cluster.

Also known as: Edge high-availability controller, Leader election

orchestratesdeployed onreceives data fromInference Server: orchestratesInference ServerEdge GPU Device: deployed onEdge GPU DeviceDistributed Vector Index Store: receives data fromDistributed Vector Index…
Direct neighbourhood (hover for relationship types)

Relationships

deployed on structural

receives data from dynamic

orchestrates control

Design guidance

Quantitative guidance

As stated by the sources; verify before use.

Classification

Patterns
Raft consensusLeader electionController-plus-worker nodes
Technologies
NVIDIA Fleet Commandetcd
Quality attributes
Reliability (ISO/IEC 25010 | NIST AI RMF: valid and reliable)
Risks mitigated
Loss of automatic failover in two-node configurations lacking quorumSite outage from single hardware failure

Sources

  1. Ch4.6: T. Nguyen, "TensorRT-LLM and NVIDIA Fleet Command," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 4.6. ISBN: 9798244538229.
  2. Ch6.2A: T. Nguyen, "Vector Database Selection," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 6.2A. ISBN: 9798244538229.