Agentic AI Reference Architecture

Infrastructure · Software component

Shard Query Router

Software componentInfrastructureInfrastructurearc:ShardQueryRouter

A cluster component on every node that forwards each request to a node owning the relevant shard and redirects to replica shards when an owner is degraded.

Responsibility. Routes queries to shard owners, failing over to replicas.

Also known as: Query forwarding

deployed onroutes tois triggered byContainer Orchestrator: deployed onContainer OrchestratorVector Store Query API: routes toVector Store Query APIGossip Membership Service: is triggered byGossip Membership Service
Direct neighbourhood (hover for relationship types)

Relationships

deployed on structural

is triggered by dynamic

routes to dynamic

Sources

  1. Ch6.2B: T. Nguyen, "Production Vector Database Deployment," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 6.2B. ISBN: 9798244538229.