Infrastructure · Software component

High-Performance Reverse Proxy

Software componentInfrastructureInfrastructurearc:HighPerformanceReverseProxy

An API gateway proxy with minimal per-request processing that forwards and load-balances traffic to backend agents, optionally serving as the cluster ingress controller.

Responsibility. Forwards and balances entry traffic with minimal latency overhead.

Also known as: Performance-optimized reverse proxy, Ingress controller

Variant of API Gateway Proxy abstract

When to choose. Choose when maximum performance and operational simplicity outweigh API-management features, authentication/rate limiting live elsewhere, and routing plus load balancing suffice.

Direct neighbourhood (hover for relationship types)

Relationships

deployed on structural

Container Orchestrator Ch4.1

alternative to variability

Policy Plugin Gateway Ch4.1

Quantitative guidance

As stated by the sources; verify before use.

~2.6x higher API calls/s and 44% lower latency on small responses than a plugin gateway; ~30,000 RPS at 100% success with sub-30 ms latency (Ch4.1).

Classification

Patterns: Round-robinLeast-connectionsIP-hash session affinityRandom selectionKubernetes ingress
Technologies: NGINXNGINX PlusNGINX Ingress Controller
Quality attributes: Performance efficiency (ISO/IEC 25010)Maintainability (ISO/IEC 25010)
Risks mitigated: Gateway-induced latency

Sources

Ch4.1: T. Nguyen, "Introduction to AI Agent Deployment and Scaling," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 4.1. ISBN: 9798244538229.