Tools & Integration · Software component
Circuit Breaker
Software componentTools & IntegrationOrchestration & Toolsarc:CircuitBreaker
A resilience component that stops calls to a persistently failing external dependency to prevent cascading failure and enable graceful degradation.
Responsibility. Stops calls to failing dependencies.
Also known as: Bulkhead, Per-agent circuit breaker
Relationships
deployed on structural
is configured by structural
is invoked by dependency
- Worker Agent abstract Ch2.8
reads dependency
emits telemetry to dynamic
sends data to dynamic
triggers dynamic
guards control
- Agent Controller abstract Ch2.8
- Agent Service API abstract Ch1.3
- External Service API Ch2.8 Ch8.2A +1
- Graph Retriever Ch1.7B
- Knowledge Retrieval Agent Ch4.2
- LLM Inference Service Ch2.8 Ch6.5
- Tool Integration Adapter abstract Ch1.2 Ref8.06
- Vector Index Store abstract Ch6.5
- Worker Agent abstract Ch1.3
is monitored by assurance
Design guidance
- SHOULD be applied to persistent failures, complementing retries for transient ones.
- MUST be placed between agents so one agent's failure cannot hang the whole workflow.
- SHOULD be combined with client-side timeouts and a fallback path.
- SHOULD give each component or agent an independent breaker per dependency, with thresholds tuned to that dependency's reliability.
- SHOULD enter a half-open state after a recovery timeout, closing on a successful trial request and reopening on failure.
- SHOULD return an empty or cached result when open so downstream consumers can degrade gracefully instead of throwing.
- MUST emit state transitions and alert operators when a circuit stays open beyond the expected recovery window.
- SHOULD wrap framework-built agents to provide unified resilience across workflows.
- MUST stop sending requests to a struggling service on elevated error rate or latency and periodically probe for recovery, since continued requests queue additional load.
- SHOULD be combined with retries with exponential backoff, fallbacks and bulkheads that isolate failure domains.
- SHOULD open on error-rate or latency thresholds, fail fast, and probe recovery in a half-open state after cooldown.
Quantitative guidance
As stated by the sources; verify before use.
- Example trip threshold: 50% of requests failing over 60 s; example half-open probe after ~30 s (Ch2.8).
- Example tuning: external search API 3 failures / 30 s timeout; LLM API 5 failures / 60 s timeout (Ch2.8).
- Example opens after 5 consecutive failures; > 10 retries per trace signals a potential cascade (Ref8.06).
Classification
- Patterns
- Circuit breakerGraceful degradationCircuit breaker (closed/open/half-open)Fail fastFailure isolationAutomatic recovery detectionClosed / open / half-open circuit states
- Technologies
- HystrixResilience4j
- Quality attributes
- Reliability (ISO/IEC 25010 | NIST AI RMF: valid and reliable)Security (ISO/IEC 25010 | NIST AI RMF: secure and resilient)Performance efficiency (ISO/IEC 25010)
- Risks mitigated
- Persistent dependency failuresService outagesCascading failuresBlocked upstream agentsCascading failures when graph queries time outCascading failures across multi-agent pipelinesThread-pool exhaustion waiting on broken servicesRetry storms against failed servicesCascading failures from retry storms
Sources
- Ch1.2: T. Nguyen, "Core Agent Patterns," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 1.2. ISBN: 9798244538229.
- Ch1.3: T. Nguyen, "Multi-Agent Systems," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 1.3. ISBN: 9798244538229.
- Ch1.7B: T. Nguyen, "Relational Reasoning with Knowledge Graphs - Hybrid RAG+KG Integration," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 1.7B. ISBN: 9798244538229.
- Ch2.8: T. Nguyen, "Error Handling and Resilience," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 2.8. ISBN: 9798244538229.
- Ch4.1: T. Nguyen, "Introduction to AI Agent Deployment and Scaling," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 4.1. ISBN: 9798244538229.
- Ch4.2: T. Nguyen, "Deployment and Scaling," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 4.2. ISBN: 9798244538229.
- Ch4.3: T. Nguyen, "Container Orchestration and Edge Deployment," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 4.3. ISBN: 9798244538229.
- Ch6.5: T. Nguyen, "Production RAG Systems," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 6.5. ISBN: 9798244538229.
- Ch8.2A: T. Nguyen, "Error Rates and Reliability," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 8.2A. ISBN: 9798244538229.
- Ch8.2B: T. Nguyen, "NeMo Guardrails Integration," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 8.2B. ISBN: 9798244538229.
- Ref8.06: "Error Troubleshooting and Incident Response for Agent Systems," unpublished reference note (06-Error-Troubleshooting-Incident-Response.md), Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam supplementary materials, 2026. unpublished note