Infrastructure · Software component
Spot Interruption Handler
Software componentInfrastructureInfrastructurearc:SpotInterruptionHandler
A control component that detects provider termination warnings for interruptible instances, drains their in-flight requests and shifts load to on-demand capacity.
Responsibility. Gracefully evacuates work from spot instances facing termination.
Also known as: Spot termination handler, Node drainer
Relationships
Design guidance
- MUST drain in-flight requests and shift load before termination without dropping requests or violating latency SLAs.
Classification
- Patterns
- Graceful drainOn-demand fallback buffer
- Quality attributes
- Reliability (ISO/IEC 25010 | NIST AI RMF: valid and reliable)Cost efficiency
- Risks mitigated
- Dropped requests on spot terminationLatency SLO violations after capacity loss
Sources
- Ch4.7: T. Nguyen, "Scaling Strategies," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 4.7. ISBN: 9798244538229.