Infrastructure · Data artifact
Serverless Hosting Plan
Data artifactInfrastructureInfrastructureVariation point (abstract)arc:ServerlessHostingPlan
An abstract configuration selecting how a serverless runtime provisions capacity for a function, trading cold-start latency and timeout limits against idle cost.
Responsibility. Fixes the capacity provisioning and billing model of a serverless function.
Also known as: Function hosting plan
Variants
| Variant | When to choose |
|---|---|
| On-Demand Consumption Plan | Choose for variable, unpredictable or infrequently triggered agent workloads. |
| Pre-warmed Capacity Plan | Choose for latency-sensitive agents requiring consistent performance; avoid enabling it for all functions, since it pays for idle capacity and removes serverless's main cost benefit. |
| Reserved Capacity Plan | Choose for predictable, constant high-volume agent workloads where reserved capacity costs less than pay-per-execution billing. |
Relationships
configures structural
Design guidance
- SHOULD choose the plan per agent workload: consumption for sporadic agents, pre-warmed for latency-sensitive agents, reserved capacity for constant high-volume agents.
Classification
- Technologies
- Azure Functions hosting plansAWS Lambda Provisioned Concurrency
- Quality attributes
- Cost efficiencyReliability (ISO/IEC 25010 | NIST AI RMF: valid and reliable)
Sources
- Ch4.2: T. Nguyen, "Deployment and Scaling," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 4.2. ISBN: 9798244538229.