Infrastructure · Data artifact

Serverless Hosting Plan

Data artifactInfrastructureInfrastructureVariation point (abstract)arc:ServerlessHostingPlan

An abstract configuration selecting how a serverless runtime provisions capacity for a function, trading cold-start latency and timeout limits against idle cost.

Responsibility. Fixes the capacity provisioning and billing model of a serverless function.

Also known as: Function hosting plan

configuresis specialized byis specialized byis specialized byServerless Function Runtime: configuresServerless Function Runt…On-Demand Consumption Plan: is specialized byOn-Demand Consumption PlanPre-warmed Capacity Plan: is specialized byPre-warmed Capacity PlanReserved Capacity Plan: is specialized byReserved Capacity Plan
Direct neighbourhood (hover for relationship types)

Variants

VariantWhen to choose
On-Demand Consumption PlanChoose for variable, unpredictable or infrequently triggered agent workloads.
Pre-warmed Capacity PlanChoose for latency-sensitive agents requiring consistent performance; avoid enabling it for all functions, since it pays for idle capacity and removes serverless's main cost benefit.
Reserved Capacity PlanChoose for predictable, constant high-volume agent workloads where reserved capacity costs less than pay-per-execution billing.

Relationships

configures structural

Design guidance

Classification

Technologies
Azure Functions hosting plansAWS Lambda Provisioned Concurrency
Quality attributes
Cost efficiencyReliability (ISO/IEC 25010 | NIST AI RMF: valid and reliable)

Sources

  1. Ch4.2: T. Nguyen, "Deployment and Scaling," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 4.2. ISBN: 9798244538229.