Agentic AI Reference Architecture

Model Serving · Model asset

Independent Draft Model

Model assetModel ServingModelsarc:IndependentDraftModel

An existing small pretrained language model used unmodified as a separate draft for speculative decoding.

Responsibility. Provides zero-training-cost speculative drafts.

Variant of Speculative Draft Model abstract

When to choose. Choose for rapid prototyping where zero training cost and immediate deployment outweigh modest acceptance.

specializesis target of alternativeToSpeculative Draft Model: specializesSpeculative Draft ModelDistilled Draft Model: is target of alternativeToDistilled Draft Model
Direct neighbourhood (hover for relationship types)

Relationships

alternative to variability

Quantitative guidance

As stated by the sources; verify before use.

Classification

Technologies
TinyLlama 1BPhi-2 3B

Sources

  1. Ch7.1A: T. Nguyen, "Advanced Implementation with Nvidia NEMO Framework and Nvlink," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 7.1A. ISBN: 9798244538229.