Model Serving · Data artifact

Model Ensemble Definition

Data artifactModel ServingModelsarc:ModelEnsembleDefinition

A declarative pipeline configuration specifying member models and the input/output tensor mappings, including conditional routes, between them.

Responsibility. Defines the dataflow of an in-server model pipeline.

Also known as: Ensemble configuration

Direct neighbourhood (hover for relationship types)

Relationships

configures structural

Model Ensemble Orchestrator Ch4.5

Design guidance

MUST match member model input/output signatures precisely.

Classification

Technologies: NVIDIA Triton Inference Server

Sources

Ch4.5: T. Nguyen, "NVIDIA NIM and Triton Inference Server," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 4.5. ISBN: 9798244538229.