Agentic AI Reference Architecture

Model Serving · Model asset

Standard Language Model Tier

Model assetModel ServingModelsarc:MidSizeLanguageModel

A standard-capability model tier (e.g., ~70B parameters) used for moderately complex queries.

Responsibility. Serves moderately complex queries needing more capability than the small tier.

Also known as: Standard model

Variant of Foundation LLM abstract

When to choose. Choose for queries classified as moderately complex.

deployed onis evaluated bydeployed onspecializesis optimized byis optimized byalternative tois target of alternativeToLLM Inference Service: deployed onLLM Inference ServiceEvaluation Harness: is evaluated byEvaluation HarnessInference Server: deployed onInference ServerFoundation LLM: specializesFoundation LLMEngine Builder: is optimized byEngine BuilderModel Quantizer: is optimized byModel QuantizerSmall Language Model Tier: alternative toSmall Language Model TierLarge Language Model Tier: is target of alternativeToLarge Language Model Tier
Direct neighbourhood (hover for relationship types)

Relationships

deployed on structural

is evaluated by assurance

is optimized by lifecycle

alternative to variability

Quantitative guidance

As stated by the sources; verify before use.

Classification

Technologies
Llama-3-70BGPT-4Llama-3.1-70BLlama 2 70BLlama Nemotron 70B InstructNemotron 15B / 22BNemotron 70B
Quality attributes
Functional suitability: correctness and validity (ISO/IEC 25010 | NIST AI RMF: valid)

Sources

  1. Ch1.8: T. Nguyen, "Scalability and Production Deployment," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 1.8. ISBN: 9798244538229.
  2. Ch4.2: T. Nguyen, "Deployment and Scaling," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 4.2. ISBN: 9798244538229.
  3. Ch7.2: T. Nguyen, "Performance Optimization and Production Monitoring," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 7.2. ISBN: 9798244538229.
  4. Ref7.12: "Advanced Nemotron Deployment Patterns," unpublished reference note (12-Nemotron-Advanced-Deployment.md), Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam supplementary materials, 2026. unpublished note
  5. Ref7.13: NVIDIA, "Llama Nemotron," NVIDIA NeMo Framework User Guide, v25.09. Accessed: Sep. 27, 2026. [Online]. Available: https://docs.nvidia.com/nemo-framework/user-guide/25.09/llms/llama_nemotron.html
  6. Ref8.05: "Cost Optimization and Resource Monitoring for Agent Systems," unpublished reference note (05-Cost-Optimization-Resource-Monitoring.md), Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam supplementary materials, 2026. unpublished note