Agentic AI Reference Architecture

Safety & Security · Software component

Self-Hosted Moderation Service

Software componentSafety & SecuritySafety, Security & Governancearc:SelfHostedModerationService

A moderation inference service running a classification model on the organization's own CPU or GPU infrastructure.

Responsibility. Runs moderation models in-house without exposing content externally.

Variant of Moderation Inference Service abstract

When to choose. Choose when lower latency is needed and content must not be exposed to third parties (critical for HIPAA or GDPR), and ML infrastructure expertise is available.

alternative tospecializeshostsThird-Party Moderation Service: alternative toThird-Party Moderation S…Moderation Inference Service: specializesModeration Inference Ser…Toxicity Classification Model: hostsToxicity Classification …
Direct neighbourhood (hover for relationship types)

Relationships

hosts structural

alternative to variability

Classification

Quality attributes
Performance efficiency (ISO/IEC 25010)Privacy (NIST AI RMF: privacy-enhanced)
Risks mitigated
Exposure of user content to third-party services
Frameworks & regulations
HIPAAGDPR

Sources

  1. Ch9.1: T. Nguyen, "Output Filtering and Content Moderation," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 9.1. ISBN: 9798244538229.