Safety & Security · Software component
Output Risk Stratifier
Software componentSafety & SecuritySafety, Security & Governancearc:OutputRiskStratifier
A routing component that classifies each output by criticality and applies a correspondingly lighter or stricter chain of output controls.
Responsibility. Selects output scrutiny level by output criticality.
Also known as: Risk-stratified output controls, Stakes-based display strategy, Decision stakes assessment
Relationships
routes to dynamic
- Approval Gateway Ch9.1
- Content Safety Filter abstract Ch9.1
- Fact Checking Rail abstract Ch9.1
sends data to dynamic
triggers dynamic
Design guidance
- SHOULD apply lighter filtering to general information and stricter scrutiny (fact checking, human approval) to high-criticality outputs such as medication changes.
- Stakes assessment SHOULD be context-sensitive: a normally low-stakes recommendation becomes high-stakes if it may expose children to harm or spread health misinformation.
Classification
- Patterns
- Risk-based filtering
- Frameworks & regulations
- FDA regulations for AI-enabled medical devices
Sources
- Ch9.1: T. Nguyen, "Output Filtering and Content Moderation," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 9.1. ISBN: 9798244538229.
- Ch10.5: T. Nguyen, "Human-over-the-Loop," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 10.5. ISBN: 9798244538229.