Governance & Compliance · Data artifact
Value Alignment Criteria
Data artifactGovernance & ComplianceSafety, Security & Governancearc:ValueAlignmentCriteria
Explicit criteria distinguishing legitimate proactive assistance, which serves users' stated goals and values, from manipulative intervention that exploits user weaknesses or psychological triggers.
Responsibility. Defines which proactive behaviours are permissible versus manipulative.
Also known as: Anti-manipulation criteria, Personalization ethics boundary
Relationships
constrains control
Design guidance
- MUST define explicitly which proactive behaviours serve user interests versus exploit them; engagement optimization alone cannot make this distinction.
Classification
- Quality attributes
- Interaction capability (ISO/IEC 25010)Transparency and accountability (NIST AI RMF: accountable and transparent)
- Risks mitigated
- Dark patternsDigital manipulationEngagement optimization against user values
Sources
- Ch10.2: T. Nguyen, "Proactive Agents," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 10.2. ISBN: 9798244538229.