Safety & Security · Human role
Security Analyst
Human roleSafety & SecuritySafety, Security & Governancearc:SecurityAnalyst
A security or ML-safety team member who investigates safety-violation alerts, adversarial prompting patterns and the effectiveness of guardrail policies.
Responsibility. Responds to safety-violation spikes by hardening prompts and guardrail policies.
Also known as: Security team, Security/ML team, Security operations center staff
Relationships
invokes dependency
is triggered by dynamic
receives data from dynamic
receives escalation from dynamic
sends data to dynamic
audits assurance
evaluates assurance
Design guidance
- SHOULD receive safety-violation alerts separately from infrastructure alerts routed to operations.
- SHOULD review sandbox policies quarterly and on capability changes to prevent permission creep and staleness.
- SHOULD revoke and rotate compromised credentials during privacy-breach containment.
Classification
- Quality attributes
- Security (ISO/IEC 25010 | NIST AI RMF: secure and resilient)
- Risks mitigated
- Coordinated jailbreak campaignsGuardrail policy drift
Sources
- Ch8.2B: T. Nguyen, "NeMo Guardrails Integration," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 8.2B. ISBN: 9798244538229.
- Ch9.1: T. Nguyen, "Output Filtering and Content Moderation," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 9.1. ISBN: 9798244538229.
- Ch9.3: T. Nguyen, "Sandboxing and Transparency Foundations," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 9.3. ISBN: 9798244538229.
- Ch9.7: T. Nguyen, "GDPR and Data Protection Regulations," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 9.7. ISBN: 9798244538229.
- Ch10.5: T. Nguyen, "Human-over-the-Loop," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 10.5. ISBN: 9798244538229.
- Ref9.08: "Safety Incident Response for AI Systems," unpublished reference note (08-Safety-Incident-Response.md), Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam supplementary materials, 2026. unpublished note
- Ref9.09: "Compliance Automation and Tools," unpublished reference note (09-Compliance-Automation-Tools.md), Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam supplementary materials, 2026. unpublished note