Observability & Evaluation · Data artifact

Integration Test Suite

Data artifactObservability & EvaluationObservability & Evaluationarc:IntegrationTestSuite

A set of tests that run complete agent workflows against real tools, APIs and databases, checking tool coordination and response content on critical paths and edge cases.

Responsibility. Specifies end-to-end workflow checks of agent tool orchestration.

Also known as: Workflow integration tests

is read byAgent Test Runner: is read byAgent Test Runner
Direct neighbourhood (hover for relationship types)

Relationships

is read by dependency

Classification

Patterns
Critical-path plus edge-case coverage
Quality attributes
Reliability (ISO/IEC 25010 | NIST AI RMF: valid and reliable)
Risks mitigated
Broken tool coordinationHallucinated or incomplete responses

Sources

  1. Ch4.2: T. Nguyen, "Deployment and Scaling," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 4.2. ISBN: 9798244538229.