Agentic AI Reference Architecture

Experience · Interface

Streaming Transport

InterfaceExperienceExperience & Human OversightVariation point (abstract)arc:StreamingTransport

An abstract client-facing transport through which incremental agent output is delivered from server to client while it is still being generated.

Responsibility. Carries progressively generated agent output to the client over a long-lived connection.

Also known as: Streaming endpoint, Streaming protocol

is invoked byis exposed byis monitored byis specialized byis specialized byConversational (Chat) Interface: is invoked byConversational (Chat) In…Response Streamer: is exposed byResponse StreamerStream Connection Manager: is monitored byStream Connection ManagerServer-Sent Events Stream: is specialized byServer-Sent Events StreamWebSocket Channel: is specialized byWebSocket Channel
Direct neighbourhood (hover for relationship types)

Variants

VariantWhen to choose
Server-Sent Events StreamChoose for most agent streaming workflows: the user submits a query, the agent streams a response, and no mid-stream client-to-server interaction is needed.
WebSocket ChannelChoose for genuinely interactive scenarios: agents expecting mid-stream user feedback or interruption, collaborative multi-user agent sessions, or real-time dashboards whose pushed updates need client acknowledgment.

Relationships

is exposed by structural

is invoked by dependency

is monitored by assurance

Classification

Patterns
Progressive deliveryGenerate-and-stream-simultaneously
Quality attributes
Performance efficiency (ISO/IEC 25010)Interaction capability (ISO/IEC 25010)
Risks mitigated
User abandonment during blank-screen waitsInability to distinguish slow processing from silent failure

Sources

  1. Ch2.9: T. Nguyen, "Streaming and Real-Time Responses," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 2.9. ISBN: 9798244538229.