Infrastructure · Infrastructure resource

Inter-Node Network Fabric

Infrastructure resourceInfrastructureInfrastructurearc:InterNodeNetworkFabric

A high-performance cluster network linking GPU nodes for cross-node collective communication and pipeline stage transfers.

Responsibility. Carries GPU traffic between nodes.

Also known as: InfiniBand

hostshostsPipeline Parallel Executor: hostsPipeline Parallel ExecutorCollective Communication Library: hostsCollective Communication…
Direct neighbourhood (hover for relationship types)

Relationships

hosts structural

Quantitative guidance

As stated by the sources; verify before use.

Classification

Technologies
InfiniBand

Sources

  1. Ch7.1A: T. Nguyen, "Advanced Implementation with Nvidia NEMO Framework and Nvlink," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 7.1A. ISBN: 9798244538229.