Infrastructure · Infrastructure resource
Inter-Node Network Fabric
Infrastructure resourceInfrastructureInfrastructurearc:InterNodeNetworkFabric
A high-performance cluster network linking GPU nodes for cross-node collective communication and pipeline stage transfers.
Responsibility. Carries GPU traffic between nodes.
Also known as: InfiniBand
Relationships
hosts structural
Quantitative guidance
As stated by the sources; verify before use.
- Cross-node InfiniBand (25 GB/s) imposes 20-35% tensor-parallel overhead (Ch7.1A).
Classification
- Technologies
- InfiniBand
Sources
- Ch7.1A: T. Nguyen, "Advanced Implementation with Nvidia NEMO Framework and Nvlink," in Mastering Agentic AI Systems: Guide for the NVIDIA NCP-AAI Exam, 1st ed. 2026, ch. 7.1A. ISBN: 9798244538229.