面向BCube拓扑的All-Reduce在网计算加速算法OA
An in-network computing acceleration algorithm for All-Reduce targeting the server-centric BCube topology
随着大规模并行计算和深度学习任务对通信性能的要求不断提高,传统基于主机执行的集合通信算法逐渐成为系统性能瓶颈.在网计算通过将 All-Reduce 操作卸载至网络设备中执行,已成为突破通信瓶颈的重要方向.然而,现有主流在网计算方法多依赖于以交换机为中心的拓扑结构(如 FatTree),难以适配以服务器为中心的拓扑结构(如 BCube).面向以服务器为中心的 BCube 拓扑提出了 All-Reduce 在网计算加速算法 BCube-INC.该算法基于 BCube 的层次化结构的特点,设计了多棵静态归约树构建机制,并结合进程级路径调度策略,实现归约与广播过程在物理路径上的隔离与并发.在 BCube拓扑上评估并比较 BCube-INC 算法、Ring All-Reduce 以及 BML 算法的性能,结果显示 Ring All-Reduce、BML 算法与 BCube-INC 算法的延迟分别为 104.85 μs,18.12 μs,16.5 μs,提出的 BCube-INC 算法与BML 算法的加速比最高可以达到 1.93.相较于 BML 算法,BCube-INC 算法可以实现近 2 倍的带宽提升.
As the communication performance requirements of large-scale parallel computing and deep learning tasks continue to grow,traditional host-based collective communication algorithms have gradually become a bottleneck in system performance.In-network computing,which offloads All-Reduce operations to network devices for execution,has emerged as a crucial approach for overcoming communication bottlenecks.However,most existing mainstream in-network computing approaches rely heavily on switch-centric topologies(e.g.,FatTree)and are difficult to adapt to server-centric topolo-gies(e.g.,BCube).This paper proposes BCube-INC,an in-network computing acceleration algorithm for All-Reduce targeting the server-centric BCube topology.Building on the hierarchical structure of BCube,the algorithm constructs multiple static reduction trees and applies a process-level path schedu-ling strategy to isolate their physical paths,enabling the reduction and broad cast processes to run con-currently.Performance evaluations and comparisons on the BCube(3,2)topology show that the laten-cies of Ring All-Reduce,BML,and the proposed algorithm are 104.85 μs,18.12 μs,and 16.5 μs,respec-tively,with the proposed algorithm achieving a maximum speedup of 1.93 over BML.Compared with the BML algorithm,the proposed algorithm achieves nearly 2 times bandwidth improvement.
刘继冉;雷斐;马骏超;董德尊;时向泉
国防科技大学计算机学院,湖南长沙 410073国防科技大学计算机学院,湖南长沙 410073国防科技大学计算机学院,湖南长沙 410073国防科技大学计算机学院,湖南长沙 410073国防科技大学计算机学院,湖南长沙 410073
信息技术与安全科学
BCube拓扑SHArP架构在网计算All-Reduce操作层次化拓扑结构
BCube topologyscalable hierarchical aggregation protocol(SHArP)architecturein-network computingAll-Reduce operationhierarchical topology structure
《计算机工程与科学》 2026 (9)
1536-1547,12
国家自然科学基金(62202482)并行与分布计算全国重点实验室基金(2024-KJWPDL-11)
评论