基于组播时间扩展图的集合通信编排算法OA
Multicast time-expanded graph-based collective communication scheduling algorithm
集合通信时延已成为大模型分布式训练的瓶颈.针对现有算法拓扑感知不足、调度复杂度高等问题,提出一种基于组播时间扩展图的集合通信编排算法.通过构建组播时变图模型,刻画节点间的拓扑关系及时隙冲突约束,将集合通信编排问题转化为时变图中组播路径搜索问题,实现路由与时隙联合规划.仿真结果表明,所提算法完成时间接近最优,同时显著降低计算复杂度,适用于大规模分布式训练场景.
Collective communication latency has become a major performance bottleneck in large-scale distributed train-ing.To address the limitations of existing algorithms in terms of insufficient topology awareness and high computational complexity,a topology-aware collective communication scheduling algorithm based on multicast time-expanded graph was proposed.By constructing a multicast time-varying graph model,both network topology constraints and time-slot conflict constraints were explicitly captured.The collective communication scheduling problem was then transformed into a multicast path search problem on the time-varying graph,enabling joint optimization of routing and time slot plan-ning.Simulation results demonstrate that the proposed algorithm achieves near-optimal communication completion time while significantly reducing computational complexity,making it suitable for large-scale distributed training scenarios.
刘飞;王鹏;麻涵;李烨;李红艳
西安电子科技大学空天地一体化综合业务网全国重点实验室,陕西 西安 710071新加坡科技设计大学,新加坡 487372西安电子科技大学空天地一体化综合业务网全国重点实验室,陕西 西安 710071西安电子科技大学空天地一体化综合业务网全国重点实验室,陕西 西安 710071西安电子科技大学空天地一体化综合业务网全国重点实验室,陕西 西安 710071
信息技术与安全科学
集合通信拓扑感知时变图组播调度分布式训练
collective communicationtopology awaretime-varying graphmulticast schedulingdistributed training
《通信学报》 2026 (4)
67-79,13
国家自然科学基金资助项目(No.62371374) The National Natural Science Foundation of China(No.62371374)
评论