基于分层多智能体的轨道车辆装配协同调度优化研究OA
Research on hierarchical multi-agent-based collaborative scheduling optimization for rail vehicle assembly
针对轨道车辆装配过程中装配线任务分配复杂、车体需频繁跨工位转运且依赖拖车搬运的调度问题,提出了一种端到端的多智能体分层深度强化学习调度优化方法.首先,将装配任务在多条装配线之间的分配过程建模为序列决策问题,上层智能体引入 Transformer 对装配任务与装配线特征进行上下文编码,并结合 Pointer Network 生成装配线分配策略;其次,下层智能体协同完成工步选择、工位分配及拖车调度决策,采用图注意力网络刻画异构资源节点间的关联关系;最后,通过多组对比实验验证所提方法的有效性.结果表明,该方法在不同规模算例上均能够实现最优调度,下层智能体策略协同实现最大完工时间平均 GAP 为 11.36%,优于图同构网络方法的15.00%,在保证高质量调度的前提下,其计算效率显著优于延迟接受爬山算法.提出的分层协同调度计算框架实现了装配任务分配与多资源调度的统一建模与协同优化,为轨道车辆装配调度提供了一种高效、可扩展的智能优化思路.
To deal with the scheduling problem in rail vehicle assembly,where assembly line task allocation is complex and car body components require frequent cross-station transfers relying on trolleys,this study proposed an end-to-end hierarchical multi-agent deep reinforcement learning framework for scheduling optimization.Firstly,the allocation of assembly tasks across multiple assembly lines was modeled as a sequential decision problem.The high-level agent encoded the assembly task and line features using a Transformer and generated line assignment strategies with a Pointer Network.Secondly,the lower-level agents coordinated the selection of operations,station assignments,and dolly scheduling,and used Graph Attention Networks to extract relational features from heterogeneous nodes.Finally,multiple comparison experiments were conducted to validate the effectiveness of the proposed method.The results show that the method achieves optimal scheduling across different instance scales.The coordination of low-level agent strategies achieves an average maximum makespan gap of 11.36%,which outperforms the 15.00%achieved by the graph isomorphism network method,and the method provides high-quality scheduling with computation efficiency significantly higher than the Late Acceptance Hill Climbing algorithm.The proposed hierarchical collaborative scheduling framework achieves unified modeling and coordinated optimization of assembly task assignment and multi-resource scheduling,providing an efficient and adaptable intelligent optimization approach for rail vehicle assembly sched-uling.
马治林;郭鹏;王祺欣;张志瑶;廖秋涵;朱东;马永敬;孙轶杰
西南交通大学机械工程学院,四川 成都 610031西南交通大学机械工程学院,四川 成都 610031||轨道交通运维技术与装备四川省重点实验室,四川 成都 610031西南交通大学机械工程学院,四川 成都 610031西南交通大学机械工程学院,四川 成都 610031||轨道交通运维技术与装备四川省重点实验室,四川 成都 610031成都川哈工机器人及智能装备产业技术研究院有限公司,四川 成都 610041成都川哈工机器人及智能装备产业技术研究院有限公司,四川 成都 610041中车青岛四方机车车辆股份有限公司,山东 青岛 266111中车青岛四方机车车辆股份有限公司,山东 青岛 266111
信息技术与安全科学
计算机辅助制造轨道车辆装配深度强化学习多智能体分层协同调度
computer aided manufacturingrail vehicle assemblydeep reinforcement learningmulti-agenthierarchical collaborative scheduling
《河北科技大学学报》 2026 (2)
145-157,13
国家自然科学基金(52405220)四川省自然科学基金(2024ZHCG0028)
评论