考虑装配协同的分布式两阶段混合流水车间图强化学习动态调度OA
Graph reinforcement learning for dynamic scheduling of two-stage distributed hybrid flow shop considering assembly coordination
针对动态环境下两阶段分布式混合流水车间(TSDH-FSSP)中跨厂生产和装配协同脱节问题,开展了面向装配协同的图强化学习动态调度方法研究.构建融合工序耦合关系与车间状态的图结构表示模型,结合卷积神经网络(CNN)与双重图注意力网络(GAT)提取厂内局部拓扑特征与跨阶段全局协同特征,并利用近端策略优化(PPO)算法在复合奖励机制引导下实现端到端自主决策.基于不同规模基准算例的仿真实验表明,在动态插单场景下,该方法在最大完工时间与相对百分比偏差(RPD)指标上均优于非支配排序遗传算法(NSGA-Ⅱ)、改进鲸鱼优化算法(IWOA)及深度学习调度方法(DRL-GCN、DRL-TF);同时,第二阶段固定规则策略在保证求解质量的同时使训练时间降低27.11%.通过轴承制造实际案例验证了该方法在复杂动态环境下的有效性与鲁棒性,为分布式制造系统中生产与装配协同调度提供了可行路径.
To address the coordination mismatch between cross-factory production and assembly in the two-stage distributed hybrid flow shop scheduling problem(TSDH-FSSP)under dynamic environments,this paper developed a dynamic scheduling method based on graph reinforcement learning(GRL)with assembly coordination.The method constructed a graph-structured representation integrating operation coupling and shop floor states.It employed a convolutional neural network(CNN)and a dual graph attention network(GAT)to capture intra-factory local topological features and cross-stage global coordination fea-tures.It further applied a proximal policy optimization(PPO)algorithm to achieve end-to-end autonomous decision-making under a composite reward mechanism.Simulation results show that the proposed method outperforms the non-dominated sorting genetic algorithm Ⅱ(NSGA-Ⅱ),the improved whale optimization algorithm(I WO A),and deep reinforcement learning scheduling methods(DRL-GCN and DRL-TF)in terms of makespan and relative percentage deviation(RPD)under dynamic job insertion scenarios.The fixed-rule strategy in the second stage reduced training time by 27.11%while maintaining high solution quality.A real-world bearing manufacturing case verifies the effectiveness and robustness of the proposed method in complex dynamic environments and demonstrates its potential for improving production-assembly coordination in distributed manufacturing systems.
裴志杰;杨晓英;李新艳;杨欣
河南科技大学 商学院,河南洛阳 471023||黄河交通学院数字经济与智慧管理学院,河南 焦作 454950河南科技大学 机电工程学院,河南洛阳 471023黄河交通学院数字经济与智慧管理学院,河南 焦作 454950河南科技大学 商学院,河南洛阳 471023
机械制造
两阶段分布式混合流水车间装配协同图强化学习动态调度图注意力网络
two-stage distributed hybrid flow shopassembly coordinationgraph reinforcement learningdynamic schedu-linggraph attention network
《计算机应用研究》 2026 (9)
2630-2638,9
工业和信息化部项目(2206-410305-04-02-409831)河南省重点研发专项(231111222600)
评论