基于端到端深度强化学习的多订单动态柔性作业车间调度方法OA
An end-to-end deep reinforcement learning method for multi-order dynamic flexible job shop scheduling problem
针对多订单随机到达条件下的动态柔性作业车间调度问题(Dynamic Flexible Job Shop Scheduling Problem with Order Random Arrival,DFJSP_ORA),提出一种面向实际生产环境的建模与求解框架.首先构建了以最小化最大完工时间为优化目标DFJSP_ORA的数学模型.引入流体模型对系统行为进行连续近似,从而提取关键状态特征.调度过程被建模为马尔可夫决策过程(Markov Decision Process,MDP),并采用近端策略优化(Proximal Policy Optimization,PPO)算法构建端到端的深度强化学习框架进行求解.该方法结合复合规则驱动的离散动作空间与优势函数驱动的策略优化机制,实现了对动态环境的高效决策.最后通过81个不同规模的实例,对所提方法与6种优先调度规则及3种强化学习方法进行比较,结果验证了其优越性,为DFJSP_ORA的求解提供了一种高效、灵活的解决方案.
To address the Dynamic Flexible Job Shop Scheduling Problem with Order Random Arrival(DFJSP_ORA),a modeling and solution framework tailored for the actual production environment is pro-posed.First,a mathematical model is formulated to minimize the maximum completion time.The fluid model is then introduced to continuously approximate system behavior and extract key state features.Sub-sequently,the scheduling process is modeled as a Markov Decision Process(MDP),and a deep reinforce-ment learning method based on Proximal Policy Optimization(PPO)is developed to solve the problem.It combines the discrete action space driven by composite rules and the strategy optimization mechanism driv-en by the advantage function,achieving efficient decision-making in dynamic environments.Experimental results demonstrate that the proposed approach performs well in dynamic scheduling scenarios and effec-tively handles uncertainty and complexity in production,providing an efficient and flexible solution for DFJSP_ORA.
王旭;李寰;韩玉艳;王玉亭;王雅坤
聊城大学 计算机学院,山东 聊城 252059聊城大学 计算机学院,山东 聊城 252059聊城大学 计算机学院,山东 聊城 252059聊城大学 计算机学院,山东 聊城 252059山东省大数据中心,山东 济南 250100
机械制造
柔性作业车间调度深度强化学习近端策略优化流体模型最大完工时间
flexible job shop schedulingdeep reinforcement learningproximal policy optimizationfluid modelmaximum completion time
《聊城大学学报(自然科学版)》 2026 (2)
192-204,273,14
国家自然科学基金项目(61973203,61803192,62106073,61966012)山东省自然科学基金项目(ZR2023MF022)聊城大学光岳青年创新团队(LCUGYTD2022-03)原生数据库架构创新及高性能核心技术(ZTZB-23-990-024)资助
评论