基于深度强化学习的模块化集成建造车间实时调度方法研究OA
Research on real-time scheduling method of modular integrated construction workshop based on deep reinforcement learning
模块化集成建造(Modular Integrated Construction,MIC)是一种新兴的建造模式,目前被广泛运用于建筑构件的生产制造.由于构件产品个性化需求日益突出,且建造车间生产环境复杂多变,因此亟需设计先进实时调度方法应对新的生产模式以及响应动态事件.基于此,针对模块化集成建造车间调度问题,提出了一种基于深度强化学习(Deep Rein-forcement Learning,DRL)的实时调度方法.首先,分析模块化集成建造车间的生产流程与特性,将其抽象为一个具有混流生产特性的生产车间并完成相关数学模型的构建;其次,通过定义生产时间序列中的调度节点,将调度问题建模为马尔可夫决策过程(Markov Decision Process,MDP);随后,依次设计具有21个生产特征的通用状态空间、8个基于遗传规划(Genetic Programming,GP)复合规则的动作空间和奖励函数,基于此,提出一种基于双记忆池的近端策略优化(Proximal Policy Optimization with Dual Memory Pools,PPO-DMP)算法来训练调度智能体,以实现生产状态与调度规则间的高效映射,从而实现调度目标的有效优化;最后,通过对比实验证明所提出的实时调度方法相较于传统方法具有良好的调度性与动态性,尤其是在应对新订单插入的场景中,其优势更加显著.
Modular Integrated Construction(MIC)represents an emerging construction paradigm that has gained widespread a-doption in the production of building components.Given the growing demand for customized component products and the intri-cate,dynamic nature of the construction workshop environment,there is an urgent need to develop advanced real-time scheduling methodologies capable of adapting to novel production modes and responding effectively to dynamic events.A real-time scheduling approach based on Deep Reinforcement Learning(DRL)was proposed for modular integrated construction shop scheduling.First,the production process and characteristics of the modular integrated construction workshop were systematically analyzed,ab-stracted as a hybrid-flow production system,and formalized through a relevant mathematical model.Second,by defining scheduling decision points within the production time series,the scheduling problem was formulated as a Markov Decision Process(MDP).Subsequently,a comprehensive state space encompassing 21 production features,8 action spaces,and reward functions derived from Genetic Programming(GP)complex rules were sequentially designed.Building on this foundation,an algorithm based on Proximal Policy Optimization with Dual Memory Pools(PPO-DMP)was proposed to train scheduling agents,enabling efficient mapping between production states and scheduling strategies,thereby achieving effective optimization of scheduling ob-jectives.Finally,comparative experiments demonstrate that the proposed real-time scheduling algorithm exhibits superior schedu-ling efficiency and dynamic adaptability compared to traditional methods,particularly in scenarios involving new order insertions,where its advantages become even more pronounced.
樊一;刘斯麒;沈洌政;朱海平
华中科技大学机械科学与工程学院,武汉 430074华中科技大学机械科学与工程学院,武汉 430074华中科技大学机械科学与工程学院,武汉 430074华中科技大学机械科学与工程学院,武汉 430074
信息技术与安全科学
深度强化学习模块化集成建造实时调度马尔可夫决策过程
deep reinforcement learningmodular integrated constructionreal-time schedulingMarkov decision process
《现代制造工程》 2026 (5)
18-30,13
国家重点研发计划项目(2023YFB3307900)
评论