基于多智能体强化学习的流程工业多操作参数协同优化OA
Collaborative Optimization of Multiple Operating Parameters for Process Industries Based on Multi-Agent Reinforcement Learning
流程工业普遍存在多操作参数强耦合、工艺拓扑复杂及多工序协同困难等问题,传统局部优化方法难以实现全局最优运行.针对上述挑战,提出一种基于图谱理论的流程拓扑结构感知的多智能体强化学习协同优化方法,以实现复杂拓扑流程工业的多操作参数协同优化.首先,构建基于拉普拉斯谱分析的拓扑结构解析框架,刻画多操作参数间的耦合关系,为智能体任务分配与协同决策提供支撑;随后,设计融合长短期记忆网络与多头注意机制的时序感知模块,提取历史状态轨迹中的关键时间依赖特征;进一步,引入多层次空间注意力机制,在组织层、变量层及连续控制域实现优化关注度的动态自适应调节;在此基础上,构建局部-全局协同的分层强化学习决策架构,实现多智能体协调控制与策略优化.基于连续搅拌釜反应器系统及盐湖化工典型流程工业数据开展仿真实验,验证了所提方法的有效性.实验结果表明,该方法较传统方法性能提升41.2%,在收敛速度与策略稳定性方面表现更优,为流程工业多操作参数协同优化提供新的技术路径.
Process industries are often confronted with strong multi-operational parameter couplings,intricate pro-cess topologies,and difficulties in multi-stage coordination,which render conventional localized optimization meth-ods inadequate for achieving global optimality.To address these challenges,this paper proposes a graph spectral theory-based process topology-aware multi-agent reinforcement learning collaborative optimization method for mul-tiple operating parameter collaborative optimization in complex topological process industries.Specifically,a topo-logy analysis framework based on Laplacian spectral analysis is developed to characterize structural coupling rela-tionships among multiple operating parameters,thereby supporting agent task allocation and coordinated decision-making.Subsequently,a temporal perception module integrating long short-term memory networks with a multi-head attention mechanism is designed to extract key temporal dependencies from historical state trajectories.Fur-thermore,a hierarchical spatial attention mechanism is introduced to enable dynamic and adaptive regulation of op-timization attention across organizational,variable,and continuous control domains.On this basis,a hierarchical reinforcement learning architecture is constructed to coordinate local and global policy optimization,facilitating co-operative control and strategy optimization among multiple agents.Simulation experiments using industrial data from a continuous stirred tank reactor system and a representative salt-lake chemical process validate the effective-ness of the proposed method.Experimental results show that the proposed method achieves up to a 41.2%perform-ance improvement over conventional approaches,exhibiting superior convergence behavior and policy stability,and providing a viable technical pathway for multiple operating parameter collaborative optimization in process industries.
刘柢炬;王雅琳;刘晨亮;罗彪;桂卫华
中南大学自动化学院 长沙 410083中南大学自动化学院 长沙 410083中南大学自动化学院 长沙 410083中南大学自动化学院 长沙 410083中南大学自动化学院 长沙 410083
协同优化图谱感知强化学习拉普拉斯谱分析层次化注意力流程工业智能优化
collaborative optimizationgraph-aware reinforcement learningLaplacian spectral analysishierarchic-al attentionintelligent optimization of process industries
《自动化学报》 2026 (1)
78-90,13
国家自然科学基金(U25A20466,92267205,62503507),湖南省自然科学基金(2025JJ60423,2025JJ10007),湖南省教育厅研究生教改项目(2025JGYB024)资助 Supported by National Natural Science Foundation of China(U25A20466,92267205,62503507),Natural Science Foundation of Hunan Province(2025JJ60423,2025JJ10007),and Hunan Pro-vincial Department of Education Graduate Education Reform Program(2025JGYB024)
评论