基于多智能体强化学习的多能互补能源系统优化运行OA
Optimization operation of multi-energy complementary system based on multi-agent reinforcement learning
针对多能互补能源系统在高比例可再生能源接入下的动态协同优化难题,以及传统集中式方法在多主体利益协调和实时响应中的局限性,开展动态优化建模研究.构建了"物理层-决策层-协同层"三层多智能体强化学习(MARL)框架,将能源生产者、消费者及系统调度器划分为独立智能体.基于改进近端策略优化算法,设计了融合经济性、环保性与稳定性的动态奖励函数,通过集中训练-分散执行机制实现分布式决策与全局协同.以典型的园区级多能互补系统为算例,结果表明:所提MARL模型使可再生能源消纳率提升至92.3%,单位电量成本较传统混合整数规划(MIP)方法降低了28.9%;在50%负荷突变场景下,系统恢复稳定时间缩短至90 s,较MIP方法提速900%;面对±20%风光预测误差,负荷满足率仍保持98.7%.该动态优化模型可有效解决多能互补系统的多主体协同与不确定性适应问题,为高渗透率可再生能源系统的实时优化调度提供技术支撑.
To address the dynamic coordinated optimization challenges of multi-energy complementary systems under high renewable energy integration and the limitations of traditional centralized methods in multi-agent interest coordination and real-time response,dynamic optimization modeling research was conducted.A three-layer multi-agent reinforcement learning(MARL)framework—consisting of a physical layer,decision layer,and coordination layer—was developed,with energy producers,consumers,and system schedulers classified as independent agents.Based on the improved proximal policy optimization algorithm,a dynamic reward function integrating economic efficiency,environmental friendliness,and stability was designed,and distributed decision-making with global coordination was achieved through a centralized training-decentralized execution mechanism.A typical park-level multi-energy complementary system was used as a case study.The results showed that the proposed MARL model increased the renewable energy consumption rate to 92.3%,reducing the unit electricity cost by 28.9%compared to the traditional mixed integer programming(MIP)method.Under a 50%load abrupt change scenario,the system recovery time was shortened to 90 s,which was 900%faster than the MIP method.Even with±20%wind and solar forecasting errors,the load satisfaction rate remained at 98.7%.This dynamic optimization model effectively addressed the multi-agent coordination and uncertainty adaptation challenges in multi-energy complementary systems,providing technical support for the real-time optimization and scheduling of high-penetration renewable energy systems.
陈锋;路小敏;李梦杨;张涛;杨帆
河南科技大学 应用工程学院,河南 三门峡 472100||三门峡职业技术学院 河南省有色金属新材料智能制造应用工程研究中心,河南 三门峡 472099郑州浪潮数据技术有限公司,郑州 450003洛阳师范学院 电气工程与自动化学院,河南 洛阳 471942河南科技大学 应用工程学院,河南 三门峡 472100||三门峡职业技术学院 河南省有色金属新材料智能制造应用工程研究中心,河南 三门峡 472099河南科技大学 应用工程学院,河南 三门峡 472100||三门峡职业技术学院 河南省有色金属新材料智能制造应用工程研究中心,河南 三门峡 472099
能源科技
多能互补能源系统多智能体强化学习动态优化建模源网荷储可再生能源消纳协同调度
multi-energy complementary systemmulti-agent reinforcement learningdynamic optimization modelingsource-grid-load-storagerenewable energy consumptioncoordinated scheduling
《综合智慧能源》 2026 (3)
15-26,12
国家自然科学基金项目(62401240)河南省教育厅高等学校重点科研项目计划(26B480004) National Natural Science Foundation of China(62401240)Key Scientific Research Project Plan of Colleges and Universities in Henan Province in 2026(26B480004)
评论