面向强不确定性供需波动的新能源电网调度强化学习算法OA
A Reinforcement Learning Algorithm for New Energy Grid Dispatch with Strong Uncertainty in Supply and Demand Fluctuations
随着新能源产业逐步规模化,面向新能源消纳能力提升的电力系统,动态经济调度重要性日渐凸显.提出一种分布式多智能体强化学习算法来解决高比例新能源动态经济调度问题.首先,通过平均一致性算法得到每时刻电网功率总需求,利用投影优化方法求得满足耦合约束、完全消纳新能源的可行功率输出;同时,基于二次函数逼近评价网络的状态动作值函数,通过求解凸优化问题得到调度的另一个近似最优解;然后,构建动作网络用于直接学习总功率需求、新能源实时最大可用出力与各火电机组决策有功出力之间的关系,并运用大量训练所得经验,在动态电力系统中迅速作出最优输出功率预测,从而提高发电机决策效率;最后,通过IEEE 39节点算例验证了所提算法的有效性和鲁棒性.
As the new energy industry gradually scales up,dynamic economic dispatch in power systems aimed at enhancing new energy absorption capacity is becoming increasingly crucial.This paper proposes a distributed multi-agent reinforcement learning algorithm to address the dynamic economic dispatch problem in systems with high proportions of new energy.First,the total power demand of the grid at each time step is obtained through an average consensus algorithm,and a feasible power output that meets coupling constraints and fully absorbs new energy is determined using a projection optimization method.Additionally,by employing a quadratic function to approximate the state-action value function of the evaluation network,another near-optimal solution for dispatch is derived by solving a convex optimization problem.Subsequently,an action network is constructed to directly learn the relationship between total power demand,real-time maximum available output of new energy units,and the active power output decisions of each thermal power unit.Leveraging experience from extensive training,the model swiftly predicts optimal output power in dynamic power systems,thus improving generator decision efficiency.Finally,the effectiveness and robustness of the proposed algorithm are verified through tests on the IEEE 39-bus system.
周宁;徐铭铭;刘清秋;黄玉雄;陈明;李更丰
国网河南省电力公司电力科学研究院,河南省 郑州市 450052国网河南省电力公司电力科学研究院,河南省 郑州市 450052西安交通大学电气工程学院,陕西省 西安市 710049西安交通大学电气工程学院,陕西省 西安市 710049国网河南省电力公司电力科学研究院,河南省 郑州市 450052西安交通大学电气工程学院,陕西省 西安市 710049
信息技术与安全科学
智能电网新能源消纳动态经济调度分布式强化学习
smart gridnew energy absorptiondynamic economic dispatchdistributed reinforcement learning
《全球能源互联网》 2026 (1)
60-71,12
国家电网有限公司科技项目(521702230005/SGHADK00PJJS2400401). Science and Technology Foundation of SGCC(521702230005/SGHADK00PJJS2400401).
评论