基于类脑记忆协同经验回放算法的自动发电控制OA
Automatic Generation Control Based on Brain-inspired Memory Cooperative Experience Replay Algorithm
新能源及电动汽车集群大规模接入电网所带来的强随机扰动加剧了电力系统频率振荡,给自动发电控制性能带来挑战.然而,现有的强化学习方法存在经验样本利用效率低的问题,难以有效反映自动发电控制系统状态变化,所获取的控制策略并不理想.因此,该文提出基于类脑记忆协同经验回放的双延迟深度确定性策略梯度自动发电控制算法.所提算法将人脑高效记忆存取机制融入经验回放,通过整合短期、长期与专家经验样本,来实现多源经验的协同利用与交互采样,使智能体在学习过程中兼顾实时反馈、历史信息与外部指导,从而更精确地反映自动发电控制系统的实时状态,以获取最优控制策略.对电动汽车集群接入的两区域负荷频率控制模型与华中电网四区域负荷频率控制模型进行仿真,结果表明,所提算法能够有效缓解电力系统频率震荡,提高自动发电控制性能.
The large-scale integration of renewable energy sources and electric vehicle clusters has introduced strong stochastic disturbances,which amplify frequency oscillations and challenge the performance of automatic generation control(AGC).However,existing reinforcement learning approaches exhibit low efficiency in utilizing experience samples,which hinders their ability to accurately reflect the dynamic state changes of the AGC system,thereby leading to suboptimal control strategies.To overcome these limitations,this paper proposes a twin delayed deep deterministic policy gradient algorithm for AGC,incorporating brain-inspired memory cooperative experience replay.By integrating short-term,long-term,and expert experience samples,it cooperatively utilizes and interactively samples multi-source experiences,enabling the agent to consider real-time feedback,historical data,and external guidance for more accurate state reflection and optimal control.The simulation results of both the two-area load frequency control model with electric vehicle cluster access and the four-area model of the Central China power grid indicate that the proposed algorithm can effectively suppress frequency oscillations and improve the performance of AGC.
席磊;苏磊;施宇;宋浩杰;李宗泽
梯级水电站运行与控制湖北省重点实验室(三峡大学电气与新能源学院),湖北省宜昌市 443002梯级水电站运行与控制湖北省重点实验室(三峡大学电气与新能源学院),湖北省宜昌市 443002梯级水电站运行与控制湖北省重点实验室(三峡大学电气与新能源学院),湖北省宜昌市 443002梯级水电站运行与控制湖北省重点实验室(三峡大学电气与新能源学院),湖北省宜昌市 443002梯级水电站运行与控制湖北省重点实验室(三峡大学电气与新能源学院),湖北省宜昌市 443002
信息技术与安全科学
自动发电控制强化学习人脑记忆经验回放
automatic generation controlreinforcement learninghuman brain memoryexperience replay
《中国电机工程学报》 2026 (12)
5033-5046,中插17,15
国家自然科学基金项目(52277108,52477104)宜昌市自然科学研究项目(A23-2-001).Project Supported by National Natural Science Foundation of China(52277108,52477104)Yichang Municipal Natural Science Foundation(A23-2-001).
评论