首页|期刊导航|电力系统自动化|基于知识嵌入型深度强化学习的电力系统频率紧急控制方法

基于知识嵌入型深度强化学习的电力系统频率紧急控制方法OA

Emergency Frequency Control Method for Power Systems Based on Knowledge-embedded Deep Reinforcement Learning

中文摘要英文摘要

随着新型电力系统建设的快速推进,电力系统频率安全面临的挑战愈发严峻,当系统发生故障导致频率失稳时,采取紧急控制恢复频率稳定至关重要.文中提出一种基于知识嵌入型深度强化学习(DRL)的电力系统频率紧急控制方法.首先,将频率紧急控制问题转化为马尔可夫模型,以仿真系统为强化学习环境,并基于深度确定性策略梯度(DDPG)算法构建深度强化学习智能体.此外,通过理论知识引导动作空间优化,综合考虑高频切机与低频减载两类场景.最后,在IEEE 39节点系统中进行控制效果测试,结果表明:深度强化学习智能体能够给出有效的频率紧急控制策略,维护系统频率安全;知识嵌入的方法改善了模型的训练稳定性,能显著提高智能体的策略学习效率与决策质量.

The rapid development of new power systems has exacerbated frequency security challenges,making emergency control crucial for restoring stability during faults.This paper proposes a power system emergency frequency control method based on knowledge-embedded deep reinforcement learning.First,the emergency frequency control problem is formulated as a Markov decision process,with a simulation system serving as the reinforcement learning environment,and a deep reinforcement learning(DRL)agent is constructed based on the deep deterministic policy gradient(DDPG)algorithm.Furthermore,theoretical knowledge guides the action space optimization,integrating both over-frequency generator tripping and under-frequency load shedding scenarios.Finally,the proposed method is validated on the IEEE 39-bus system,demonstrating that the DRL agent can generate effective emergency frequency control strategies to ensure system security,and the knowledge-embedded technique enhances training stability and significantly improves policy learning efficiency and decision quality.

LI Jiaxu;WU Junyong;SHI Fashun;ZHANG Zhenyuan;LI Lusu

School of Electrical Engineering,Beijing Jiaotong University,Beijing 100044,ChinaSchool of Electrical Engineering,Beijing Jiaotong University,Beijing 100044,ChinaDepartment of Electrical Engineering,Tsinghua University,Beijing 100084,ChinaSchool of Electrical Engineering,Beijing Jiaotong University,Beijing 100044,ChinaCollege of Mechanical and Electrical,Shijiazhuang University,Shijiazhuang 050035,China

人工智能新型电力系统频率安全频率紧急控制深度强化学习深度确定性策略梯度高频切机低频减载

artificial intelligencenew power systemfrequency securityemergency frequency controldeep reinforcement learning(DRL)deep deterministic policy gradient(DDPG)over-frequency generator trippingunder-frequency load shedding

《电力系统自动化》 2026 (1)

97-107,11

国家重点研发计划资助项目(2018YFB0904500)国家电网有限公司科技项目(SGLNDK00KJJS1800236). This work is supported by National Key R&D Program of China(No.2018YFB0904500)and State Grid Corporation of China(No.SGLNDK00KJJS1800236).

10.7500/AEPS20250611008

评论