水泵水轮机转速强化学习控制策略OA
Reinforcement learning approach for speed control of pump turbines
水电是优秀的可再生能源,承担着电网重要的调峰和调频任务,水电机组转速系统对负载的快速响应直接关系到电能质量和电网安全.但水电机组工况多,非线性严重,常用的比例积分微分(PID)控制难以实现获得理想的控制效果.为提升系统的控制性能和泛化能力,本文提出了一种基于软演员-评论家(SAC)强化学习算法的智能控制策略.该方法在非线性水泵水轮机调速系统基础上,训练一个带外源输入的非线性自回归-长短期记忆网络(NARX-LSTM)模型作为强化学习的预训练模型,并用 LSTM 训练一个误差校正模型对其进行误差校正;随后,用带误差校正的NARX-LSTM模型代替环境与代理进行交互训练,将训练好的控制策略用于系统的转速控制.仿真结果表明,与传统PID控制相比,本文所提方法在不同工况下,响应速度、超调量等方面均表现出优越性,并能以更小的波动应对工况变化.本研究证实了强化学习在解决复杂工业控制问题中的有效性,为水泵水轮机转速控制提供了一种富有潜力的新方法.
Hydropower serves as a critical renewable energy source that is often used for essential peak-shaving and frequency regulation for power grids;the agility of hydropower units'speed-governing system in response to load fluctuations directly impacts power quality and grid stability.However,the generating units usually operate across diverse conditions and suffer from severe nonlinearities,posing a huge challenge to the conventional method of proportional-integral-derivative(PID)control.To enhance system control performance and robustness,this paper describes a new intelligent control strategy that is based on the Soft Actor-Critic(SAC)reinforcement learning algorithm.By using the strategy and a nonlinear pump-turbine governing system,first a framework is constructed to train a network of Nonlinear Autoregressive with Exogenous Input Long Short-Term Memory(NARX-LSTM)as a surrogate model.It uses one module for LSTM-based error-correction to raise model accuracy.Then,this error-corrected NARX-LSTM environment is leveraged for iterative training of the SAC agent.Simulation results demonstrate that the new method outperforms traditional PID control in response speed and overshoot suppression across multiple operating points.And,the strategy exhibits superior resilience to operational transitions with minimal fluctuations.This study has verified the efficacy of reinforcement learning in achieving a complicated industrial control,and a promising new paradigm for hydropower speed regulation.
肖文圣;何佳;赵忠盖;郎彦东;陈金保
江南大学 自动化与智能科学学院(物联网学院),江苏 无锡 214122湖北省智慧水电技术创新中心,武汉 430000||中国长江电力股份有限公司,武汉 430000江南大学 自动化与智能科学学院(物联网学院),江苏 无锡 214122湖北省智慧水电技术创新中心,武汉 430000||中国长江电力股份有限公司,武汉 430000湖北省智慧水电技术创新中心,武汉 430000||中国长江电力股份有限公司,武汉 430000
能源科技
水泵水轮机水轮机调速强化学习SAC算法带外源输入的非线性自回归-长短期记忆网络
pump turbineturbine speed controlreinforcement learningsoft actor-critic algorithmnonlinear autoregressive with exogenous input long short-term memory network
《水力发电学报》 2026 (6)
23-36,14
湖北省智慧水电技术创新中心开放研究基金(HBCXZX-JJ-202409)
评论