基于自适应奖励函数-多智能体深度强化学习的移动储能时空调度策略OA
Spatio-temporal Dispatch Strategy of Mobile Energy Storage Based on Multi-agent Deep Reinforcement Learning With Adaptive Reward Function
移动储能系统(mobile energy storage systems,MESS)是缓解分布式可再生能源供需时空不匹配问题和促进其就近消纳的关键技术.在多源、多负荷的分布式能源系统中,MESS 的高效调度面临移动节点抉择和充放电决策的时空复杂耦合、多重约束冲突等复杂问题,传统依赖精确模型的优化方法难以获得高效的调度策略.为此,该文提出一种基于自适应奖励函数-多智能体深度强化学习的 MESS 时空调度策略.该方法将 MESS 调度问题建模为多智能体马尔科夫决策过程,利用多智能体协同架构解耦时空强耦合的高维决策问题,并通过智能体与环境交互学习机制,实现MESS在复杂环境中的自适应调度.此外,所提策略引入自适应权重调整机制,引导 MESS 在复杂环境中逐步形成合理的决策偏好,从而显著提升学习效率与模型收敛性能.结果表明,所提策略能够让 MESS 在复杂场景中实现高效调度,表现出良好的稳定性和鲁棒性,为分布式能源系统中 MESS 的智能调度提供理论支持与实践参考.
Mobile energy storage systems(MESS)are crucial technologies for alleviating the spatiotemporal mismatch between distributed renewable energy supply and demand,while promoting its local consumption.In systems characterized by multiple energy sources and loads,the efficient scheduling of MESS is challenged by the spatiotemporal coupling between mobile node selection and charge/discharge decisions,as well as multiple conflicting constraints.Traditional optimization approaches relying on precise mathematical models often fail to derive effective scheduling strategies under such conditions.To address this,this paper proposes a spatiotemporal scheduling strategy based on an adaptive reward function and multi-agent deep reinforcement learning.The problem is formulated as a multi-agent Markov decision process and cooperative multi-agent framework is used to decouple the high-dimensional problem with strong spatiotemporal coupling.Through agent-environment interaction,the system autonomously learns adaptive scheduling strategies in complex scenarios.Furthermore,this paper introduces an adaptive weight adjustment mechanism to guide MESS in developing rational decision-making preferences under dynamic conditions,significantly improving learning efficiency and model convergence.Simulation results demonstrate that the proposed strategy enables MESS to achieve efficient scheduling in complex scenarios,demonstrating strong stability and robustness,and providing theoretical support and practical reference for the intelligent scheduling of MESS in distributed energy systems.
杨迪;王辉;杨睿彤;成润坤;甘玮;罗燊
华北电力大学经济与管理学院,北京市 昌平区 102206华北电力大学经济与管理学院,北京市 昌平区 102206华北电力大学经济与管理学院,北京市 昌平区 102206华北电力大学经济与管理学院,北京市 昌平区 102206华北电力大学经济与管理学院,北京市 昌平区 102206华北电力大学经济与管理学院,北京市 昌平区 102206
信息技术与安全科学
移动储能时空调度多智能体深度强化学习奖励函数优化
mobile energy storagespatio-temporal dispatch strategymulti-agent deep reinforcement learningreward function optimization
《中国电机工程学报》 2026 (17)
6235-6249,中插8,16
国家社会科学基金项目(22BJL134). Project Supported by National Social Science Foundation of China(22BJL134).
评论