基于改进柔性动作-评价算法的电动汽车实时充放电策略OA
Real-time Charging/discharging Strategy for Electric Vehicle Based on Improved Soft Actor-critic
用户出行行为与电价的随机性为电动汽车参与实时电价指导的充放电策略带来严峻挑战.为应对该挑战,该文提出一种基于改进柔性动作-评价算法的电动汽车实时充放电策略.首先,考虑电动汽车充放电过程中效率随功率变化的特性以及电量边界约束条件,分别建立非线性充放电效率模型与电量边界模型,以更准确地建模电量更新过程.其次,构建用户焦虑模型用于表征其续航里程与时间需求,以缓解因焦虑导致的非理性充电行为及其引发的决策偏差,结合马尔科夫链刻画用户出行不确定性,模拟其充电位置与时间行为.然后,将电动汽车充放电优化问题建模为转移概率未知的马尔科夫决策过程,进而提出一种集成三重评价网络和综合经验回放机制的改进柔性动作-评价算法,以实时制定电动汽车充放电策略.算例仿真结果表明,所提基于改进柔性动作-评价算法的充放电策略能够在保证充放电功率可靠的前提下满足用户需求并降低充电费用,对不确定性有良好的自适应性.
The randomness of user travel behavior and electricity prices poses a severe challenge to the charging and discharging optimization of electric vehicles under the guidance of real-time electricity prices.To meet this challenge,this paper proposes a real-time charging and discharging strategy for the electric vehicle based on an improved soft actor-critic.First,considering the characteristics of the efficiency changing with power during the charging and discharging process of the electric vehicle and the power boundary constraints,a nonlinear charging and discharging efficiency model and a power boundary model are established respectively to more accurately model the SOC update process.Secondly,a user anxiety model is constructed to characterize their range and time requirements to alleviate the irrational charging behavior caused by anxiety and the decision-making bias caused by it.The user travel uncertainty is characterized by the Markov chain,and their charging location and time behavior are simulated.Then,the electric vehicle charging and discharging optimization problem is modeled as a Markov decision process with unknown transition probability,and then an improved soft actor-critic integrating a triple critic network and a comprehensive experience playback mechanism is proposed to formulate the strategy for electric vehicle charging and discharging in real time.The simulation results of the example show that the proposed optimization method based on the improved soft actor-critic can meet user needs and reduce charging costs under the premise of ensuring reliable charging and discharging power,and has good adaptability to uncertainty.
赵黎媛;徐富广;张献;李慕松
智能配用电装备与系统全国重点实验室(河北工业大学),天津市北辰区 300401||河北省电磁场与电器可靠性重点实验室(河北工业大学),天津市北辰区 300401智能配用电装备与系统全国重点实验室(河北工业大学),天津市北辰区 300401||河北省电磁场与电器可靠性重点实验室(河北工业大学),天津市北辰区 300401智能配用电装备与系统全国重点实验室(河北工业大学),天津市北辰区 300401||河北省电磁场与电器可靠性重点实验室(河北工业大学),天津市北辰区 300401智能配用电装备与系统全国重点实验室(河北工业大学),天津市北辰区 300401||河北省电磁场与电器可靠性重点实验室(河北工业大学),天津市北辰区 300401
信息技术与安全科学
电动汽车用户焦虑充放电优化深度强化学习用户出行行为
electric vehicleuser anxietycharging and discharging optimizationdeep reinforcement learninguser travel behavior
《电网技术》 2026 (3)
中插75,1129-1139,中插76,13
天津市自然科学基金项目(23JCQNJC01060)河北省自然科学基金项目(F2024202005).Project Supported by Natural Science Foundation of Tianjin(23JCQNJC01060)Hebei Natural Science Foundation(F2024202005).
评论