基于Q-learning的空气源热泵制冷系统无模型优化控制在传感器误差下的鲁棒性分析OA
Analysis of the robustness of model-free optimal control for air source heat pump refrigeration system based on Q-learning under sensor error
暖通空调(HVAC)系统运行高度依赖传感器数据,其测量误差会明显影响控制策略的优化效果与稳定性.以上海市某办公建筑空气源热泵(ASHP)系统为研究对象,基于实际运行数据构建仿真环境,引入不同等级的传感器噪声误差,并定量分析其对基于Q-learning的无模型优化控制与基于粒子群算法(PSO)的有模型优化控制性能的影响.结果表明,在工业常规传感器误差范围内,两种优化方法均可实现系统能效提升,其中Q-learning在综合效用稳定性方面表现更优;在故障级传感器噪声条件下,PSO优化性能退化,而Q-learning仍保持较好的鲁棒性.
The operation of HVAC systems is highly dependent on sensor data,and measurement errors can significantly affect the optimization effect and stability of control strategies.Taking the air source heat pump(ASHP)system of an office building in Shanghai City as the research object,a simulation environment is constructed based on real operation data,and different levels of sensor noise errors are introduced to quantitatively analyze their impact on the performance of model-free optimization control based on Q-learning and model-based optimization control based on particle swarm optimization(PSO).The results show that within the range of conventional sensor errors in industry,both optimization methods can achieve an improvement in system energy efficiency,with Q-learning performing better in terms of overall utility stability.Under fault-level sensor noise conditions,the performance of PSO deteriorates,but Q-learning still maintains better robustness.
陈文嘉;李铮伟;李振海
同济大学机械工程与机器人学院,上海 200092同济大学机械工程与机器人学院,上海 200092同济大学机械工程与机器人学院,上海 200092
建筑与水利
强化学习无模型控制空气源热泵传感器测量误差
reinforcement learningmodel-free controlair-source heat pumpsensor measurement error
《节能》 2026 (3)
60-65,6
评论