基于强化学习自适应自耦PID的可控永磁悬浮系统控制研究OA
Research on adaptive self-coupling PID control for controllable permanent magnet levitation systems based on reinforcement learning
可控永磁悬浮带式输送机是一种以可控永磁悬浮托辊作为支承结构的新型磁悬浮带式输送机.针对可控永磁悬浮系统存在的非线性和易受干扰问题,提出了一种融合强化学习深度确定性策略梯度(DDPG)与自耦PID(SC-PID)的控制方法,DDPG算法作为上层控制策略,通过学习可控永磁悬浮系统的非线性特性,自适应调整下层SC-PID控制的速度因子参数;对于DDPG算法训练前期探索效率低的问题,引入双经验回放池机制,提高算法前期训练效率.仿真与实验结果表明:与PID与SC-PID控制方法相比,所提出的控制方法可以根据系统跟踪误差快速调整控制参数,具有良好的跟踪性能与抗干扰性能;在外部负载冲击扰动下,系统悬浮气隙变化量为0.29 mm,较PID与SC-PID控制方法分别降低32.5%和19.4%,提升了可控永磁悬浮系统的动态性能,证明了控制器参数的智能化调整所带来的优越性.
The controllable permanent magnet levitation belt conveyor is a novel type of magnetic levitation belt conveyor that uses controllable permanent magnet levitation rollers as its supporting structure.Aiming at the nonlinearity and susceptibility to interference of its controllable permanent magnet levitation system,a control method integrating the reinforcement-learning deep deterministic policy gradient(DDPG)algorithm and self-coupling PID(SC-PID)was proposed.The DDPG algorithm serves as the upper-layer control strategy,which learns the nonlinear characteristics of the controllable permanent magnet levitation system to adaptively adjust the speed factor parameters of the lower-layer SC-PID control.Moreover,to address the low exploration efficiency in the early training phase of the DDPG algorithm,a double replay buffer mechanism was introduced to enhance the algorithm's training efficiency in the initial stage.The simulation and experimental results show that compared with the PID and SC-PID control methods,the proposed control method can quickly adjust control parameters according to the system tracking error,demonstrating excellent tracking and anti-interference performance.Under external load impact disturbances,the change in the system's levitation gap is 0.29 mm,which is a reduction of 32.5%and 19.4%compared to the PID and SC-PID control methods,respectively.This improvement in the dynamic performance of the controllable permanent magnet levitation system proves the superiority brought about by the intelligent adjustment of controller parameters.
胡坤;孙亚伟;蒋浩;陈卓;许刚
安徽理工大学机电工程学院,安徽 淮南,232001||煤炭无人化开采数智技术全国重点实验室,安徽 淮南,232001安徽理工大学机电工程学院,安徽 淮南,232001安徽理工大学机电工程学院,安徽 淮南,232001安徽理工大学机电工程学院,安徽 淮南,232001安徽理工大学机电工程学院,安徽 淮南,232001
机械制造
可控永磁悬浮系统DDPG算法自耦PID双经验回放池
controllable permanent magnet levitation systemdeep deterministic policy gradient(DDPG)algorithmself-coupling PIDdouble replay buffer
《中南大学学报(自然科学版)》 2026 (7)
3043-3059,17
国家自然科学基金资助项目(52274153)安徽省高校学科拔尖人才学术资助项目(gxbjZD2022015)(Project(52274153)supported by the National Natural Science Foundation of ChinaProject(gxbjZD2022015)supported by the Top Talent Academic Support Program for Discipline Leaders in Anhui Province)
评论