基于RL-DE改进算法的移动机械臂逆运动学求解研究OA
Research on inverse kinematics solution of mobile robotic arms based on an improved RL-DE algorithm
针对移动平台与机械臂耦合系统因整体关节自由度冗余导致的逆运动学求解难题,传统的基于伪逆矩阵解决方法存在奇异点敏感性缺陷.为解决多自由度冗余移动机械臂逆运动学求解问题,提出一种融合强化学习(reinforcement learning,RL)与差分进化(differen-tial evolution,DE)的改进算法.其中,基于移动机械臂物理模型,以目标位姿与移动机械臂末端实际到达位姿的误差为适应度函数,构建DE算法优化模型.为克服传统DE算法进化参数固定的局限性,进而提升算法的全局搜索能力和求解收敛速度,提出一种调整不同时期进化方向的动态突变多策略,实现全局探索与局部开发策略之间的权衡,并将种群的适应度与多样性的变化作为特征输入,以最优个体适应度的进化率作为奖励函数,采用深度确定性策略梯度(deep deterministic policy gradient,DDPG)强化学习方法优化种群进化参数.仿真结果表明:本文提出的方法无须对矩阵求逆,可有效规避奇异点问题,且其逆运动学求解成功率和定位误差等性能优于人工蜂群、粒子群、自适应差分进化等算法,同时轨迹平滑度及平均误差等轨迹跟踪性能优于自适应差分进化算法.
To address the inverse kinematics challenge arising from the joint redundancy in mobile platform-arm coupled systems,the traditional pseudo-inverse matrix-based methods are sensitive to singularity.This paper proposes an improved algorithm that integrates reinforcement learning(RL)and differential evolution(DE)to solve the inverse kinematics problem for highly redundant mobile robotic arms.The optimization model in the DE algorithm is constructed based on the physical model of the mobile robotic arms,with the fitness function defined as the error between the target pose and the desired end-effector pose of the mobile robotic arms.To overcome the limitations of fixed evolutionary parameters in conventional DE algorithm and enhance both global search capability and convergence speed,a dynamic mutation multi-strategy mechanism that adaptively adjusts evolutionary directions at different stages to balance global exploration and local exploitation is proposed.Furthermore,the deep deterministic policy gradient(DDPG)algorithm is employed to optimize the evolutionary parameters,in which variation in population fitness and diversity serves as state inputs,and the improvement rate of the best individual's fitness acts as the reward signal.Simulation results demonstrate that the proposed method eliminates the need for matrix inversion,effectively circumventing singularity issues and outperforming artificial bee colony,particle swarm optimization,and self-adaptive differential evolution algorithms in terms of inverse kinematics success rate and positioning accuracy.Additionally,it outperforms the self-adaptive differential evolution algorithm in trajectory smoothness and tracking precision,and exhibits lower average error in trajectory tracking.
胡德安;孙智;王秋枫;李明俊
湖南大学 机械与运载工程学院,湖南 长沙 410082湖南大学 机械与运载工程学院,湖南 长沙 410082中核四〇四有限公司 第三分公司,甘肃 嘉峪关 732850湖南大学 机械与运载工程学院,湖南 长沙 410082
信息技术与安全科学
移动机械臂逆运动学差分进化算法强化学习动态突变多策略
mobile robotic armsinverse kinematicsdifferential evolution algorithmreinforcement learningdynamic mutation multi-strategy
《湖南大学学报(自然科学版)》 2026 (8)
1-13,13
国家自然科学基金资助项目(52402495,U2341269),National Natural Science Foundation of China(52402495,U2341269)
评论