面向复杂地形场景的四轮独立转向重载机器人端到端控制OA
End-to-end Control for 4WISD Heavy-duty Robots in Complex Terrains
针对四轮独立转向与驱动(4WISD)移动机器人在复杂地形中依赖理想约束与参数整定、易受轮地非理想效应影响而泛化受限的问题,构建一种无需显式模型计算的端到端深度强化学习底层控制策略.该方法基于近端策略优化算法,结合课程学习与域随机化构建多地形、多扰动训练过程,并通过结构化状态-动作定义与物理启发奖励塑形,使策略由本体观测直接生成四轮转向角与轮速命令,实现多轮协同与侧滑抑制.基于 Isaac Sim 高保真仿真平台,在起伏粗糙地形和低摩擦平面两类工况下与 PID-LS、MPC-LS 级联基线进行对比.结果表明,该策略在工况变化下性能波动较小,在粗糙地形中线速度跟踪更接近任务目标,且在线计算开销较低,单步耗时 0.304 ms.室外平整水泥地面实机验证表明,该策略可基于ROS-PLC控制链路稳定在线运行,三轴速度RMSE分别为0.169 m/s、0.213 m/s和0.116 rad/s;单步策略推理耗时0.62 ms,传感器同步与状态构建平均耗时 56.15 ms.结果验证了端到端数据驱动底层控制在 4WISD 平台无精确建模条件下的可行性,为高自由度轮式移动平台复杂环境运动控制提供了创新路径.
To address the limited generalization of traditional control methods for four-wheel independent steering and driving(4WISD)mobile robots in complex terrains,caused by their reliance on idealized constraints and para-meter tuning as well as their susceptibility to non-ideal wheel-ground interactions,an end-to-end deep reinforce-ment learning low-level control policy without explicit model-based computation is developed.Based on proximal policy optimization,the method integrates curriculum learning and physics-based domain randomization to con-struct a multi-terrain and multi-disturbance training process.With a structured state-action formulation and phys-ically motivated reward shaping,the policy directly maps proprioceptive observations to four-wheel steering-angle and wheel-speed commands,enabling coordinated multi-wheel control and slip suppression.Experiments in the high-fidelity Isaac Sim simulator compare the proposed policy with PID-LS and MPC-LS cascaded baselines under rough undulating terrains and low-friction flat terrains.Results show that the proposed policy exhibits smaller perform-ance fluctuations across conditions,achieves more accurate linear-velocity tracking on rough terrains,and main-tains low online computational cost,with a single-step latency of 0.304 ms.Real-world validation on an outdoor flat concrete surface further demonstrates stable online execution through a ROS-PLC control pipeline,with velocity root mean square error(RMSE)values of 0.169 m/s,0.213 m/s,and 0.116 rad/s for the three velocity components.The policy inference latency is 0.62 ms,while sensor synchronization and state construction take 56.15 ms on aver-age.These results verify the feasibility of end-to-end data-driven low-level control for 4WISD platforms without pre-cise modeling,offering an innovative approach to motion control of high-DOF wheeled mobile robots in complex en-vironments.
徐德刚;王逸之;谢永芳
中南大学自动化学院 长沙 410083中南大学自动化学院 长沙 410083中南大学自动化学院 长沙 410083
四轮独立转向与驱动深度强化学习端到端控制复杂地形
four-wheel independent steering and drivingdeep reinforcement learningend-to-end controlcomplex terrain
《自动化学报》 2026 (9)
1979-1991,13
国家自然科学基金(62473386),湖南省重点研发计划项目(2025RC1009,2023GK2096),山东省重点研发计划项目(2025GNKJHZ0201),新疆维吾尔自治区重大科技专项项目(2022A02010)资助 Supported by National Natural Science Foundation of China(62473386),the Key Research and Development Project of Hunan Province(2025RC1009,2023GK2096),the Key Re-search and Development Project of Shandong Province(2025GNKJHZ0201),and the Major Science and Technology Special Project of Xinjiang Uyghur Autonomous Region(2022A02010)
评论