首页|期刊导航|自动化学报|冗余人工肌肉驱动的仿生机器人强化学习控制

冗余人工肌肉驱动的仿生机器人强化学习控制OA

Reinforcement Learning Control for Bioinspired Robots Driven by Redundant Artificial Muscles

中文摘要英文摘要

人工肌肉是仿生机器人的核心驱动部件,然而当前人工肌肉的应用与真实生物相差甚远,缺乏像生物一样的冗余多肌肉协同.针对上述问题,围绕仿生机器人的复杂人工肌肉驱动与协同,本文提出一种由多股人工肌肉并联驱动的软体机器人设计,并围绕这种设计建立基于强化学习的运动控制策略.研制了以柔性十字形电路板为主体,集成六路液晶弹性体人工肌肉与驱动电路的原型样机,并测试获得其应变特性与响应性能;针对原型样机形变-运动特点,在仿真环境中构建基于绳腱驱动的简化模型.通过合理设计状态空间、动作空间及奖励函数等,以 soft Actor-Critic 算法进行强化学习并行训练,得到平移与旋转运动肌肉协同策略.将运动策略中稳定周期段以离线方式驱动实物样机,实现有效的多向平移与旋转运动,验证了采用强化学习控制复杂人工肌肉系统的可行性.

Artificial muscles are key actuation components for bioinspired robots.However,their current applica-tions remain far from the capabilities of biological muscle systems,particularly due to the lack of redundant and co-ordinated multi-muscle actuation similar to that found in living organisms.To address the challenge of complex ar-tificial-muscle actuation and coordination in bioinspired robots,this study proposes a soft robotic design driven by multiple artificial muscles arranged in parallel and develops a reinforcement learning-based locomotion control strategy for this design.A prototype was developed using a flexible cross-shaped printed circuit board as the main body,integrating six liquid crystal elastomer artificial muscles and their driving circuits.Its strain characteristics and dynamic response performance were experimentally characterized.Considering the deformation and locomotion characteristics of the prototype,a simplified tendon-driven model was constructed in a simulation environment.By properly designing the state space,action space,and reward functions,parallel reinforcement learning training was conducted using the soft Actor-Critic algorithm to obtain coordinated muscle activation strategies for translational and rotational locomotion.The stable periodic segments of the learned locomotion policies were then extracted and used to drive the physical prototype offline.The robot achieved effective multidirectional translation and rotation,demonstrating the feasibility of using reinforcement learning to control complex artificial-muscle-driven systems.

牛鹏军;程屹涛;朱彦臣;厉侃;刘珂

北京大学先进制造与机器人学院 北京 100871北京大学先进制造与机器人学院 北京 100871华中科技大学智能制造装备与技术全国重点实验室 武汉 430074华中科技大学智能制造装备与技术全国重点实验室 武汉 430074北京大学先进制造与机器人学院 北京 100871

仿生机器人人工肌肉强化学习软体机器人运动控制

bionic robotartificial musclesreinforcement learningsoft robotlocomotion control

《自动化学报》 2026 (5)

953-965,13

国家重点研发计划(2022YFB4701900)资助 Supported by National Key Research and Development Pro-gram of China(2022YFB4701900)

10.16383/j.aas.c250508

评论