LSTM-Enhanced Deep Reinforcement Learning for Active Motion Compensation of Surgical Robots with Known Target PositionOA
Active motion compensation is essential for improving the precision and safety of robot-assisted surgery in the presence of physiological motion such as heartbeat and respiration.Conventional direct error feedback controllers often show limited performance when sensing delay and measurement noise are present.To address this issue,this study proposes an active motion compensation framework based on deep reinforcement learning enhanced with a Long Short-Term Memory(LSTM)network,where the target position is assumed to be known.The motion compensation task is formulated as a Markov decision process,and the controller is trained to generate continuous control forces for the surgical instrument in three Cartesian directions.To overcome the performance degradation caused by sensing delay,LSTM is incorporated into both the actor and critic networks.Four controllers,including DDPG,TD3,DDPG-LSTM,and TD3-LSTM,are trained and evaluated in a Unity-based simulation environment with a 40 ms sensing delay and zero-mean Gaussian measurement noise.Experiments are conducted on simulated motion signals as well as Phantom and in vivo cardiac motion datasets.The results show that conventional fully connected controllers trained by DDPG and TD3 fail to achieve satisfactory compensation under delayed conditions,whereas the proposed LSTM-enhanced controllers significantly improve tracking performance.Among them,TD3-LSTMachieves the best overall results,with RMSE values of 0.1739,0.3823,and 0.6136 mm on simulated,Phantom,and in vivo data,respectively.In addition,the proposed LSTM-enhanced controller outperforms a conventional PD controller,demonstrating the effectiveness of combining temporal sequencemodelingwith reinforcement learning for delay-aware surgical motion compensation.
Wei Wei;Shujuan Li;Legend Zhang;Junmin Lyu;Qi Hu;Wenfeng Zheng;Bo Yang
School of Optoelectronic Science and Intelligent Instrumentation,Xi''an University of Technology,Xi''an,China School of Intelligent Manufacturing,Xi''an University,Xi''an,ChinaSchool of Optoelectronic Science and Intelligent Instrumentation,Xi''an University of Technology,Xi''an,ChinaFuture Tech Institute,Guangzhou Huashang University,Guangzhou,ChinaFuture Tech Institute,Guangzhou Huashang University,Guangzhou,ChinaSchool of Automation Engineering,University of Electronic Science and Technology of China,Chengdu,ChinaFuture Tech Institute,Guangzhou Huashang University,Guangzhou,China School of Automation Engineering,University of Electronic Science and Technology of China,Chengdu,ChinaSchool of Automation Engineering,University of Electronic Science and Technology of China,Chengdu,China
信息技术与安全科学
Active motion compensationsurgical robotdeep reinforcement learningLSTMTD3time delay
《Computer Modeling in Engineering & Sciences》 2026 (8)
P.1433-1457,25
Supported by Chengdu Science and Technology Program[2026-YF08-00034-GX].
评论