面向插植手术机器人的单目视觉空间配准OA
Monocular vision-based spatial registration for implant surgery robots
为了提高插植手术机器人工作空间与手术空间的配准精度,提出一种基于单目视觉的插植手术机器人空间配准方法.通过单目相机的内参标定与手眼标定,建立了相机坐标系与插植手术机器人坐标系之间的手眼空间位姿关系.根据深度学习提出了基于CenterNet神经网络的手术目标关键点检测方法,运用PnP(Perspective-n-Point)建立了手术目标坐标系与相机坐标系映射模型.为提高空间配准的稳定性,采用LM(Levenberg-Marquardt)对映射模型进行非线性优化,结合手眼空间位姿关系,建立基于LM-PnP的插植手术机器人系统的位姿映射模型.最后,开展目标圆孔检测实验,以验证所提方法的稳定性.实验结果表明,所提LM-PnP算法在目标圆孔检测中的误差小于0.186 mm.机器人在不同位姿转换测试中,手术目标的姿态偏差为-1.5°~1°,位置偏差为-1~1 mm,表明该配准技术具有较好的稳定性和精确性.与传统双目深度相机相比,该方法仅需单目相机即可实现手术目标的精确配准,可在自然光源下进行操作,且无需依赖红外镜头与光学定位标记球.
To improve registration accuracy between the workspace of an implantation surgical robot and the surgical environment,a monocular vision-based spatial registration method is proposed.First,the spa-tial pose relationship between the camera coordinate system and the robot coordinate system is established through intrinsic calibration of the monocular camera and hand-eye calibration.Subsequently,a surgical target keypoint detection method based on the CenterNet neural network is developed using deep learning techniques.The Perspective-n-Point(PnP)algorithm is then employed to construct a mapping model be-tween the surgical target coordinate system and the camera coordinate system.To further enhance the sta-bility of spatial registration,the Levenberg-Marquardt(LM)algorithm is applied to perform nonlinear op-timization of the mapping model.By integrating the hand-eye calibration results,an LM-PnP pose map-ping model for the surgical robotic system is established.Finally,experiments are conducted to evaluate the stability and accuracy of the proposed method.The results indicate that the proposed LM-PnP algo-rithm achieves a detection error of less than 0.186 mm for the target circular hole.During robot pose trans-formation tests,the orientation and position deviations of the surgical target range from-1.5° to 1° and-1 mm to 1 mm,respectively.These results demonstrate that the proposed registration method provides high stability and accuracy.Compared with conventional binocular depth camera approaches,the proposed method requires only a monocular camera to achieve precise surgical target registration,operates under nat-ural lighting conditions,and does not rely on infrared sensors or optical marker spheres.
何振亚;钱佳珂;杜亦民;姚彦冰;张宪民
华南理工大学 机械与汽车工程学院 广东省精密装备与制造技术重点实验室,广东 广州 510640华南理工大学 机械与汽车工程学院 广东省精密装备与制造技术重点实验室,广东 广州 510640华南理工大学 机械与汽车工程学院 广东省精密装备与制造技术重点实验室,广东 广州 510640华南理工大学 机械与汽车工程学院 广东省精密装备与制造技术重点实验室,广东 广州 510640华南理工大学 机械与汽车工程学院 广东省精密装备与制造技术重点实验室,广东 广州 510640
机械制造
单目视觉空间配准手术机器人深度学习
monocular visionspatial registrationsurgical robotdeep learning
《光学精密工程》 2026 (5)
794-805,12
广州市科技计划资助项目(No.202201010072)广东省基础与应用基础研究基金资助项目(No.2019A1515011515)
评论