复杂关节物体六自由度位姿估计与实时系统OA
6-DoF pose estimation and real-time system for complex articulated objects
针对复杂关节物体六自由度位姿估计中存在的运动学约束建模不足等问题,提出了一种关节感知解耦的位姿估计方法.采用关节感知的解耦建模策略,利用独立分支分别回归物体旋转与平移,从而缓解二者之间的误差耦合.在此基础上,设计注意力引导的多模态特征融合机制,动态建模图像语义与点云几何间的跨模态相关性,实现遮挡稳定的特征提取.最后,设计自适应加权方案自动平衡多项损失函数,并结合轻量化预测模块实现部件铰接参数的回归.在ArtIm-age基准数据集上的实验结果表明,该方法在无需额外优化步骤的情况下,单张图像的推理速度最快可达20 ms;对于抽屉等复杂多部件物体,旋转误差稳定在1.6°;眼镜类别的3D IoU提升约28%,在绝大多数类别和指标上均优于对比基准.该框架实现了从基座视角到各部件运动学的统一估计,在保证物理一致性的同时,显著提升了位姿预测的实时性与精确度,具备嵌入机器人实时视觉系统的应用潜力.
To address limitations in kinematic modeling for 6-DoF pose estimation of complex articulated objects,a joint-aware decoupled pose estimation framework is proposed.A decoupled modeling strategy is adopted,in which rotation and translation are regressed through independent branches,thereby reducing error coupling.An attention-guided multimodal feature fusion mechanism is developed to capture the rela-tionships between image semantics and point cloud geometry,enhancing robustness under occlusion.An adaptive weighting scheme is further introduced to balance multiple loss terms during training.In addition,a lightweight module is designed to predict part-level articulation parameters.Experimental results on the ArtImage dataset demonstrate that the proposed method achieves an inference speed of up to 20 ms per frame without requiring external optimization.For complex objects such as drawers,the rotation error re-mains stable at 1.6°,while the 3D IoU for the glasses category improves by approximately 28%.The method consistently outperforms baseline approaches across most categories and evaluation metrics.The proposed framework enables unified estimation from the base pose to articulated parts,improving both pose accuracy and inference efficiency while preserving physical consistency.
欧林林;陈婷;禹鑫燚;Umarov Tilek Mutalibovich;姜浩男
浙江工业大学 信息工程学院,浙江 杭州 310023浙江工业大学 信息工程学院,浙江 杭州 310023浙江工业大学 信息工程学院,浙江 杭州 310023奥什国立大学,奥什 723500浙江工业大学 信息工程学院,浙江 杭州 310023
信息技术与安全科学
复杂关节物体六自由度位姿估计关节感知解耦跨模态融合自适应加权
complex articulated objects6-DoF pose estimationjoint-aware decouplingcross-modal fu-sionadaptive weighting
《光学精密工程》 2026 (9)
1411-1422,12
国家自然科学基金资助项目(No.62373329)浙江省自然科学基金资助项目(No.LZ25F030003,No.LBMHD24F030002)
评论