融合零样本语义先验与双几何约束的煤矿井下动态SLAM方法OA
Dynamic SLAM method for underground coal mines integrating zero-shot semantic priors and dual geometric constraints
针对煤矿井下语义标注数据匮乏、深度信息缺失及人员、设备等动态目标运动模式复杂多样,导致视觉同步定位与建图(SLAM)在动态环境下特征误匹配增多和位姿估计稳定性下降等问题,提出了一种融合零样本语义先验与双几何约束的煤矿井下动态SLAM方法.首先,针对井下语义标注数据匮乏和设备类别的长尾分布问题,构建零样本语义先验模块,该模块基于开放词汇检测、稀疏光流估计与交互式分割生成潜在动态目标的初始语义掩码,并通过形态学处理优化掩码边界,在无需使用井下专用标注数据训练的条件下,为动态特征检测提供语义先验;然后,针对井下高反光、粉尘遮挡等因素造成的深度空洞问题,采用边缘优先填充的自适应深度修复策略补全缺失的深度信息,提高深度信息完整性与几何约束可靠性;最后,针对井下动态目标运动模式多样的问题,融合对极几何与深度重投影一致性约束,分别从二维极线一致性和三维深度一致性2个方面判别动态特征,实现不同运动模式下动态特征的鲁棒识别与剔除.在公开TUMRGB-D动态序列和自主采集的煤矿井下典型场景中开展实验,结果表明:所提方法能够减少动态特征误匹配,提升动态环境下的位姿估计精度和轨迹稳定性;在TUM RGB-D动态序列下的定位实验中,所提方法估计轨迹的绝对轨迹误差的均方根误差和标准差均低于对比方法;在煤矿井下场景的定位实验中,所提方法的估计轨迹与参考路径具有较好的形态一致性,表现出较好的定位稳定性与场景适应性.
Scarce semantically annotated data for underground coal mines,missing depth information,and complex and diverse motion patterns of dynamic objects such as personnel and equipment increase feature mismatches and reduce pose estimation stability in Visual Simultaneous Localization and Mapping(SLAM)in dynamic environments.To address these problems,a dynamic SLAM method for underground coal mines integrating zero-shot semantic priors and dual geometric constraints was proposed.First,to address scarce semantically annotated underground data and long-tailed equipment categories,a zero-shot semantic prior module was constructed.The module generated initial semantic masks for potential dynamic objects through open-vocabulary detection,sparse optical flow estimation,and interactive segmentation,and optimized mask boundaries through morphological processing,thereby providing semantic priors for dynamic feature detection without training on dedicated annotated underground data.Then,to address missing depth regions caused by high reflectance and dust occlusion underground,an adaptive depth image inpainting strategy based on edge-first filling was used to complete missing depth information and improve the completeness of depth information and the reliability of geometric constraints.Finally,to address diverse motion patterns of dynamic objects underground,epipolar geometry and depth reprojection consistency constraints were integrated to identify dynamic features in terms of two-dimensional epipolar consistency and three-dimensional depth consistency,enabling robust identification and removal of dynamic features under different motion patterns.Experiments were conducted on public TUM RGB-D dynamic sequences and self-collected data from typical underground coal mine scenes.The results showed that the proposed method reduced dynamic feature mismatches and improved pose estimation accuracy and trajectory stability in dynamic environments.In localization experiments on TUM RGB-D dynamic sequences,both the root mean square error and standard deviation of absolute trajectory error for trajectories estimated by the proposed method were lower than those of the comparison methods.In localization experiments in underground coal mine scenes,trajectories estimated by the proposed method were broadly consistent in shape with the reference paths and exhibited good localization stability and scene adaptability.
牟琦;王雄杰;张正义;郭柏璋;句建国
西安科技大学人工智能与计算机学院,陕西西安 710054西安科技大学人工智能与计算机学院,陕西西安 710054西安科技大学人工智能与计算机学院,陕西西安 710054西安科技大学人工智能与计算机学院,陕西西安 710054西安科技大学人工智能与计算机学院,陕西西安 710054
矿业与冶金
煤矿井下动态SLAM语义先验对极几何深度重投影一致性动态特征检测
dynamic SLAM for underground coal minessemantic priorepipolar geometrydepth reprojection consistencydynamic feature detection
《工矿自动化》 2026 (7)
45-56,12
广西重点研发计划项目(FN2504240008)陕西省教育厅重点科学研究计划重点项目(25JR113).
评论