融合语义分割的葡萄果园机器人稠密地图构建方法OA
Dense Mapping Method for Grape Orchard Robots Integrating Semantic Segmentation
针对葡萄果园作业机器人存在的定位精度低、果实识别不准确及地图质量不理想等问题,提出一种融合语义分割的稠密建图算法 PDS-SLAM.基于 ORB-SLAM3 框架,通过改进特征点提取策略,结合角点数量自适应调节FAST阈值,并改进四叉树算法,提高特征点分布均匀性,提升定位精度;在 PIDNet 基础上融合 DSA 模块提出PDSNet,改善对果实的空间感知能力,提高果实识别效果;引入稠密建图线程与八叉树线程,通过点云恢复算法得到局部点云,利用统计离群点滤波与半径滤波优化局部点云,并结合语义掩膜对葡萄点云进行语义标注生成语义地图,最后转换为八叉树地图.在 EuRoC数据集实验中,PDS-SLAM 绝对轨迹误差比 ORB-SLAM3 降低 27.3%,ORB特征点匹配数量平均提升 15.5%;在自建数据集上,PDSNet在速度 126.92 f/s下 IoU 达到 78.9%.研究结果表明,PDS-SLAM 可提升果园机器人定位和感知能力,为果园机器人导航与作业提供支持.
Aiming to address low localization accuracy,unreliable fruit recognition,and poor map quality in vineyard robots,PDS-SLAM,a dense mapping algorithm that integrated semantic segmentation was proposed.Built on ORB-SLAM3,each image was partitioned during feature extraction;the regional FAST threshold was adaptively adjusted according to regional corner counts;and quadtree uniformization method with minimum distance was applied,which improved spatial uniformity and matching robustness of feature points,thereby enhancing localization accuracy.A network,PDSNet,was proposed by integrating a DSA module into PIDNet,enhancing spatial perception of grape clusters and improving fruit recognition.A dense mapping thread and an octree thread were introduced:images were projected to recover local dense point clouds via a point cloud recovery algorithm;statistical outlier filter and radius filter were applied to remove aberrant points;semantic masks were used to annotate grape clusters,yielding a dense semantic map that was finally converted into an octomap.In experiments on the EuRoC dataset and a self-collected dataset,a 27.3%reduction in absolute trajectory error(ATE)on the MH03 sequence relative to ORB-SLAM3 and a 15.5%average increase in matched ORB features were achieved,indicating improved localization accuracy.PDSNet achieved an IoU of 78.9%for grape segmentation at 126.92 f/s.The results demonstrated that PDS-SLAM enhanced localization perception and produced dense semantic maps and octree maps,supporting autonomous navigation and precision operations for orchard robots.
冯桑;张禧龙;杨润彬;陈彦阳;黄晓涛
广东工业大学机电工程学院,广州 510006广东工业大学机电工程学院,广州 510006广东工业大学机电工程学院,广州 510006广东工业大学机电工程学院,广州 510006广东工业大学机电工程学院,广州 510006
信息技术与安全科学
ORB-SLAM3葡萄果园机器人语义分割语义地图
ORB-SLAM3grape orchard robotsemantic segmentationsemantic map
《农业机械学报》 2026 (6)
36-44,9
广东省研究生教育创新计划项目(粤教研函[2023]3号)
评论