首页|期刊导航|中国计量大学学报|基于前景点稠密化的多模态3D目标检测算法

基于前景点稠密化的多模态3D目标检测算法OACHSSCD

A multimodal 3D object detection algorithm based on foreground point densification

中文摘要英文摘要

目的:受限于激光雷达的采样机制,点云数据在远距离及遮挡场景下呈现出极度稀疏性,导致目标几何结构信息严重丢失.针对这个问题,本研究提出一种基于前景点稠密化的多模态 3D 目标检测算法.方法:通过融合图像语义分割与深度补全信息,对前景区域点云进行针对性增强,以补充原始点云中目标缺失的结构细节信息;同时,构建双分支并行网络以平衡生成点云的几何完整性与原始点云真实分布的一致性.结果:在KITTI 数据集上的实验结果表明,本研究所提方法在汽车、行人和自行车三类目标上均取得了稳定的性能提升,尤其在远距离及遮挡严重的困难场景以及 30 m 以上的中远距离区间表现优异.结论:本研究有效融合了图像中的深度信息与语义信息,为提升复杂场景下的 3D 目标检测鲁棒性提供了一种新的技术思路.

Aims:Limited by the sampling mechanism of LiDAR,point cloud data usually exhibits significant sparsity,making it difficult to fully describe the geometric structure information of objects.To address this problem,this paper proposes a multimodal 3D object detection method based on foreground point densification.Methods:By fusing image semantic segmentation and depth completion information,targeted enhancement was performed on the point cloud of foreground regions to supplement the missing structural details of objects in the raw point cloud.Meanwhile,a dualbranch parallel network was constructed to balance the completeness of the generated point cloud set and the distribution consistency of the raw point cloud.Results:Extensive experimental results on the KITTI dataset demonstrated that the proposed method achieved consistent performance improvements on three categories of objects:car,pedestrian,and cyclist.It exhibited superior performance especially in challenging scenarios and for medium-to long-range objects.Conclusions:This study combines depth information and semantic information in images,providing a novel solution for 3D object detection tasks.

廖鹏;谭爱红;邵永鑫

中国计量大学 机电工程学院,浙江 杭州 310018中国计量大学 机电工程学院,浙江 杭州 310018中国计量大学 机电工程学院,浙江 杭州 310018

信息技术与安全科学

前景稠密化BEV特征融合3D目标检测点云多模态融合

foreground point densificationBEV feature fusion3D object detectionpoint cloudmultimodal fusion

《中国计量大学学报》 2026 (2)

267-276,10

10.3969/j.issn.2096-2835.2026.02.013

评论