首页|期刊导航|计算机技术与发展|毫米波雷达物理先验引导的多模态3D目标检测

毫米波雷达物理先验引导的多模态3D目标检测OA

Millimeter-wave Radar Prior-guided Multimodal 3D Object Detection

中文摘要英文摘要

针对单一传感器在复杂天气与光照条件下性能受限的问题,融合毫米波雷达与视觉信息的多模态3D 目标检测方法成为提升系统鲁棒性的有效途径.当前主流方法仍面临雷达点云稀疏、图像深度估计不准确及异构模态特征交互不足等挑战.为此,提出一种雷达物理特性先验引导的动态多模态融合增强方法.该方法构建了雷达先验增强网络(Radar Prior Enhancement Network,RaPENet),利用雷达反射强度等物理属性通过动态高斯扩展对稀疏点云特征稠密化建模,并结合空间感知信息优化图像模态深度估计.为了缓解在鸟瞰图(Bird's-Eye View,BEV)空间融合过程中跨模态特征交互不充分的问题,设计了可变形交叉注意力门控融合模块(Deformable Cross-Attention with Gated Fusion,DCAGFusion),通过动态空间采样与模态可信度调控机制实现异构模态 BEV 特征之间的空间对齐与自适应性融合.在 nuScenes 基准数据集上的实验表明,该方法在 NDS 与 mAP 指标上分别达到57.4%和45.9%,相较于基线模型提升0.6%,验证了该方法在检测精度与环境适应性方面的有效性.

Multimodal 3D object detection has emerged as an effective solution to overcome the limitations of single sensors under adverse weather and lighting conditions.However,existing approaches are hindered by sparse radar point clouds,inaccurate image depth estimation,and weak cross-modal feature interaction.To address these challenges,we propose a radar prior-guided multimodal fusion framework.This framework constructs a radar prior enhancement network(RaPENet)which leverages physical attributes such as Radar Cross Section to densify sparse point clouds through dynamic Gaussian expansion and to enhance image depth estimation with spatially aware constraints.To further improve fusion in Bird's-Eye View(BEV)space,we design a Deformable Cross-Attention with Gated Fusion(DCAGFusion)module that enables spatially aligned and confidence-adaptive integration of cross-modal BEV features.Experiments on the nuScenes benchmark show that the proposed method achieves 57.4%NDS and 45.9%mAP,surpassing baseline models by 0.6%.These results highlight the advantage of incorporating radar physical priors and adaptive fusion for robust and accurate multimodal 3D detection in challenging environments.

郭江涛;高媛;翟双姣;秦品乐;曾建潮

中北大学 计算机科学与技术学院,山西 太原 030051中北大学 计算机科学与技术学院,山西 太原 030051中北大学 计算机科学与技术学院,山西 太原 030051中北大学 计算机科学与技术学院,山西 太原 030051中北大学 计算机科学与技术学院,山西 太原 030051

信息技术与安全科学

3D目标检测毫米波雷达多模态融合雷达物理特性图像深度估计

3D object detectionmillimeter-wave radarmultimodal fusionradar physical attributesimage depth estimation

《计算机技术与发展》 2026 (5)

36-44,9

山西省基础研究计划项目(青年)(202203021222049)

10.20165/j.cnki.ISSN1673-629X.2025.0353

评论