首页|期刊导航|南京信息工程大学学报|时序特征与几何约束辅助的三维目标检测技术及应用

时序特征与几何约束辅助的三维目标检测技术及应用OA

3D object detection with temporal features and geometric constraints:techniques and applications

中文摘要英文摘要

当前主流的单目3D目标检测网络采用关键点检测,在时序特征建模、几何约束与深度估计方面存在局限性,限制了3D检测器的性能发挥.本文提出一种改进的单目3D目标检测算法MonoTGD,引入时序特征交互模块,利用多帧序列的长短期时序信息增强特征表达的一致性和动态建模能力;几何结构增强模块通过扩展关键点集合并引入几何一致性约束提升关键点预测的准确性;伪深度生成与监督模块在不引入激光雷达数据的同时生成的伪深度图为深度估计提供有效的监督信号.上述模块仅在训练阶段使用,推理阶段不引入额外的计算成本.在KITTI3D数据集上的实验结果表明,相比基线方法MonoCon,MonoTGD在验证集上的3D检测平均精度指标,在简单类别上提高了4.25个百分点,而在测试集上,中等难度类别提高了4.82个百分点.特别是测试集上中等难度类别的性能提升,充分验证了本方法在实际应用场景中的有效性.

Current mainstream monocular 3D object detection networks,which are based on keypoint detection,ex-hibit limitations in temporal feature modeling,geometric constraint utilization,and depth estimation,thereby constrai-ning the overall performance of 3D detectors.This paper proposes MonoTGD(Monocular Temporal Geometric Deep),an improved monocular 3D object detection algorithm.The proposed framework incorporates three key mod-ules:a temporal feature interaction module that leverages both long-and short-term temporal information from multi-frame sequences to enhance feature representation consistency and dynamic modeling capabilities;a geometric struc-ture enhancement module that improves keypoint prediction accuracy by expanding the keypoint set and enforcing geometric consistency constraints;a pseudo-depth generation and supervision module that produces pseudo-depth maps without requiring LiDAR data,thereby providing effective supervisory signals for depth estimation.Crucially,all these modules are used only during the training phase,introducing no additional computational cost during infer-ence.Experiments on the KITTI3D dataset show that MonoTGD significantly improves performance.Specifically,it increases the average precision of 3D detection on the validation set by 4.25 percentage points in the easy category.More importantly,it achieves a gain of 4.82 percentage points in the moderate difficulty category on the test set,which fully validates the method's effectiveness in practical application scenarios.

许德刚;刘栋梁;李滨;李宝森

河南工业大学粮食信息处理与控制教育部重点实验室,郑州,450001||河南工业大学河南省粮食仓储信息智能感知与决策重点实验室,郑州,450001河南工业大学粮食信息处理与控制教育部重点实验室,郑州,450001||河南工业大学河南省粮食仓储信息智能感知与决策重点实验室,郑州,450001||河南工业大学信息科学与工程学院,郑州,450001河南工业大学粮食信息处理与控制教育部重点实验室,郑州,450001||河南工业大学河南省粮食仓储信息智能感知与决策重点实验室,郑州,450001||河南工业大学信息科学与工程学院,郑州,450001河南工业大学粮食信息处理与控制教育部重点实验室,郑州,450001||河南工业大学河南省粮食仓储信息智能感知与决策重点实验室,郑州,450001||河南工业大学信息科学与工程学院,郑州,450001

信息技术与安全科学

3D目标检测时序特征建模多关键点约束深度估计几何一致性

3D object detectiontemporal feature modelingmulti-keypoint constraintsdepth estimationgeometric consistency

《南京信息工程大学学报》 2026 (3)

289-301,13

河南省重大科技专项(241100210100)河南工业大学粮食信息处理中心科研平台开放课题(KFJJ2023003)

10.13878/j.cnki.jnuist.20250314001

评论