慧眼识"新"开放词汇目标检测OA
Sharp eyes spot the"novel"in open-vocabulary object detection
针对开放场景中模型前景判别能力弱、基类偏差大导致新类检测精度较低的问题,提出一种慧眼识"新"开放词汇目标检测方法.首先,设计前景特征判别模块,利用前景估计器对潜在新类区域建模并生成高质量伪标签,实现前景与背景的精准区分,以增强模型对前景特征的判别能力.其次,提出双向特征对齐模块,采用双向跨模态对齐机制与置信度校准策略,抑制训练过程中的基类偏差,强化模型对新类特征的学习.最后,构建对比降噪训练模块,引入噪声视觉-文本对进行对比学习,进一步提升模型对前景特征的区分能力与新类泛化能力.实验结果表明,该方法在COCO数据集及更具挑战性的细粒度LVIS数据集上,新类检测精度分别达到44.9%和37.4%,优于当前主流方法,有效提升了开放场景下的新类检测性能.
To address the low detection accuracy of novel classes in open-world scenarios-primarily caused by weak foreground discrimination and strong bias toward base classes-an open-vocabulary object detection framework named Sharp Eyes Spot the"Novel"in Open-Vocabulary Object Detection(SSN-OVD)is proposed.First,a Foreground Feature Discrimination(FFD)module is introduced,in which a fore-ground estimator is employed to model potential novel-class regions and generate high-quality pseudo-la-bels,enabling more precise foreground-background separation and enhancing the discriminability of fore-ground features.Second,a Bidirectional Feature Alignment(BFA)module is designed to leverage bidi-rectional cross-modal alignment together with confidence calibration,thereby mitigating base-class bias during training and strengthening the model's capability to learn robust representations of novel classes.Third,a Contrastive Denoising Training(CDT)module is developed,incorporating noisy visual-text pairs into the contrastive learning process to further improve feature discrimination and generalization for novel categories.Experimental results demonstrate that the proposed approach achieves state-of-the-art performance,yielding novel-class detection accuracies of 44.9% on COCO and 37.4% on the more chal-lenging fine-grained LVIS dataset.These results indicate that the method effectively enhances novel-class detection in open-world environments.
金友;张若楠;邓箴;杨军;刘立波
宁夏大学 信息工程学院,宁夏 银川 750021宁夏大学 前沿交叉学院,宁夏 中卫 755000宁夏大学 信息工程学院,宁夏 银川 750021宁夏大学 信息工程学院,宁夏 银川 750021宁夏大学 信息工程学院,宁夏 银川 750021||宁夏大学 宁夏"东数西算"人工智能与信息安全重点实验室,宁夏 银川 750021
信息技术与安全科学
目标检测开放词汇前景特征判别双向特征对齐对比降噪训练
object detectionopen-vocabularyforeground feature discriminationbidirectional feature alignmentcontrastive denoising training
《光学精密工程》 2026 (5)
830-846,17
宁夏自然科学基金资助项目(No.2024AAC02010,No.2023AAC02010)宁夏科技创新领军人才计划(No.2022GKLRLX03)银川市科技计划项目(No.2025RC09)国家自然科学基金资助项目(No.62262053,No.62506179)2024年宁夏回族自治区重点研发计划(引才专项)(No.2024BEH04026)
评论