基于动态特征融合与特征感知的可见光-红外行人重识别方法OA
Visible-infrared person re-identification via dynamic feature fusion and feature-awareness
可见光-红外行人重识别(VI-ReID)因面临显著的跨模态差异和类内差异而极具挑战性.当前主流方法主要通过对齐特征空间来学习模态共享表示,但过度侧重跨模态共性,弱化了可见光纹理、红外热辐射等模态专属特征及其身份判别特征的利用.为此,提出基于动态特征融合与特征感知的可见光-红外行人重识别框架(visible-infrared person re-identification via dynamic feature fusion and feature-awareness,DFFA),依托 Transformer 长距离建模优势,通过跨模态交叉注意力动态融合可见光局部纹理与红外全局热辐射特征,保留模态专属与共享特征互补性.设计多维度损失函数,模态融合对比损失分别关联可见光局部特征、红外全局特征与辅助表征,模态内一致性损失约束特征稳定性,全局分类损失增强身份判别力,三者协同优化特征交互与判别性.改进 k-互近邻重排序算法并应用于跨模态场景,降低邻域模态偏差.实验在 SYSU-MM01、RegDB 和LLCM 三个数据集上验证了方法有效性:在 SYSU-MM01 全搜索模式下 Rank-1 精度达 76.35%、平均精度均值(mAP)达 79.56%;在 RegDB 的 VIS to IR 模式下 Rank-1 精度达 92.83%、mAP 为88.68%;在 LLCM 复杂弱光场景中,VIS to IR 模式 Rank-1 精度达 68.2%、mAP 为 66.3%,IR to VIS 模式 Rank-1 精度为 56.5%、mAP 为 63.4%.结果充分证实了动态特征融合、多维度损失设计及改进重排序策略的协同有效性.
Visible-infrared person re-identification(VI-ReID)remains challenging due to cross-modal discrepancies and intra-class variations.While existing methods focus on feature space alignment for cross-modal shared representations,they often neglect modality-specific discriminative features such as visible textures and infrared thermal patterns.To address this limitation,a visible-infrared person re-identification framework via dynamic feature fusion and feature-awareness(DFFA)is proposed.Leveraging Transformer's long-range modeling capabilities,DFFA dynamically integrates local visible textures with global infrared thermal features through cross-modal attention,effectively preserving complementary modality-specific and shared characteristics.Our framework features a multi-dimensional loss design:a modality-fusion contrastive loss aligns local visible features,global infrared features,and auxiliary representations,an intra-modality consistency loss stabilizes feature learning,a global classification loss enhances identity discrimination.Additionally,a cross-modal optimized k-reciprocal re-ranking algorithm to mitigate modality bias in neighborhood similarity assessment is developed.Extensive experiments on three datasets(SYSU-MM01,RegDB,and LLCM)demonstrate state-of-the-art performance:achieving Rank-1 accuracies of 76.35%(SYSU-MM01,All-search)and 92.83%(RegDB,VIS to IR)with mAP scores of 79.56%and 88.68%,respectively.In complex low-light scenarios of LLCM,Rank-1 reaches 68.2%(VIS to IR)and 56.5%(IR to VIS)with mAP of 66.3%and 63.4%.These results validate the synergistic effectiveness of our dynamic fusion strategy,multi-loss design,and enhanced re-ranking approach.
史娜;陈琳琳;何强;张长伦
北京建筑大学 理学院,北京 102616北京建筑大学 理学院,北京 102616||北京建筑大学 大数据建模理论与技术研究所,北京 102616北京建筑大学 理学院,北京 102616||北京建筑大学 大数据建模理论与技术研究所,北京 102616北京建筑大学 理学院,北京 102616||北京建筑大学 大数据建模理论与技术研究所,北京 102616
信息技术与安全科学
行人重识别跨模态特征融合对比损失函数k-互近邻重排序算法
person re-identificationcross-modalityfeature fusioncontrastive lossk-reciprocal re-ranking algorithm
《陕西师范大学学报(自然科学版)》 2026 (5)
65-80,16
国家自然科学基金(12301581)北京市自然科学基金(4252033)北京建筑大学基本科研业务费(X25039)
评论