基于交替中心聚类的无监督跨模态行人重识别OA
Unsupervised cross-modal person re-identification based on alternating center clustering
针对现有无监督跨模态行人重识别方法在聚类过程中通常仅对各模态数据进行独立聚类,难以有效建立跨模态关联的难题,提出一种交替中心聚类策略与优化方法.首先,对不同模态的数据分别进行模态内聚类以形成初始类簇;然后,利用该初始类簇的先验信息,通过交替选择不同模态类簇中心作为全局数据初始类簇中心进行二次聚类,从而构建跨模态类簇关联.此外,设计了混合对比学习框架,用于进一步减小模态间差异,通过构建混合聚类中心联合学习模态特定信息和模态不变信息,以优化跨模态特征表达.实验结果表明:本研究模型在SYSU-MM01和RegDB数据集上的两种模式下,相对于基线模型mAP指标分别取得了 7.09%,5.89%和18.52%,18.30%的性能提升.
In addressing the challenge that existing unsupervised cross-modal person re-identification methods typically performed independent clustering for each modality,making it difficult to effectively establish cross-modal associations,an alternating center clustering strategy and optimization method was proposed.First,the data of different modalities were clustered independently to form initial clusters within each modality.Then,using the prior information of these initial clusters,an alternating approach was applied,where the centers of different modality clusters were selected as global initial cluster centers for secondary clustering,thereby constructing cross-modal cluster associations.Additionally,a hybrid contrastive learning framework was designed to further reduce the modality discrepancies by jointly learning modality-specific and modality-invariant features through the optimization of cross-modal feature representations with hybrid clustering centers.Experimental results show that compared to the baseline model,the proposed model achieves a performance improvement in mAP of 7.09%and 5.89%on the SYSU-MM01 dataset,and 18.52%and 18.30%on the RegDB dataset under two modes,respectively.
陈峰;李果;何结龙;刘阳
安徽工业大学计算机科学与技术学院,安徽马鞍山 243032安徽工业大学计算机科学与技术学院,安徽马鞍山 243032安徽工业大学计算机科学与技术学院,安徽马鞍山 243032安徽工业大学计算机科学与技术学院,安徽马鞍山 243032
信息技术与安全科学
无监督学习行人重识别多模态聚类对比学习特征表示
unsupervised learningperson re-identificationmulti-modal clusteringcontrastive learningfeature representation
《华中科技大学学报(自然科学版)》 2026 (5)
54-60,7
国家自然科学基金资助项目(62206006).
评论