基于原型引导与双重对比学习的无源域自适应OA
Prototype guidance and dual-level contrastive learning for source-free domain adaptation
无源域自适应(source-free domain adaptation,SFDA)旨在源域数据不可访问的情况下,实现预训练模型从源域到目标域的有效迁移.现有SFDA方法大多采用自训练学习策略,但其易受噪声伪标签的影响,模型难以准确捕捉数据关键特征,导致性能下降.为此,本文提出一种基于原型引导与双重对比学习的无源域自适应方法(prototype guidance and dual-level contrastive learning,PDCL).PDCL 基于源模型提取源域各类特征,构建目标域初始类别级原型表示.通过特征融合策略对齐源域各类别特征与目标域样本特征,生成目标域伪标签.引入原型正交损失,通过最大化类间原型的正交性以增强判别性.PDCL采用双重对比学习策略:在决策空间进行实例级对比,拉近近邻样本并推远异类样本;在特征空间进行原型级对比,增强特征空间的结构一致性.在Office-31、Office-Home及DomainNet-126基准数据集上的实验结果表明,PDCL在SFDA中相较现有先进方法实现了性能提升,验证了其有效性.
Source-free domain adaptation(SFDA)aims to enable effective knowledge transfer of pre-trained models from the source domain to the target domain when the source samples are inaccessible.Most SFDA methods adopt self-training learning,but they are susceptible to noisy pseudo-labels,making it difficult for models to accurately capture in-trinsic features and leading to performance degradation.To address this issue,we propose a novel SFDA method named prototype guidance and dual-level contrastive learning(PDCL).Specifically,PDCL first extracts features from the source domain using the pre-trained source model to construct initial class-level prototype representations for the target domain.Subsequently,it aligns the features of source and target samples via a feature fusion strategy,thereby generat-ing pseudo-labels for the target domain.Secondly,it introduces a prototype orthogonality loss to enhance discriminabil-ity by maximizing the orthogonality between class prototypes.Finally,PDCL employs a dual-level contrastive learning strategy,where instance-level contrast is conducted in the decision space to pull near neighbors closer and push outliers away,while prototype-level contrast is conducted in the feature space to enhance structural consistency.Experimental results on Office-31,Office-Home,and DomainNet-126 datasets show that PDCL outperforms state-of-the-art methods,which validates its effectiveness.
杨立然;张小龙;赵振兵;翟永杰;苏攀
华北电力大学燕赵电力实验室,河北保定 071003||华北电力大学控制与计算机工程学院,河北保定 071003||华北电力大学复杂能源系统智能计算教育部工程研究中心,河北保定 071003华北电力大学控制与计算机工程学院,河北保定 071003华北电力大学燕赵电力实验室,河北保定 071003||华北电力大学电气与电子工程学院,河北保定 071003华北电力大学燕赵电力实验室,河北保定 071003||华北电力大学控制与计算机工程学院,河北保定 071003华北电力大学控制与计算机工程学院,河北保定 071003||华北电力大学河北省能源电力知识计算重点实验室,河北保定 071003
信息技术与安全科学
无源域自适应原型引导对比学习伪标签特征融合原型正交自训练特征对齐
source-free domain adaptationprototype guidancecontrastive learningpseudo-labelfeature fusionproto-type orthogonalityself-trainingfeature alignment
《智能系统学报》 2026 (5)
1130-1141,12
国家自然科学基金联合基金项目重点支持项目(U21A20486)河北省自然科学基金项目(F2024502002)中央高校基本科研业务费专项资金项目(2024MS129).
评论