融合提示学习与分类确定性最大化的领域自适应OA
Domain Adaptation Based on Prompt Learning and Classification Certainty Maximization
领域自适应面临现实场景复杂多变的问题,且现有的方法大多注重优化分类的一致性,而忽略了分类的确定性.针对上述问题,提出一种结合对比语言-图像预训练(constrastive language-image pre-training,CLIP)与分类确定性最大化的网络模型.CLIP 作为一个多模态预训练模型,通过对大规模的图像-文本对进行预训练,具有强大的跨域泛化能力.通过提示学习和对比学习获取 CLIP 模型的知识,使模型适应更多的复杂现实场景.通过分类确定性最大化的方法,采用双分类器评估分类的一致性,减少模型在推理过程中的混淆.在 Office-31、Office-Home和MiniDomainNet三个领域自适应基准数据集上进行实验,结果表明,与现有的先进方法相比,所提模型在三个数据集上的图像分类精确度均有提升.
Domain adaptation faced the issue of complex and variable real-world scenarios,and existing methods mostly focused on optimizing classification consistency while neglecting classification certainty.To address these issues,a network model combining constrastive language-image pre-training(CLIP)with classification certainty maximization was proposed.CLIP,as a multimodal pre-trained model,was pre-trained on a large scale of image-text pairs and possessed strong cross-domain generalization capabili-ties.By leveraging prompt learning and contrastive learning,the knowledge of the CLIP model was ac-quired,enabling the model to adapt more complex real-world scenarios.Through the method of classifica-tion certainty maximization,a dual-classifier was employed to assess classification consistency and reduce confusion during the model's inference process.Experiments were conducted on three domain adaptation benchmark datasets:Office-31,Office-Home,and MiniDomainNet.The experimental results indicated that compared with existing advanced methods,the proposed model showed improvements in image classi-fication accuracy across all three datasets.
丁美荣;卓金鑫;刘庆龙;郎济聪
华南师范大学 人工智能学院 广东 佛山 528225华南师范大学 人工智能学院 广东 佛山 528225华南师范大学 人工智能学院 广东 佛山 528225华南师范大学 人工智能学院 广东 佛山 528225
信息技术与安全科学
迁移学习图像分类CLIP模型提示学习领域自适应分类确定性
transfer learningimage classificationCLIP modelprompt learningdomain adaptationclassification certainty
《郑州大学学报(理学版)》 2026 (2)
25-32,8
国家自然科学基金面上项目(62176162)广东省自然科学基金项目(2022A1515140099,2023A1515012875)
评论