结合对比学习和多任务学习的大语言模型分类技术在标准检索系统中的应用OA
Application of Large Language Model Classification Technology Combining Contrastive Learning and Multi-task Learning in Standard Retrieval System
[目的]基于关键词的标准全文检索系统在处理用户查询时,需要从全量数据中进行检索,会导致检索系统性的召回率降低.[方法]为了解决此类问题,本文提出了一种结合对比学习与多任务学习的分类算法,将用户查询映射到中国标准分类号(CCS)分类体系,从而减小检索范围.利用层次感知的对比学习策略和知识注入的多任务框架提升该方法对CCS分类体系的细粒度类别的分类能力.[结果]该方法在用户查询分类场景的测试指标Micro-F1为89.23%;在应用线上标准检索场景后,Recall@5和MRR分别提升10.3%和9.5%.[结论]通过本文的多种实验,证明了该方法在提升基于全文检索的标准检索系统的有效性.
[Objective]When processing user queries,a standard keyword-based full-text retrieval system needs to perform retrieval over the full dataset.[Methods]To address this problem,this paper proposes a classification approach that combines contrastive learning and multi-task learning to map user queries into the Chinese Classification for Standards(CCS)taxonomy,thereby reducing the retrieval scope.A hierarchy-aware contrastive learning strategy and a knowledge-injected multi-task learning framework are further introduced to enhance the proposed method's ability to classify fine-grained categories within the CCS taxonomy.[Results]The proposed method achieves a Micro-F1 of 89.23%on the user query classification task;after being deployed in an online standard retrieval setting,Recall@5 and MRR increase by 10.3%and 9.5%,respectively.[Conclusion]Extensive experiments demonstrate that the proposed method effectively improves standard full-text retrieval systems.
张勇;王益谊;于钢;李娟;张阳
中国标准化研究院中国标准化研究院中国标准化研究院中国标准化研究院中国标准化研究院
分类对比学习多任务学习CCS
classificationcontrastive learningmulti-task learningCCS
《标准化学报》 2026 (8)
63-71,9
本文受中国标准化研究院基本科研业务费项目"面向大模型的结构化XML标准文档可读可理解工具研发"(项目编号:252025Y-12532)资助.
评论