基于少样本学习和思维链提示的知识概念抽取方法研究OA
Research on knowledge concept extraction method based on few-shot learning and chain-of-thought prompting
知识概念抽取在教育、医疗、金融领域均有重要的应用价值.知识概念抽取属于命名实体识别的一个细分任务,但是由于缺乏数据集和知识概念实体类型的特殊性,直接将通用命名实体识别方法运用到知识概念抽取任务中,往往效果不佳.鉴于上述挑战,利用开源大语言模型,提出了基于少样本学习和思维链提示的知识概念抽取方法.首先,通过对比学习训练关注了实体语义的文本表征,并采用K-近邻算法提升检索到的少样本示例的相关性.其次,采用思维链提示的方法展示样本,以提升大语言模型在知识概念抽取任务中的推理能力.在多个数据集上的实验结果表明,基于少样本学习和思维链提示的知识概念抽取方法总体上表现出了优于现有方法的效果.
Knowledge concept extraction has important application value in the fields of education,medical care,and finance.Knowledge concept extraction is a sub-task of named entity recognition.However,due to the lack of data sets and the particularity of knowledge concept entity types,directly applying general named entity recognition methods to knowledge concept extraction tasks often has poor results.In view of the above challenges,a method based on few-shot learning and chain-of-thought prompting for knowledge concept extraction was proposed,utilizing open-source large language models.Firstly,text representations focusing on entity semantics were trained through contrastive learning,and the relevance of the retrieved few-shot examples was enhanced using the K-nearest neighbors algorithm.Secondly,a method utilizing chain-of-thought prompting was adopted to present the samples,with the aim of improving the reasoning ability of large language models in knowledge concept extraction.Experimental results on multiple datasets demonstrate that the few-shot learning and chain-of-thought prompting for knowledge concept extraction method,on the whole,has shown results superior over existing methods.
佘霖琳;熊龙洋;陆雪松
华东师范大学数据科学与工程学院,上海 200062华东师范大学数据科学与工程学院,上海 200062华东师范大学数据科学与工程学院,上海 200062
信息技术与安全科学
知识概念抽取命名实体识别大语言模型
knowledge concept extractionnamed entity recognitionlarge language model
《大数据》 2026 (2)
97-110,14
国家自然科学基金项目(No.62277017) The National Natural Science Foundation of China(No.62277017)
评论