基于大语言模型的材料科学信息抽取OA
Information Extraction in Materials Science Based on Large Language Model
科学文献因具备特有的专业术语和复杂的语义关系,使得直接利用已有的大语言模型(LLM)从中提取专业领域知识充满挑战.针对LLM在材料科学领域知识抽取性能不足的问题,提出一种通过领域对齐微调提升抽取效果的方法,并展示了如何利用微调后的LLM提取材料文献中的关键信息.首先,通过具备较强语言能力的LLM结合提示工程,辅助人工标注材料领域的数据集.其次,在具有7B参数的LLM上采用QLoRA技术进行指令微调,使模型在微调后能够根据指令从材料科学文献中准确提取信息.微调后的LLM在多个任务上表现优异:材料实体识别的F1值达到0.94,材料类型识别的准确率达到0.91,材料属性数值抽取的准确率达到0.89.实验结果表明,该方法在处理材料科学文献中的复杂术语和语义关系方面表现出色,并展现出较强的泛化能力,为材料科学领域的知识抽取提供了一种新的解决思路.
The distinctive terminology and intricate semantic relationships inherent to scientific literature continue to present a significant ob-stacle to directly utilizing existing LLM for the extraction of specialized domain knowledge.This study aims to address the limitations in the knowledge extraction capabilities of LLM within the field of materials science.We put forth a methodology to augment their efficacy through do-main-specific fine-tuning and illustrate the deployment of the fine-tuned LLM for the extraction of pivotal information from materials science literature.The preliminary stage of the methodology utilises LLM with robust linguistic capabilities and prompt engineering to facilitate the manual annotation of the materials domain dataset.Subsequently,fine-tuning of QLoRA is performed on LLM with parameter 7B,thereby en-abling the fine-tuned LLM to accurately extract information from materials science literature in accordance with the instructions.The fine-tuned LLM demonstrated exceptional performance in material entity recognition,achieving an F1 score of 0.94.It also showed high accuracy in material type recognition and material property value extraction,with scores of 0.91 and 0.89,respectively.The experimental results demon-strate that the method is effective in addressing complex terminology and semantic relationships in materials science literature,exhibiting ro-bust generalization capabilitiesand offers a novel approach to knowledge extraction in the field of materials science.
时宗彬;乐小虬
中国科学院 文献情报中心||中国科学院大学 经济与管理学院,北京 100190中国科学院 文献情报中心||中国科学院大学 经济与管理学院,北京 100190
信息技术与安全科学
大语言模型提示工程QLoRA指令微调信息抽取
large language modelsprompt engineeringQLoRAinstruction fine-tuninginformation extraction
《软件导刊》 2026 (1)
1-9,9
国家社会科学基金项目(23BTQ102)
评论