基于多维指令集微调的大语言模型金融事件抽取OA
Multi-dimensional Instruction Set Tuning for Financial Event Extraction with Large Language Models
事件抽取是自然语言处理中的关键任务,旨在从非结构化或半结构化文本中自动识别事件触发词、类型、论元及论元角色,并转化为结构化表示.针对传统深度学习模型抽取金融事件时存在数据标注成本高、长文本处理效率低与复杂事件解析能力弱等问题,提出一种基于多维指令集微调的大语言模型事件抽取模型(MIFEE).MIFEE设计了涵盖金融事件抽取各类需求的多维指令库;提出指令重要性驱动叠加策略,先量化各指令维度独立贡献,再按重要性逐项叠加,避免指令冗余的同时最大化发挥各维度指令的互补效应,以此构建多维指令集;基于多维指令集微调大语言模型(LLM),从而提升金融事件抽取性能.实验结果表明,MIFEE在金融领域事件抽取通用数据集ChFinAnn和DuEE-Fin上均优于对比的基线方法,最优F1值分别达到90.7%和77.3%,验证了MIFEE的优异性;在长文本与复杂事件场景下的性能验证实验中,MIFEE在F1值和推理速度方面均优于少样本上下文学习方法(Few-shot ICL),验证了其在处理复杂语义结构与长依赖方面具备较优的解析效率与准确性;此外,消融实验进一步验证了指令重要性驱动叠加策略的有效性.
Event extraction is a key task in natural language processing that aims to automatically identify event triggers,event types,arguments,and argument roles from unstructured or semi-structured text and convert them into structured representations.To address the challenges faced by traditional deep learning models in extracting financial events,such as high annotation costs,low efficiency in handling long documents,and limited capability for parsing complex events,this paper proposes a large language model event extraction method based on multi-dimensional instruction set fine-tuning(MIFEE).MIFEE begins by designing a multi-dimensional instruction library that addresses various requirements of financial event extraction.It then proposes an instruction importance-driven stacking strategy,which first quantifies the independent contribution of each instruction dimension,and then stacks them in order of importance.This approach maximizes the complementary effects across dimensions while avoiding instruction redundancy,thereby constructing a multi-dimensional instruction set.Finally,the model fine-tunes a large language model based on this multi-dimensional instruction set to enhance financial event extraction performance.Experimental results show that MIFEE outperforms the compared baseline methods on the general financial event extraction datasets ChFinAnn and DuEE-Fin,achieving optimal F1 scores of 90.7%and 77.3%,respectively,demonstrating the superiority of MIFEE.In performance validation experiments conducted under long-text and complex event scenarios,MIFEE surpasses few-shot in-context learning(Few-shot ICL)methods in both F1 score and inference speed,confirming its strong capability in parsing efficiency and accuracy when handling complex semantic structures and long-range dependencies.Additionally,ablation experiments further validate the effectiveness of the instruction importance-driven stacking strategy.
杨维;才智杰
青海师范大学 计算机学院,西宁 810016||省部共建藏语智能信息处理及应用国家重点实验室,西宁 810008青海师范大学 计算机学院,西宁 810016||省部共建藏语智能信息处理及应用国家重点实验室,西宁 810008
信息技术与安全科学
自然语言处理金融事件抽取多维指令集大语言模型
natural language processingfinancial event extractionmulti-dimensional instruction setlarge language models
《计算机科学与探索》 2026 (8)
2276-2287,12
国家自然科学基金(61966031,61866032)青海省藏文信息处理与机器翻译重点实验室项目(2020-ZJ-Y05)藏文信息处理教育部重点实验室项目(2013-Z-Y17,2014-Z-Y32,2015-Z-Y03). This work was supported by the National Natural Science Foundation of China(61966031,61866032),the Program of Tibetan Informa-tion Processing and Machine Translation Key Laboratory of Qinghai Province(2020-ZJ-Y05),and the Program of Key Laboratory of Tibetan Information Processing,Ministry of Education(2013-Z-Y17,2014-Z-Y32,2015-Z-Y03).
评论