结合对抗训练的双通道特征融合命名实体识别OA
Dual-channel Feature Fusion Named Entity Recognition Based on Adversarial Training
针对现有命名实体识别模型缺乏对局部信息的关注,同时在处理长距离依赖关系和复杂序列数据时存在不足的问题,提出一种结合对抗训练的双通道特征融合的命名实体识别模型.首先,使用预训练模型提取特征,通过对抗训练增强模型的鲁棒性和泛化性.其次,在双向长短期记忆网络后引入多头注意力和时间步构成的双通道模块,在捕捉全局和局部信息的同时提升模型对长距离依赖和复杂序列数据的处理能力.最后,利用 GlobalPointer和旋转位置编码识别实体的头尾信息,在减少计算成本的同时进一步增强对全局信息的捕捉能力.实验结果表明,模型在五个公共数据集上的 F1 值相较于其他模型均有一定的提升,验证了其在获取全局和局部信息及处理复杂序列数据的能力.
Existing named entity recognition(NER)models often lack focus on local information and face challenges in handling long-range dependencies and complex sequence data.To address these is-sues,a dual-channel feature fusion NER model incorporating adversarial training was proposed.First,features were extracted using a pretrained model,with adversarial training enhancing robustness and gen-eralization.Then,a dual-channel module,comprising multi-head attention and time steps,was intro-duced after a bidirectional long short-term memory network to capture both global and local information,improving the model's ability to manage long-range dependencies and complex sequences.Finally,GlobalPointer and rotary position encoding were employed to identify the head and tail information of enti-ties,reducing computational costs while further enhancing the model's ability to capture global informa-tion.Experimental results showed that the proposed model achieved improvements in F1 scores across five public datasets,validating its effectiveness in capturing both global and local information and han-dling complex sequence data.
李卫军;丁建平;刘雪洋;王子怡;刘世侠;苏易礌
北方民族大学 计算机科学与工程学院 宁夏 银川 750021||北方民族大学 图像图形智能处理国家民委重点实验室 宁夏 银川 750021北方民族大学 计算机科学与工程学院 宁夏 银川 750021北方民族大学 计算机科学与工程学院 宁夏 银川 750021北方民族大学 计算机科学与工程学院 宁夏 银川 750021北方民族大学 计算机科学与工程学院 宁夏 银川 750021北方民族大学 计算机科学与工程学院 宁夏 银川 750021
信息技术与安全科学
对抗训练多头注意力双通道特征融合旋转位置编码命名实体识别
adversarial trainingmulti-head attentiondual-channel feature fusionrotary position embeddingnamed entity recognition
《郑州大学学报(理学版)》 2026 (4)
44-51,8
宁夏高等学校科学研究项目(NYG2024086)中央高校基本科研业务费(2022PT_S04)国家自然科学基金项目(62066038,61962001)
评论