融合对抗训练与胶囊网络的羊疾病命名实体自动标注方法OA
An automatic annotation method for sheep disease named entities integrating adversarial training and capsule networks
羊疾病防治是养羊业健康发展的关键,但基层诊疗能力薄弱、过度依赖专家经验,常导致防控滞后.基于深度学习的大模型辅助诊疗提供了创新解决方案,而羊疾病文本是该领域知识应用的核心载体,命名实体识别则是实现文本自动标注的关键环节.然而,羊疾病语料存在实体数量分布不均、语义关系复杂以及实体边界难以判定等问题.为解决以上问题,本文分析了羊疾病语料特点,制定了标注规则,构建了包含9个类别、共计9 635个实体的羊疾病语料库,以支撑命名实体识别任务的开展.在此基础上,提出了 1种融合对抗训练与胶囊网络的羊疾病命名实体识别模型 SD-ATCN(A named entity recognition model for sheep diseases texts integrating adversarial training and capsule networks).首先,使用 RoBERTa 模型提取上下文嵌入信息,并结合对抗训练生成的对抗样本,将两者集成为文本嵌入层的输出,以提升模型在处理噪声数据及应对不均衡标注场景下的稳定性.随后,在BiLSTM提取的全局特征中融入胶囊网络,以增强模型对复杂实体关系的理解能力.最后,利用CRF解码输出实体标签,实现实体的自动识别.此外,训练过程中使用差分学习率,灵活调整不同层的学习速率,以加快模型收敛速度并提升性能.结果表明,该模型的准确率、召回率和F1值分别达到93.28%、95.57%和 94.40%,相比基线模型 RoBERTa-BiLSTM-CRF 分别提升了 2.13%、1.20%和 1.69%.基于SD-ATCN模型开发了羊疾病自动标注系统,显著提升了标注效率,为羊疾病文本信息的自动化处理以及智能化诊疗提供了技术支持.
Disease prevention and control are crucial for the healthy development of the sheep industry.However,weak capabilities of the primary diagnosis and over-reliance on expert experience often lead to delay in disease management.Deep learning-based large models offer an innovative solution for assisted diagnosis,for which sheep disease texts serve as core carriers of knowledge in this field.Named Entity Recognition(NER)is a key step towards automatic text annotation.Nevertheless,sheep disease corpora faces challenges such as imbalanced entity distribution,complex semantic relationships,and ambiguous entity boundaries.To address these issues,this study analyzed the characteristics of sheep disease texts,established annotation rules,and constructed a corpus containing 9 categories and 9,635 entities to support NER tasks,proposing a named entity recognition model for sheep disease texts—SD-ATCN(A Named Entity Recognition Model for Sheep Diseases Texts Integrating Adversarial Training and Capsule Networks).First,the RoBERTa model was used to extract contextual embeddings,which were integrated with adversarial samples generated through adversarial training to form the output of the text embedding layer.This enhanced the model's stability in handling noisy data and imbalanced annotation scenarios.Then,capsule networks were incorporated into the global features extracted by BiLSTM to improve the model's ability to capture complex entity relationships.Finally,a CRF layer decoded the entity labels to achieve automatic entity recognition.Additionally,differential learning rates were applied during training to flexibly adjust learning rates across different layers,accelerating convergence and improving performance.Experimental results showed that the model respectively achieved precision,recall,and F,scores as 93.28%,95.57%,and 94.40%,outperforming the baseline RoBERTa-BiLSTM-CRF model by 2.13%,1.20%,and 1.69%.Based on the SD-ATCN model,an automatic annotation system for sheep disease texts was developed,significantly improving annotation efficiency and providing technical support for automated text processing and intelligent diagnosis in sheep disease management.
张泽嘉;孙小华;王超;王斌;袁万哲;王福顺
河北农业大学信息科学与技术学院,河北保定 071001河北软件职业技术学院数字传媒系,河北保定 071000河北农业大学信息科学与技术学院,河北保定 071001||河北省农业大数据重点实验室,河北保定 071000河北农业大学信息科学与技术学院,河北保定 071001||河北省农业大数据重点实验室,河北保定 071000河北农业大学动物医学院/中兽医学院,河北保定 071000河北农业大学信息科学与技术学院,河北保定 071001||河北省农业大数据重点实验室,河北保定 071000
信息技术与安全科学
羊疾病命名实体识别RoBERTa对抗训练胶囊网络差分学习率自动标注
sheep diseasesnamed entity recognitionRoBERTaadversarial trainingcapsule networksdifferential learning ratesautomatic annotation
《河北农业大学学报》 2026 (2)
95-107,13
河北省重点研发计划项目(22327403D)河北省现代农业产业技术体系羊产业创新团队专项资金项目(HBCT2024250204).
评论