大模型的药物不良反应实体识别能力评估OA
Evaluation of Large Language Models for Adverse Drug Reaction Entity Recognition
本研究针对药物不良反应领域的命名实体识别任务,构建了用于药物警戒领域的中文命名实体识别数据集(Chinese Named Entity Recognition Pharmacovigilance Dataset,CNER-PH),并在此基础上对主流命名实体识别(Named Entity Recognition,NER)模型与大语言模型进行了系统评估.方法上,采用多种预训练模型基于Trans-former的双向编码器表示(Bidirectional Encoder Representations from Transformers,BERT)、鲁棒优化的BERT预训练方法(Robustly Optimized BERT Pretraining Approach,RoBERTa)与大语言模型(GPT-4o、DeepSeek等),重点分析其在实体类别多样化及边界模糊场景下的识别能力差异.实验结果表明,BERT系列模型在应对复杂实体边界时表现更为稳健,F1值整体高于大语言模型.研究结果揭示了不同模型在药物不良反应识别中的特点与不足,为后续方法改进提供了依据.
This study focused on the named entity recognition task in the field of adverse drug reactions and constructed a Chinese dataset named Chinese named entity recognition pharmacovigilance dataset(CNER-PH).Based on this dataset,mainstream named entity recognition(NER)models and large language models were systematically evaluated.The methods used included several pre-trained models such as bidirectional encoder representations from transformers(BERT)series and robustly optimized BERT pretrain-ing approach(RoBERTa),as well as large language models such as GPT-4o and DeepSeek.The analysis emphasized their recogni-tion ability under conditions of diverse entity types and unclear entity boundaries.The experimental results show that BERT series models are more stable in handling complex entity boundaries,and their overall F1 scores are higher than those of large language models.The findings reveal the strengths and weaknesses of different models in adverse drug reaction recognition and provide a ba-sis for future methodological improvements.
王子天;徐康;董振江
南京邮电大学 计算机学院,软件学院,网络空间安全学院,江苏 南京 210023南京邮电大学 计算机学院,软件学院,网络空间安全学院,江苏 南京 210023南京邮电大学 计算机学院,软件学院,网络空间安全学院,江苏 南京 210023
信息技术与安全科学
大语言模型药物警戒命名实体识别数据集构建
large language modelspharmacovigilancenamed entity recognitiondataset construction
《山西大学学报(自然科学版)》 2026 (4)
547-556,10
国家自然科学基金(622022406187219062276142)江苏省社会发展项目(BE2023025)国家社会科学基金重点项目(23ATQ009)江苏省社会科学基金(23TQB007)江苏省高校哲学社会科学研究重大项目(2020SJZDA102)
评论