生成式人工智能在消瘦患者鉴别诊断中的辅助价值OA
Evaluating the performance of generative AI in assisting the differential diagnosis of weight loss
目的:基于真实世界病例报告,系统评估国产生成式人工智能模型DeepSeek-V3和Qwen3在消瘦患者鉴别诊断中的性能.方法:于2025年6月2日检索PubMed数据库中2012年1月1日至2025年6月2日发表在《美国病例报告杂志》(American Journal of Case Reports)标题或摘要中包含"weight loss"的所有病例报告.由两位具有高级职称的全科医生根据消瘦诊断标准进行筛选,排除不符合消瘦诊断标准、信息不完整或属于专科明确诊治范畴的病例,将最终纳入的病例整理为临床病历摘要.将这些临床病历摘要文本分别输入DeepSeek-V3和Qwen3系列模型(Qwen3-235B-A22B、Qwen3-32B和Qwen3-30B-A3B)的提示框,生成前十位鉴别诊断清单.模型均未针对该任务进行专门训练或强化.采用灵敏度、精确度和F1分数综合评价模型性能,组间比较采用McNemar检验和Cochran's Q检验.结果:最终分析了87份病例报告.DeepSeek-V3在首位诊断、前五位诊断及前十位诊断三个层级均展现出更高的灵敏度、精确度和F1分数,且两个模型在前五位诊断层级的性能差异有统计学意义(P=0.043).在Qwen3系列中,Qwen3-235B-A22B在首位诊断的灵敏度、精确度及F1分数上均表现最佳,但三个模型在各层级的诊断性能差异均无统计学意义(均P>0.05).结论:国产生成式人工智能模型在消瘦鉴别诊断中呈现广度优于精度的特点,DeepSeek-V3在关键诊断层级表现更优.尽管其首位诊断灵敏度和精确度有待提升,但作为临床决策支持工具可有效拓展全科医生的诊断思路.
Objective:To systematically evaluate the performance of generative artificial intelligence(GenAI)models,DeepSeek-V3 and the Qwen3 series,in the differential diagnosis of weight loss.Methods:A search was conducted in the PubMed database for all case reports published in the American Journal of Case Reports between January 1,2012 and June 2,2025,containing the term"weight loss"in the title or abstract.Two senior general practitioners independently reviewed each case to determine whether it met predefined diagnostic criteria for weight loss(emaciation).Cases that did not meet these criteria,had incomplete information,or involved clearly defined specialty-specific diagnoses and treatments were excluded.The remaining cases were then compiled into standardized clinical case summaries.These summaries were presented to DeepSeek-V3 and the Qwen3 series models(Qwen3-235B-A22B,Qwen3-30B-A3B,and Qwen3-32B)to generate ranked lists of the top 10 differential diagnoses.The models were not specifically fine-tuned for this task.Sensitivity,precision,and F1-score were used to evaluate performance.Intergroup comparisons were performed using McNemar's test and Cochran's Q test.Results:A total of 87 case were analyzed.DeepSeek-V3 demonstrated better performance than Qwen3-235B-A22B in sensitivity,precision,and F1-score,especially at the Top5 level(P=0.043).Among the Qwen3 series models,Qwen3-235B-A22B showed the best performance in sensitivity,precision,and F1-score for the Top1 diagnosis,but the differences among the three Qwen3 models across all diagnostic levels were not statistically significant(all P>0.05).Conclusions:Domestic GenAI models exhibit a characteristic of"breadth over precision"in the differential diagnosis of weight loss,with DeepSeek-V3 performing better at key diagnostic levels.Although the sensitivity and precision for the top-ranked diagnosis require improvement,these models have the potential to serve as effective clinical decision support tools,broadening the diagnostic perspectives of general practitioners.
刘颖;张云红;蔡东平;任菁菁
浙江大学医学院附属第一医院全科医学科,浙江 杭州 310003大理白族自治州人民医院全科医学科,云南 大理 671000苏州高新区狮山街道社区卫生服务中心,江苏 苏州 215011浙江大学医学院附属第一医院全科医学科,浙江 杭州 310003
医药卫生
体重减轻未分化疾病鉴别诊断人工智能语言模型
Weight lossMedically unspecified diseaseDifferential diagnosisArtificial intelligenceLanguage model
《浙江大学学报(医学版)》 2026 (1)
65-71,7
国家自然科学基金(72274169)浙江大学医学交叉前沿研究基金This study was supported by National Natural Science Foundation of China (72274169) and Medical Interdisciplinary Innovation Program of Zhejiang University School of Medicine
评论