首页|期刊导航|Health Care Science|A Survey on Medical Competence Evaluation Benchmarks for Large Language Models

A Survey on Medical Competence Evaluation Benchmarks for Large Language ModelsOA

中文摘要

Large language models(LLMs)show considerable potential to revolutionize healthcare through their performance across diverse clinical applications.Given the inherent constraints of LLMs and the critical nature of medical practice,a rigorous and systematic evaluation of their medical competence is imperative.This study presents a comprehensive review of the established methodologies and benchmarks for evaluating the medical competence of LLMs,encompassing a thorough analysis of current assessment practices across medical knowledge,clinical practice competence,and ethical-safety considerations.By integrating clinician competency assessment frameworks into LLMs evaluation,we propose a structured tri-dimensional framework that systematically organizes existing evaluation approaches according to medical theoretical knowledge,clinical practice ability,and ethical-safety considerations.Furthermore,this research provides critical insights into future developmental trajectories while establishing foundational frameworks and standardization protocols for the integration of LLMs into medical practice.

Qiting Wang;Huiru Zou;Haobin Zhang;Yongshun Huang;Junzhang Tian;Weibin Cheng

School of Public Health,Guangdong Pharmaceutical University,Guangzhou,ChinaInstitute for Healthcare Artificial Intelligence Application,The Affiliated Guangdong Second Provincial General Hospital of Jinan University,Guangzhou,ChinaInstitute for Healthcare Artificial Intelligence Application,The Affiliated Guangdong Second Provincial General Hospital of Jinan University,Guangzhou,ChinaKey Technologies Research Laboratory,Guangdong Province Hospital for Occupational Disease Prevention and Treatment,Guangzhou,ChinaInstitute for Healthcare Artificial Intelligence Application,The Affiliated Guangdong Second Provincial General Hospital of Jinan University,Guangzhou,ChinaInstitute for Healthcare Artificial Intelligence Application,The Affiliated Guangdong Second Provincial General Hospital of Jinan University,Guangzhou,China Faculty of Health Sciences,City University of Macao,Macao,China

医药卫生

benchmarklarge language modelmedical competence ABSTRACT

《Health Care Science》 2026 (1)

P.4-18,15

Guangzhou Science and Technology Program,Grant/Award Numbers:2025B03J0110,2024A03J1074,2024A03J0927。

10.1002/hcs2.70050

评论