Transforming Healthcare with State-of-the-Art Medical-LLMs:A Comprehensive Evaluation of Current Advances Using Benchmarking FrameworkOA
The emergence of Medical Large Language Models has significantly transformed healthcare.Medical Large Language Models(Med-LLMs)serve as transformative tools that enhance clinical practice through applications in decision support,documentation,and diagnostics.This evaluation examines the performance of leading Med-LLMs,including GPT-4Med,Med-PaLM,MEDITRON,PubMedGPT,and MedAlpaca,across diverse medical datasets.It provides graphical comparisons of their effectiveness in distinct healthcare domains.The study introduces a domain-specific categorization system that aligns these models with optimal applications in clinical decision-making,documentation,drug discovery,research,patient interaction,and public health.The paper addresses deployment challenges of Medical-LLMs,emphasizing trustworthiness and explainability as essential requirements for healthcare AI.It presents current evaluation techniques that improve model transparency in high-stakes medical contexts and analyzes regulatory frameworks using benchmarking datasets such asMedQA,MedMCQA,PubMedQA,and MIMIC.By identifying ongoing challenges in biasmitigation,reliability,and ethical compliance,thiswork serves as a resource for selecting appropriate Med-LLMs and outlines future directions in the field.This analysis offers a roadmap for developing Med-LLMs that balance technological innovation with the trust and transparency required for clinical integration,a perspective often overlooked in existing literature.
Himadri Nath Saha;Dipanwita Chakraborty Bhattacharya;Sancharita Dutta;Arnab Bera;Srutorshi Basuray;Satyasaran Changdar;Saptarshi Banerjee;Jon Turdiev
Department of Computer Science,SNEC,University of Calcutta,Kolkata,700073,IndiaDepartment of Computer Science,PRTGC,West Bengal State University,Barasat,700126,IndiaDepartment of Computer Science&Engineering,The Neotia University,Kolkata,743368,IndiaDepartment of Computer Science&Engineering,The Neotia University,Kolkata,743368,IndiaDepartment of Computer Science&Engineering,University College of Science and Technology,University of Calcutta,Kolkata,700009,IndiaDepartment of Food Science,University of Copenhagen,Copenhagen,1165,DenmarkDepartment of Computer Science,Illinois Institute of Technology,10West 35th Street,Chicago,IL 60616,USADepartment of Computer Science,San Francisco State University,1600 Holloway Avenue,San Francisco,CA 94132,USA
医药卫生
Medical large language models(Med-LLM)AI in healthcarenatural language processing(NLP)in medicinefine-tuning medical LLMsretrieval-augmented generation(RAG)in medicinemulti-modal learning in healthcareexplainability and transparency in medical AIFDA regulations for AI in medicineevaluation and benchmarking of medical large language models
《Computers, Materials & Continua》 2026 (2)
P.234-289,56
评论