儿科医师/研究生输血医学知识认知现状与大语言模型辅助学习的可靠性研究OA

Objective To investigate the current knowledge status of transfusion medicine among pediatricians/post-graduates and the reliability of large language models(LLMs)for assisted learning,and to assess changes in pediatricians'transfusion medicine knowledge before and after the implementation of the"Pediatric Transfusion Guideline"(hereafter re-ferred to as the"Guideline").Methods In January 2022(prior to the implementation of the"Guideline"),a question-naire was developed based on the"Guideline"content and distributed to pediatricians.Subsequently,in July 2025(after the implementation of the"Guideline"),the"Pediatric Transfusion Medicine Knowledge Questionnaire"was designed based on the content of the January 2022 questionnaire.This questionnaire survey was conducted on pediatricians/postgrad-uates and LLMs.We analyzed the level of transfusion medicine knowledge among pediatricians/postgraduates and the relia-bility of LLMs for assisted learning,and compared the accuracy of pediatricians'responses before and after"Guideline"im-plementation.Results The survey results after the implementation of the"Guidelines"revealed that pediatricians/post-graduates achieved response accuracy rates exceeding 80%on the topic of"Patient Blood Management".However,re-sponse accuracy rates were below 30%for topics including"Types and Indications of Blood Components/Products"and"E-valuation of Transfusion Efficacy".The pediatricians'accuracy rates for related questions before and after the implementa-tion of the"Guidelines"were 14.7%-68.9%and 3%-38%,respectively,and the comparison of accuracy rates for each question showed significant differences(P<0.001).The accuracy rates of the LLMs on the questionnaire were all below 90%.Among them,Doubao(81.1%)and Kimi(86.4%)achieved relatively higher accuracy rates,while Tencent Yuan-bao(Hunyuan)had the lowest accuracy rate at only 59.5%.Conclusion The implementation of the"Guideline"may have improved pediatricians'knowledge level of pediatric transfusion medicine.However,their knowledge level of pediatric transfusion remains low,and LLMs cannot yet provide absolutely reliable guidance.Systematic training in pediatric transfu-sion medicine is urgently needed.