基于生成式人工智能的师范生批判性数字素养测评OA

As an important component of digital literacy,critical digital literacy has garnered significant attention in recent years.To examine the accuracy and reliability of generative artificial intelligence(GenAI)in assessing critical digital literacy,this study employs GenAI to evaluate the critical digital literacy demonstrated by 66 pre-service teachers across three information modalities:text,images,and videos,according to the critical digital literacy assessment standards,and compares the evaluation results with those by digital literacy experts.The results show that GenAI achieves low accuracy and high stability in critical digital literacy evaluation,but its assessment accuracy improves as the complexity of information modalities increases.This findings indicate that the capacity of GenAI to evaluate critical digital literacy needs further enhancement.Future teachers should interpret evaluation results cautiously when utilizing GenAI for evaluations.This paper provides practical references for defining the applicable boundaries of GenAI in literacy assessment involving complex multimodal information.