首页|期刊导航|远程教育杂志|虚拟数字讲师的手势类型与呈现频率如何影响学习?

虚拟数字讲师的手势类型与呈现频率如何影响学习?OA

How Do Gesture Types and Presentation Frequency of Virtual Digital Instructors Affect Learning?

中文摘要英文摘要

数智学习环境中虚拟数字讲师的手势作为重要的社会线索,其类型和频率对学习者的认知过程、情感体验乃至学习效果都具有重要影响.基于此,本研究借助眼动追踪、皮肤电测量、学习体验量表和学习效果测试相结合的多模态技术,系统分析了虚拟数字讲师的手势类型(包括节拍性、指示性)与频率(包括平均、增强)对学习的影响及其内在作用机制.结果表明:在学习体验与效果层面,指示性手势能够有效提升情绪唤醒度、社会存在感和迁移测试成绩;平均手势有利于提升情绪支配度,增强手势则更有利于提升社会存在感与整体学习成效;"节拍性—增强"手势最能提升学习动机与保持测试成绩.在内在机制层面,增强手势,特别是"指示性—增强"手势有利于降低认知焦虑;指示性与增强手势均能促进学习者在学习内容区域的视觉认知加工资源投入;动机、社会存在感、保持测试及迁移测试成绩与学习内容区域总注视时间呈正相关,与讲师区域总注视时间呈负相关;社会存在感、保持测试成绩与皮肤电导水平呈负相关.根据上述结果,本研究提出四条优化策略,以期为虚拟数字讲师以及有形智能体的设计、生成与应用提供参考与建议.

In digital-intelligent learning environments,the gestures of virtual digital instructors serve as important social cues that exert significant impacts on learners' cognitive processes,emotional experiences and even learning outcomes.Accordingly,this study adopted a multimodal approach integrating eye tracking,electrodermal activity(EDA)measurement,learning experience scales,and learning outcome tests to systematically examine the effects of gesture type(beat gestures vs.deictic gestures)and presentation fre-quency(average presentation vs.enhanced presentation),as well as the underlying mechanisms.The results indicate that in terms of learning experience and outcomes,deictic gestures significantly enhanced emotional arousal,social presence,and transfer test perfor-mance.Average presentation was associated with higher levels of emotional dominance,whereas enhanced presentation was more effec-tive in improving social presence and overall learning outcomes.Among gesture combinations,beat-enhanced gestures most effectively promoted learning motivation and retention test performance.Regarding the underlying mechanisms,enhanced presentation,particular-ly deictic-enhanced gestures,helped reduce cognitive anxiety.In addition,deictic gestures and enhanced presentation promoted greater allocation of visual cognitive processing resources to the learning content area.Learning motivation,social presence,retention test per-formance and transfer test performance were positively correlated with total fixation duration on the learning content area and negatively correlated with total fixation duration on the instructor area.Furthermore,social presence and retention test performance were negative-ly correlated with electrodermal activity levels.Based on these findings,this study puts forward four optimization strategies to provide practical guidance for the design,generation,and application of virtual digital instructors and embodied intelligent agents.

王雪;邢晓宁;吴向文

天津师范大学教育学部(天津300387)||天津师范大学学科交叉中心(天津300387)天津师范大学教育学部(天津300387)宁夏师范大学人工智能与基础教育宁夏重点实验室(宁夏固原756099)

社会科学

虚拟数字讲师手势类型手势频率眼动追踪皮肤电活动

Virtual digital instructorsGesture typeGesture frequencyEye trackingElectrodermal activity(EDA)

《远程教育杂志》 2026 (5)

70-78,9

2025年度国家自然科学基金专项项目"教学代理情绪设计促进在线学习成效的机制及其智能调节方法"(项目编号:62541702)、2025年教育部人文社会科学规划一般项目"生成式教学资源画面情感对学习的影响机制及其智能进化研究"(项目编号:25YJA880070)和2022年教育部人文社会科学研究规划基金项目"学科核心素养视域下高中阶段'品格教育'的实践与提升策略研究"(项目编号:22YJA880092).

10.15881/j.cnki.cn33-1304/g4.2026.05.008

评论