首页|期刊导航|现代电影技术|基于分层协作的虚拟现实(VR)影像多模态交互体系构建与应用研究

基于分层协作的虚拟现实(VR)影像多模态交互体系构建与应用研究OA

Construction and application research of a hierarchically collaborative multi-modal interaction framework for virtual reality(VR)cinematic experiences

中文摘要英文摘要

虚拟现实(VR)影像是一种沉浸式多媒体环境,VR影像多模态的关键不在于感官数量,而在于模态间如何围绕创作内容和用户形成分层协作.为探讨VR影像中多模态交互的分层协作机制,本文从功能驱动的角度,通过对最新多模态技术及代表性VR影像案例的分析,提出了基于分层协作的VR影像多模态交互体系:以视觉与听觉为核心的传统多模态;融入触觉等身体感知的具身多模态;基于呼吸、眼动等反馈的生理驱动多模态;基于人工智能(AI)技术的智能自适应多模态.研究表明,VR影像的交互逻辑已从基础感官刺激叠加转向跨模态协同建构,四个层级呈现出由外部信息整合转向内在状态感知与智能调控的发展趋势.

Virtual reality(VR)cinematic experiences are immersive multimedia environments in which multimodality de-pends not merely on the number of sensory channels involved,but on the hierarchical collaboration among different modali-ties in relation to creative content and user experience.From a function-driven perspective,this study explores the layered collaborative mechanisms of multimodal interaction in virtual reality cinematic experiences through an analysis of latest mul-timodal technologies and representative VR cases.Based on these analyses,the study proposes a hierarchically collabora-tive multimodal interaction framework consisting of four levels:traditional multimodality centered on visual and auditory per-ception;embodied multimodality integrating haptic and other bodily perception;physiologically driven multimodality based on biofeedback signals such as respiration and eye tracking;and intelligent adaptive multimodality enabled by artificial intel-ligence(AI).The findings suggest that the interaction logic of virtual reality cinematic experiences has evolved from the ba-sic accumulation of sensory stimuli toward cross-modal collaborative construction.Together,these four levels reveal a de-velopmental tendency from external information integration to internal-state perception and intelligent regulation.

丁妮;赵恬

北京师范大学艺术与传媒学院,北京 100875北京师范大学艺术与传媒学院,北京 100875

社会科学

虚拟现实(VR)影像多模态交互具身认知智能自适应

Virtual Reality(VR)Cinematic ExperiencesMultimodal InteractionEmbodied CognitionIntelligent Adaption

《现代电影技术》 2026 (5)

42-49,8

国家社科基金艺术学重大项目"网络视听壮大主流价值与文化强国建设"(25ZD07)国家社科基金艺术学一般项目"VR电影的多模态用户体验评估系统构建与应用"(25BC049).

10.3969/j.issn.1673-3215.2026.05.006

评论