首页|期刊导航|山东理工大学学报(自然科学版)|基于手指追踪、肢体及面部动捕技术的三维手语建模研究

基于手指追踪、肢体及面部动捕技术的三维手语建模研究OA

Research on 3D sign language modeling based on finger tracking,limb and facial motion capture technology

中文摘要英文摘要

手语是听障人群日常生活沟通最主要的方式,然而复杂多样的手语动作提高了手语的学习成本.本文提出一种结合手指追踪、肢体及面部动捕的三维手语建模方法,利用专用动捕设备,精确捕捉手指、肢体及面部动作的细节和动态变化,并在Unity平台中将三部分动作整合后绑定数字人体模型,实现了三维手语建模.该方法弥补了传统方法只能捕捉单一手势的缺点,在增加肢体及面部动作后,三维手语更加接近真实手语,可为手语的数字化表达和听障人群沟通辅助工具开发提供有力支持.

Sign language is the most important means of communication for individuals with hearing im-pairments in daily life,but the complexity and diversity of sign language movements increase the learning cost.In this paper,we proposed a 3D sign language modeling method that integrates finger tracking,limb and facial motion capture.Using dedicated motion capture equipment,we can accurately capture the details and dynamic changes of fingers,limbs and facial movements.These captured motions are integrat-ed in the Unity platform and bound to a digital human model to achieve 3D sign language modeling.This method overcomes the limitation of traditional methods that could only capture single gestures.By incor-porating limb and facial movements,the 3D sign language becomes closer to real sign language,providing strong support for the digital expression of sign language and the development of communication aids for the hearing-impaired.

秦永;涂佳利;黄为荣

山东理工大学 建筑工程与空间信息学院,山东 淄博 255049山东理工大学 建筑工程与空间信息学院,山东 淄博 255049山东理工大学 建筑工程与空间信息学院,山东 淄博 255049

信息技术与安全科学

手指追踪手势识别肢体捕捉面部动捕AI手语

finger trackinggesture recognitionlimb motion capturefacial motion captureAI-based sign language

《山东理工大学学报(自然科学版)》 2026 (1)

21-25,32,6

淄博市校城融合发展计划项目(2021JSCG0019)

评论