语音驱动的三维高斯人脸运动生成方法OA

With the development of digital human technology,synthesizing realistic facial motions that align with audio has become a significant research focus.Existing image-based facial motion synthesis methods are often limited to specific camera angles and struggle with accurately expressing facial details.The core issue lies in the lack of effec-tive 3D representation.To address this problem,this paper proposes an audio-driven 3D facial motion generation method via Gaussian splatting.The method first combines 3D Gaussian splatting with a parametric facial model to perform 3D modeling of dynamic facial data,establishing a relationship between the Gaussian representation and the mesh model.For motion generation,audio-driven movements are mapped to the vertex displacements on the facial model,and dynamic facial Gaussian deformation is achieved through mesh deformation.Compared to existing meth-ods,the proposed Gaussian-based facial motion generation method demonstrates superior 3D consistency and image quality,along with significantly improved generation and rendering efficiency.