首页|期刊导航|计算机工程与科学|一种融合语义图卷积与自注意力机制的三维人体姿态估计方法

一种融合语义图卷积与自注意力机制的三维人体姿态估计方法OA

A 3D human pose estimation method integrating semantic graph convolutional network and self-attention mechanism

中文摘要英文摘要

针对三维人体姿态估计不易捕捉人体关节序列的全局特征、估计精度不高的问题,提出了一种融合语义图卷积与自注意力机制的三维人体姿态估计方法.首先,为提升从二维人体姿态序列映射到三维人体姿态序列过程中的特征提取效果,在语义图卷积网络中融入自注意力机制,进行基于局部特征与全局特征相融合的空间特征提取;其次,对 MLP-Mixer网络的通道混合模块加以改进,引入了语义图卷积网络与 U型 MLP结构进行时序特征的提取;最后,基于二维人体图像的融合特征与提取的时序特征进行三维人体姿态估计.在三维人体姿态估计数据集 Human3.6M 上进行实验,将所提出的方法与当前主流的三维人体姿态估计方法进行对比,实验结果表明该方法在平均误差指标MPJPE和PA-MPJPE上相比次优方法分别下降约4.5 mm和0.2 mm,实验结果验证了所提出方法的有效性.

Aiming at the problem that it is difficult to capture the global characteristics of human joint sequences and the estimation accuracy is not high,a 3D human pose estimation method combining semantic graph convolutional network and self-attention mechanism is proposed.Firstly,in order to im-prove the feature extraction effect in the process of mapping from two-dimensional human pose sequence to three-dimensional human pose sequence,self-attention mechanism is integrated into semantic graph convolutional network to carry out spatial feature extraction based on the integration of local features and global features.Secondly,the channel-mixing module of the MLP-Mixer network is improved by in-troducing a semantic graph convolutional network and a U-shaped MLP structure for temporal feature extraction.Finally,3D human pose estimation is performed based on the fused features from 2D human images and the extracted temporal features.Experimental evaluations on the Human3.6M dataset for 3D human pose estimation demonstrate that,compared with current mainstream 3D human pose estima-tion methods,the proposed method reduces the average error metrics MPJPE and PA-MPJPE by ap-proximately 4.5 mm and 0.2 mm compared with the suboptimal method,respectively.The experimen-tal results validate the effectiveness of the proposed method.

童立靖;英溢卓;曹楠

北方工业大学人工智能与计算机学院,北京 100144北方工业大学人工智能与计算机学院,北京 100144北方工业大学人工智能与计算机学院,北京 100144

信息技术与安全科学

三维人体姿态估计语义图卷积MLP-Mixer模型自注意力机制

3D human pose estimationsemantic graph convolutional networkMLP-Mixer modelself-attention mechanism

《计算机工程与科学》 2026 (3)

521-530,10

北京市属高校青年拔尖人才培养计划(CIT&TCD201904009)

10.3969/j.issn.1007-130X.2026.03.014

评论