首页|期刊导航|陕西师范大学学报(自然科学版)|融合双注意力机制与空间重建卷积的人体动作识别方法

融合双注意力机制与空间重建卷积的人体动作识别方法OA

A human action recognition method based on dual attention mechanism and spatial reconstruction convolution

中文摘要英文摘要

基于骨架的人体动作识别是计算机视觉领域的重要研究方向,在智能监控、人机交互等领域具有广泛应用.然而,现有多数方法不能在复杂场景下充分捕捉关键关节点和人体运动模式特征,并且在提取关节点特征时,可能会生成大量冗余特征.因此,提出了融合双注意力机制与空间重建卷积的人体动作识别方法,首先利用图卷积结构对骨架数据中同一帧的关节点和骨骼信息进行建模,捕捉关节点之间的空间关系,随后对特征图进行通道和空间注意力加权,使模型能够自适应地关注关键关节点和人体运动模式,增强特征表达能力;在此基础上,进一步将同一帧的关节整体建模,通过空间与通道重建卷积挖掘帧间的依赖关系,提升模型的时序建模能力.实验结果显示,提出的模型有效提升了基线模型语义引导网络(semantic-guided network,SGN)的特征提取能力和计算效率,在人体行为识别任务中取得了更高精度,特别是在复杂场景和长距离依赖关系的处理上表现尤为突出;在 NTU RGB+D 验证集上相较于其他方法具有显著优势,跨主题的准确度达到了 89.2%,跨视角的准确度达到了 95.8%,验证了模型的有效性和优越性.

Skeleton based human action recognition is an important research direction in the field of computer vision and has wide applications in intelligent monitoring,human-computer interaction,and other fields.However,most existing methods fail to adequately capture key joint information and human motion patterns in complex scenarios,and they often generate a large number of redundant features during joint feature extraction.To address these issues,a human action recognition method that integrates a dual-attention mechanism with spatial reconstruction convolution is proposed.First,a graph convolutional structure is employed to model joint and bone information within the same frame of the skeleton data,thereby capturing the spatial relationships among joints.Subsequently,channel and spatial attention weighting is applied to the feature maps,enabling the model to adaptively focus on critical joints and motion patterns and enhancing the expressiveness of the extracted features.On this basis,the model further performs holistic joint modeling within each frame and leverages spatial and channel reconstruction convolutions to explore inter-frame dependencies,thus improving its temporal modeling capability.Experimental results show that the proposed model significantly enhances the feature extraction ability and computational efficiency of the Baseline SGN(semantic-guided network).It achieves higher accuracy in human action recognition tasks,with particularly notable improvements in complex scenarios and in handling long-range dependencies.On the NTU RGB+D validation set,the model demonstrates clear advantages over prior approaches,achieving 89.2%accuracy under the cross-subject setting and 95.8%under the cross-view setting,thereby validating its effectiveness and superiority.

解志鹏;李成龙;邢胜南;王共杰

山东建筑大学 计算机科学与技术学院,山东 济南 250000山东建筑大学 计算机科学与技术学院,山东 济南 250000山东华云三维科技有限公司,山东 济南 250000山东建筑大学 计算机科学与技术学院,山东 济南 250000

信息技术与安全科学

骨架人体动作识别关节点图卷积特征提取

skeletonhuman action recognitionjoint pointsgraph convolutionfeature extraction

《陕西师范大学学报(自然科学版)》 2026 (5)

81-93,13

国家自然科学基金(62102235)山东省自然科学基金(ZR2020QF029)

10.15983/j.cnki.jsnu.2026508

评论