基于频率感知混合Transformer的加注动作识别方法研究OA
Research on refueling action recognition method based on frequency-aware hybrid Transformer model
近年来,Transformer 模型在骨架序列的长期依赖建模方面表现出了显著优势,尤其在骨架动作识别领域得到了广泛应用.然而,现有基于 Transformer 的方法通常依赖简单的注意力机制来捕捉时空特征,这在学习具有相似运动模式的判别性表示方面存在不足,因此本研究引入了频率感知混合 Transformer 模型进行骨架动作识别.该模型专门设计用于识别具有细微判别性运动的相似骨架动作,结合频域建模与时空注意力机制,通过融合高频分支模块和低频分支模块实现多尺度特征交互,增强对相似动作的辨识能力.在自建的包含7 类标准操作的骨架动作数据集上,将本文模型与5 种主流骨架动作识别模型进行了对比实验.结果表明,基于频率感知混合 Transformer 模型的识别准确率为 97.62%,优于其他骨架动作识别模型.
In recent years,Transformer models have demonstrated significant advantages in modeling long-term dependencies within skeleton sequences,especially in the domain of skeleton action recogni-tion.However,current Transformer-based methods typically rely on simplistic attention mechanisms to capture spatial-temporal features,which limits their ability to learn discriminative representations for ac-tions with similar motion patterns.To address these challenges,this study introduces a frequency-aware mixed Transformer model for skeleton action recognition.This model is specifically designed to recognize similar skeleton actions with subtle discriminative movements by combining frequency-domain modeling with spatial-temporal attention mechanisms.By integrating high-frequency and low-frequency branch modules,the model enables multi-scale feature interaction,thereby enhancing its ability to distinguish similar actions.Comparative experiments between the proposed model and five mainstream models were conducted on a self-built skeleton action dataset containing seven types of standard operations.The results show that the frequency-aware mixed Transformer model achieves a recognition accuracy of 97.62%,out-performing other skeleton action recognition models.
吴夏;章平;王淼;鲁鹏飞;时雪峰;刘涛
安徽工程大学 计算机与信息学院,安徽 芜湖 241000安徽工程大学 计算机与信息学院,安徽 芜湖 241000奇瑞汽车股份有限公司 制造工程院,安徽 芜湖 241000安徽工程大学 计算机与信息学院,安徽 芜湖 241000中京建设集团有限公司 上海分公司,上海 201900安徽工程大学 计算机与信息学院,安徽 芜湖 241000
矿业与冶金
骨架动作识别加注动作频域建模时空注意力机制Transformer
skeleton action recognitionfilling actionfrequency domain modelingspatial-temporal attention mechanismTransformer
《山东理工大学学报(自然科学版)》 2026 (5)
35-41,7
安徽省高校科研项目(2024AH050109)安徽未来技术研究院企业合作项目(2023qyhz12)
评论