基于伪节点交叉注意力的远程步态情绪识别OA
Long Distance Gait Emotion Recognition Based on Pseudo Node Cross Attention
近年来,情绪识别在心理计算、人机交互和精神状态监测中的应用引起了广泛关注.与面部情绪识别和脑电情绪识别(EEG)等其他方式相比,步态情绪识别所使用的采集无需高精度拍摄,且可以不用佩戴专门的采集设备进行远距离采集.尽管该领域已经开展了一系列研究并取得了相应进展,但目前仍面临两个主要挑战.一是现有大多数基于步态情绪识别的工作都侧重于通过图卷积网络(GCN)从骨骼图像中探索人体关节的局部相关性,而忽略了人体关节的全局相关性;二是使用了人体自然连接关节骨架图,原有的固定连接会限制网络捕捉远距离关节之间相互作用的能力.为了解决这些问题,提出了一种基于伪节点交叉注意力的图卷积网络,通过伪节点的方法有效地实现全局和局部关节节点的信息及时传递,并使用交叉注意力方法捕获有效和高效的步态表示以进行情绪状态识别.将所提出的方法在情绪步态数据集Emotion-Gait上进行评估,准确率达到88.63%,与已有经典先进模型相比性能更优.
In recent years,the application of emotion recognition in mental computing,human-computer interaction,and mental state moni-toring has attracted considerable attention.Compared with other methods such as facial and electroencephalogram(EEG)emotion recognition,gait data does not require high-precision shooting equipment and can be collected at a long distance.Although some research has been con-ducted in this field and corresponding progress has been made,there are still two problems that remain unsolved.First,most of the existing work on gait-based emotion recognition focuses on exploring the local correlation of human joints from skeleton images through graph convolu-tional networks(GCNs),while ignoring the global correlation of human joints.Second,the human body's naturally connected joint skeleton graph is used,and the original fixed connection will limit the network's ability to capture the interaction between distant joints.To solve these problems,this paper proposes a graph convolutional network based on pseudo-node cross-attention,which realizes the timely transmission of information of all joints through the pseudo-node method and uses the cross-attention method to capture efficient gait representation for emo-tional state recognition.The proposed method is evaluated on the dataset Emotion-Gait,and the accuracy rate reaches 88.63%,it has better performance compared with the existing classic advanced models.
卢亮宇;周成菊
华南师范大学 人工智能学院,广东 佛山 528000华南师范大学 人工智能学院,广东 佛山 528000
信息技术与安全科学
步态情绪识别交叉注意力图卷积神经网络关节邻接矩阵
gait emotion recognitioncross attentiongraph convolutional networksjoint adjacency matrix
《软件导刊》 2026 (1)
47-53,7
评论