基于时间序列成像的多任务学习驱动情感识别OA
Multi-task Learning-driven Emotion Recognition Based on Time Series Imaging
针对脑电情感识别依赖特征抽取或时频谱图导致的计算复杂度高的问题,提出一种基于时间序列成像(TSI)的多任务学习驱动情感识别方法.通过格拉姆角场、马尔可夫转移场以及模式差分场,实现一维脑电信号到二维图像的直接编码;基于 ResNet18 分类骨干网络,设计多任务特征融合框架,融合 3 种 TSI 编码提取的特征表示.实验结果表明:在 DEAP 数据集上,所提方法在 Valence 和 Arousal 的二分类中的平均分类准确率分别为96.51%和 97.22%,在 AMIGOS数据集上分别为 98.59%和 99.64%,扩展到四分类和八分类时,DEAP 上的平均分类准确率分别为 91.06%和 87.43%,AMIGOS上的平均准确率分别为 97.41%和 89.84,在脑电情感识别中具备良好的鲁棒性.
To overcome the high computational complexity of EEG-based emotion recognition methods based on fea-ture extraction or time-frequency representations,a multi-task learning-driven method for emotion recognition based on time series imaging(TSI)was proposed.EEG signals were directly transformed into two-dimensional images using Gramian angular field,Markov transition field,and motif difference field.Built upon the ResNet18 architec-ture,a multi-task feature fusion framework was designed to integrate features from the three imaging methods to en-hance emotional feature representation.Experimental results showed that with the DEAP dataset,the proposed method achieved average classification accuracies of 96.51%and 97.22%for binary classification of Valence and Arousal,respectively,and with the AMIGOS dataset,the accuracies reached 98.59%and 99.64%.When extend-ed to four-class and eight-class classification tasks,the proposed method achieved average accuracies of 91.06%and 87.43%with DEAP,and 97.41%and 89.84%with AMIGOS,respectively.These results demonstrated the robustness of the proposed method in EEG-based emotion recognition.
XU Shengxin;LIANG Bizheng;HU Fei;XU Huaxing
National Engineering Center for Risk Perception and Prevention(RPP),China Academy of Electronics and Information Technolo-gy,Beijing 100041,ChinaInstitute of Telecommunication and Navigation Satellites,China Academy of Space Technology,Beijing 100094,ChinaSchool of Electrical and Information Engineering,Zhengzhou University,Zhengzhou 450001,ChinaSchool of Electrical and Information Engineering,Zhengzhou University,Zhengzhou 450001,China
信息技术与安全科学
脑电情感识别时间序列成像多任务特征融合
EEGemotion recognitiontime series imagingmulti-taskfeature fusion
《郑州大学学报(工学版)》 2026 (1)
73-80,8
国家重点研发计划(2022YFC3502400)中央本级重大增减支项目(2060302-1802-03)
评论