Robust Human Pose Estimation and Action Recognition Utilizing Feature ExtractionOA
Human pose estimation is crucial across diverse applications,from healthcare to human-computer interaction.Integrating inertial measurement units(IMUs)with monocular vision methods holds great potential for leveraging complementary modalities;however,existing approaches are often limited by IMU drift,noise,and underutilization of visual information.To address these limitations,we propose a novel dual-stream feature extraction framework that effectively combines temporal IMU data and single-view image features for improved pose estimation.Short-term dependencies in IMU sequences are captured with convolutional layers,while a Transformerbased architecture models long-range temporal dynamics.To mitigate IMU drift and inter-sensor inconsistencies,a complementary filtering module is introduced alongside a cross-channel interaction mechanism.Features from the IMU and image streams are then fused via a dedicated fusion module and further refined utilizing a high-precision regression head for accurate pose prediction.Experimental results on benchmark datasets demonstrate that our method significantly outperforms existing techniques in terms of estimation,accuracy,and robustness,validating the effectiveness of our dual-stream architecture.
Sheng Luo;Rashid Abbasi;Hao Wang;Jinghua Xu;Dongyang Lyu;Aaron Zhang;Farhan Amin;Isabel de la Torre;Gerardo Mendez Mezquita;Henry Fabian Gongora
College of Computer Science and Artificial Intelligence,Wenzhou University,Wenzhou,ChinaCollege of Computer Science and Artificial Intelligence,Wenzhou University,Wenzhou,ChinaWenzhou Shifeng Technology Co.,Ltd.,Wenzhou Innovation Center,Wenzhou,ChinaThe State Key Laboratory of Fluid Power Transmission and Control,Zhejiang University,Hangzhou,ChinaChina Electronics Digital Innovation,Hengkuan International Building,Beijing,ChinaCollege of Computer Science and Artificial Intelligence,Wenzhou University,Wenzhou,ChinaSchool of Computer Science and Engineering,Yeungnam University,Gyeongsan,Republic of KoreaDepartment of Signal Theory and Communications,University of Valladolid,Valladolid,SpainDepartment of Project Management,Universidad Internacional Iberoamericana,Campeche,MexicoDepartment of Project Management,Universidad Internacional Iberoamericana,Campeche,Mexico
信息技术与安全科学
Human pose estimationdual-stream networkinertial measurement units(IMU)
《Computer Modeling in Engineering & Sciences》 2026 (3)
P.870-887,18
support provided by the European University of Atlantic.
评论