首页|期刊导航|Computers, Materials & Continua|GaitMAFF:Adaptive Multi-Modal Fusion of Skeleton Maps and Silhouettes for Robust Gait Recognition in Complex Scenarios

GaitMAFF:Adaptive Multi-Modal Fusion of Skeleton Maps and Silhouettes for Robust Gait Recognition in Complex ScenariosOA

中文摘要

Gait recognition is a key biometric for long-distance identification,yet its performance is severely degraded by real-world challenges such as varying clothing,carrying conditions,and changing viewpoints.While combining silhouette and skeleton data is a promising direction,effectively fusing these heterogeneous modalities and adaptively weighting their contributions in response to diverse conditions remains a central problem.This paper introduces GaitMAFF,a novelMulti-modal Adaptive Feature Fusion Network,to address this challenge.Our approach first transforms discrete skeleton joints into a dense SkeletonMap representation to align with silhouettes,then employs an attention-based module to dynamically learn the fusion weights between the two modalities.These fused features are processed by a powerful spatio-temporal backbone withWeighted Global-Local Feature FusionModules(WFFM)to learn a discriminative representation.Extensive experiments on the challenging CCPG and Gait3D datasets show that GaitMAFF achieves state-of-the-art performance,with an average Rank-1 accuracy of 84.6%on CCPG and 58.7%on Gait3D.These results demonstrate that our adaptive fusion strategy effectively integrates complementary multimodal information,significantly enhancing gait recognition robustness and accuracy in complex scenes and providing a practical solution for real-world applications.

Zhongbin Luo;Zhaoyang Guan;Wenxing You;Yunteng Wang;Yanqiu Bi

College of Computer Science,Chongqing University,Chongqing,400044,China School of Traffic and Transportation,Chongqing Jiaotong University,Chongqing,400074,ChinaDepartment of Engineering Sciences and Applied Mathematics,Northwestern University,Evanston,IL 60208,USASchool of Traffic and Transportation,Chongqing Jiaotong University,Chongqing,400074,ChinaSchool of Traffic and Transportation,Chongqing Jiaotong University,Chongqing,400074,ChinaSchool of Civil Engineering,Chongqing Jiaotong University,Chongqing,400074,China National&Local Joint Engineering Research Center of Transportation Civil EngineeringMaterials,Chongqing JiaotongUniversity,Chongqing,400074,China

信息技术与安全科学

Gait recognitionmulti-modal fusionadaptive feature fusionskeleton mapsilhouette

《Computers, Materials & Continua》 2026 (5)

P.540-558,19

funded by the Natural Science Foundation of Chongqing Municipality,grant number CSTB2022NSCQ-MSX0503.

10.32604/cmc.2025.075704

评论