首页|期刊导航|信息工程大学学报|SAPD:面向遮挡人脸识别的对抗补丁分割防御方法

SAPD:面向遮挡人脸识别的对抗补丁分割防御方法OA

SAPD:Segmentation-Based Adversarial Patch Defense Framework for Occluded Face Recognition

中文摘要英文摘要

针对现有对抗补丁人脸识别防御方法的泛化能力差、难以抵御强对抗扰动的问题,提出一种基于分割的对抗补丁攻击的防御方法(SAPD).该方法构建融合注意力机制的U-Net分割网络,结合多尺度混合损失函数实现像素级补丁定位;提出形态学掩码平滑(MMS)策略,有效消除扰动的同时不破坏面部结构;设计遮挡区域正则化(OAR)损失函数,在零对抗样本训练条件下增强模型对遮挡的鲁棒性,保持对干净数据的识别性能.在添加对抗补丁的LFW数据集上实验表明,该方法对眼镜状补丁、口罩状补丁1及口罩状补丁2的识别准确率分别达到92.50%、96.16%及95.67%.此外,该方法在MobileFaceNet、FaceNet和IResNet50等主流人脸识别模型上均有性能提升,证明其具有较强的兼容性、良好的泛化能力与实用价值.

To address the issues of poor generalization and weak robustness against strong adversarial perturbations in existing face recognition defense methods against adversarial patches,a segmentation-based adversarial patch defense(SAPD)framework is proposed.In this method,a U-Net segmentation network fused with an attention mechanism is constructed,and a multi-scale hybrid loss function is em‑ployed to realize pixel-level patch localization.A morphological mask smoothing(MMS)strategy is in‑troduced to effectively remove perturbations while preserving facial structure.An occluded-area regu‑larization(OAR)loss function is further designed to improve occlusion robustness without adversarial training,maintaining clean-data accuracy.The experiments conducted on the LFW dataset with the added adversarial patches showed that the recognition accuracies of the method for the eyeglass-shaped patches,mask-shaped patch 1,and mask-shaped patch 2 reach 92.50%,96.16%,and 95.67%,respectively.Furthermore,consistent performance gains are observed across mainstream face recogni‑tion models such as MobileFaceNet,FaceNet,and IResNet50,verifying the strong compatibility,gener‑alization capability,and practical value of the proposed approach.

王浩轩;黄瑞阳;刘宏基;汪浣沙

信息工程大学,河南 郑州 450001信息工程大学,河南 郑州 450001信息工程大学,河南 郑州 450001信息工程大学,河南 郑州 450001

信息技术与安全科学

对抗防御对抗补丁分割修复人脸识别深度学习遮挡

adversarial defenseadversarial patchsegmentationinpaintingface recognitiondeep learningocclude

《信息工程大学学报》 2026 (2)

199-207,9

军队后勤科研项目(BHQ090003000X03)

10.3969/j.issn.1671-0673.2026.02.010

评论