联邦学习中的模型中毒攻击防御策略综述OA
Survey of Model Poisoning Attack Defense Strategies in Federated Learning
模型中毒攻击是联邦学习中的一种严重威胁,在模型中毒攻击中,恶意攻击者通过在训练数据或模型更新中注入恶意信息,从而干扰全局模型的正常收敛,直至操控其预测结果.模型中毒攻击的隐蔽性和多样性使得防御极为困难,因此引起研究者的广泛关注.对模型中毒攻击的原理加以分析,重点剖析攻击者如何通过篡改本地训练数据或伪造模型参数来破坏全局模型性能的内在机制,在此基础上,系统性地将现有防御策略划分为三类:基于恶意模型分析的防御策略,这类方法主要通过模型更新相似性比较和质量评估来有效识别潜在的恶意行为;基于模型更新鲁棒聚合的防御策略,其核心在于采用移除极值或自动加权创新的聚合方式来显著降低攻击造成的影响;基于模型更新加密聚合的防御策略,这类策略创造性地结合了差分隐私和同态加密前沿技术,在确保数据隐私安全的同时大幅提升了模型的鲁棒性,并对其优缺点以及应用场景加以分析说明,最后对模型中毒攻击的隐私保护问题和具体的解决方案详细分析,并从攻击和防御两个角度提出未来的发展方向.
Model poisoning attack is a serious threat in federated learning.In model poisoning attacks,malicious attackers inject malicious information into training data or model updates,thereby interfering with the normal convergence of the global model until their prediction results are manipulated.The concealment and diversity of model poisoning attacks make defense extremely difficult,so it has attracted extensive attention from researchers.The principle of model poisoning attack is analyzed,and the internal mechanism of how attackers destroy the performance of the global model by tampering with local training data or forging model parameters is analyzed.On this basis,this paper systematically divides the existing defense strategies into three categories:defense strategies based on malicious model analysis,which mainly identify potential malicious behaviors through model update similarity comparison and quality assessment techniques.The core of the defense strategy based on model update robust aggregation is to significantly reduce the impact of attacks by removing extreme values or automatically weighting innovations.The defense strategy based on model update encryption aggregation creatively combines the frontier technologies of differential privacy and homomorphic encryption,which greatly improves the robustness of the model while ensuring data privacy security.The advantages and disadvantages and application scenarios are analyzed and explained.The privacy protection problems and specific solutions of model poisoning attacks are analyzed in detail,and the future development direction is proposed from the perspectives of attack and defense.
张磊;姜鸽;蒲冰倩;常亮
佳木斯大学信息电子技术学院,黑龙江佳木斯 154007||佳木斯大学信息电子技术学院黑龙江省自主智能与信息处理重点实验室,黑龙江佳木斯 154007||佳木斯市卫星导航技术与装备工程技术重点实验室,黑龙江佳木斯 154007佳木斯大学信息电子技术学院,黑龙江佳木斯 154007||佳木斯大学信息电子技术学院黑龙江省自主智能与信息处理重点实验室,黑龙江佳木斯 154007||佳木斯市卫星导航技术与装备工程技术重点实验室,黑龙江佳木斯 154007佳木斯大学信息电子技术学院,黑龙江佳木斯 154007||佳木斯大学信息电子技术学院黑龙江省自主智能与信息处理重点实验室,黑龙江佳木斯 154007||佳木斯市卫星导航技术与装备工程技术重点实验室,黑龙江佳木斯 154007佳木斯大学信息电子技术学院,黑龙江佳木斯 154007||佳木斯大学信息电子技术学院黑龙江省自主智能与信息处理重点实验室,黑龙江佳木斯 154007||佳木斯市卫星导航技术与装备工程技术重点实验室,黑龙江佳木斯 154007
信息技术与安全科学
联邦学习模型中毒攻击鲁棒聚合差分隐私同态加密模型更新
federated learningmodel poisoning attackrobust aggregationdifferential privacyhomomorphic encryptionmodel updating
《计算机科学与探索》 2026 (4)
943-964,22
黑龙江省自然科学基金联合基金培育项目(PL2024F002)黑龙江省省属高等学校基本科研业务费优秀创新团队建设项目(2022-KYYWF-0654)佳木斯大学国家基金培育项目(JMSUGPZR2022-014)佳木斯大学"东极"学术团队项目(DJXSTD202417)黑龙江省省属本科高校优秀青年教师基础研究支持计划(YQJH2024239)黑龙江省教育厅基础研究基金基础研究项目(2023-KYYWF-0580).This work was supported by the Cultivation Project of Joint Natural Science Foundation of Heilongjiang Province(PL2024F002),the Excellent Innovation Team Construction Project of Basic Scientific Research Business Fees for Provincial Colleges and Universities in Heilongjiang Province(2022-KYYWF-0654),the National Foundation Cultivation Project of Jiamusi University(JMSUGPZR2022-014),the"Polar East"Academic Team Project of Jiamusi University(DJXSTD202417),the Heilongjiang Provincial Outstanding Young Faculty Basic Research Support Program for Provincial Universities(YQJH2024239),and the Heilongjiang Provincial Basic Scientific Research Foundation Project(2023-KYYWF-0580).
评论