本地差分隐私下基于聚类的两阶段多任务学习算法OA
Two-Stage Clustering-Based Multi-Task Learning Algorithm Under Local Differential Privacy
随着多任务学习在数据分析中的广泛应用,其隐私泄露风险日益凸显.传统方法依赖可信服务器且忽视噪声干扰,同时仅考虑任务相关性,导致隐私保护不足与模型性能下降.提出了一种满足本地差分隐私(local differen-tial privacy,LDP)的基于K-Means聚类的两阶段多任务学习算法(local differential privacy K-means-based two-stage multi-task learning,KTMTL),旨在实现隐私保护与模型效用的协同优化.在第一阶段,通过改进K-means聚类算法,采用Huber距离替代欧氏距离,有效抑制因拉普拉斯噪声引入的离群点影响;在第二阶段,设计交互式多任务学习模型,联合建模任务间特征关联性与任务相关性,并利用梯度聚合优化模型参数.理论分析表明,KTMTL严格满足LDP且复杂度可控.在School、ADNI和合成数据集上的实验显示,KTMTL在相同隐私预算下,相较于DP-MTRL和DP-DMTL,模型预测精度(AUC)提升10%~15%,归一化均方误差(nMSE)降低8%~12%,同时运行效率显著优于同类方法.KTMTL通过协同优化隐私保护与任务分组质量,为隐私敏感场景下的多任务学习提供了高效、鲁棒的解决方案.
The widespread application of multi-task learning in data analysis amplifies privacy leakage risks.Traditional approaches relying on trusted servers,neglecting noise interference,and considering only task correlation result in insuffi-cient privacy protection and degraded model performance.This study proposes KTMTL,a two-stage clustering-based multi-task learning algorithm under local differential privacy(LDP),to jointly optimize privacy preservation and model utility.The first stage replaces the Euclidean distance with Huber distance in an improved K-means clustering algorithm,effectively suppressing outlier impacts induced by Laplace noise.The second stage constructs an interactive multi-task learning framework that simultaneously models feature-task correlations and optimizes parameters through gradient aggre-gation.Theoretical analysis confirms the algorithm's rigorous LDP compliance and bounded complexity.Experiments on School,ADNI,and synthetic datasets demonstrate KTMTL outperforms existing privacy-preserving algorithms(e.g.,DP-MTRL,DP-DMTL)by 10%-15%in prediction accuracy(AUC)and reduces normalized mean squared error(nMSE)by 8%-12%under equivalent LDP guarantees,while significantly outperforming comparable methods in computational efficiency.The proposed framework provides an efficient and robust solution for privacy-sensitive multi-task learning scenarios through synergistic optimization of privacy protection and task grouping quality.
方贤进;程俊;张朋飞;方翔;陈家庆;王杰
安徽理工大学 计算机科学与工程学院,安徽 淮南 232001安徽理工大学 计算机科学与工程学院,安徽 淮南 232001安徽理工大学 计算机科学与工程学院,安徽 淮南 232001||云南省服务计算重点实验室(云南财经大学),昆明 650221安徽理工大学 计算机科学与工程学院,安徽 淮南 232001安徽理工大学 计算机科学与工程学院,安徽 淮南 232001安徽理工大学 安全科学与工程学院,安徽 淮南 232001
信息技术与安全科学
隐私保护本地差分隐私K-means聚类多任务特征学习多任务关系学习
privacy protectionlocal differential privacyK-means clusteringmulti-task feature learningmulti-task rela-tionship learning
《计算机工程与应用》 2026 (12)
325-338,14
国家自然科学基金(61572034)云南省服务计算重点实验室开放课题(YNSC24116).
评论