FedReg*:应对联邦学习非独立同分布场景下的挑战OA

In non-independent and identically distributed(non-IID)data environments,model performance often degrades significantly.To address this issue,two improvement methods are proposed:FedReg and FedReg*.FedReg is a method based on hybrid regularization aimed at enhancing federated learning in non-IID scenarios.It introduces hybrid regularization to replace traditional L2 regularization,combining the advantages of L1 and L2 regularization to enable feature selection while preventing overfitting.This method better adapts to the diverse data distributions of different clients,improving the overall model performance.FedReg* combines hybrid regularization with weighted model aggregation.In addition to the benefits of hybrid regularization,FedReg* applies a weighted averaging method in the model aggregation process,calculating weights based on the cosine similarity between each client gradient and the global gradient to more reasonably distribute client contributions.By considering variations in data quality and quantity among clients,FedReg* highlights the importance of key clients and enhances the model's generalization performance.These improvement methods enhance model accuracy and communication efficiency.