基于多智能体深度强化学习的车联网任务安全卸载OA
Secure Task Offloading for IoV Based on Multi-agent Deep Reinforcement Learning
随着智能交通的发展,移动边缘计算的融入使得车联网不再受到车辆自身资源的限制,但是缺乏高效的任务卸载策略仍会影响用户的体验质量(QoE).针对任务卸载时的安全问题,本文提出一种基于多智能体深度强化学习的任务安全卸载策略.首先,根据车辆动态环境建立任务模型、通信模型、计算模型,并根据系统模型将任务卸载问题转化为马尔可夫决策过程.其次,使用MADDPG算法来应对单智能体在动态环境中难以收敛的问题,确保任务的高效卸载.最后,在算法训练过程中融入差分隐私和加权联邦学习,以及减少边缘节点资源异构和Non-IID数据对训练结果造成的影响,同时防止入侵者通过参数反推模型来保护用户隐私.对比仿真实验结果表明,本文算法能有效提高系统执行效率,同时保证任务在训练过程中的用户隐私.
With the development of intelligent transportation,the integration of mobile edge computing has alleviated the re-source limitations of vehicles in the Internet of Vehicles(IoV).However,the lack of efficient task offloading strategies still af-fects the Quality of Experience(QoE)of users.To address the security issues during task offloading,this paper proposes a task security offloading strategy based on Multi-Agent Deep Reinforcement Learning(MADRL).Firstly,a task model,acommunica-tion model,and a computation model are established based on the dynamic environment of vehicles.The task offloading problem is then transformed into a Markov Decision Process(MDP)according to the system model.Secondly,the Multi-Agent Deep De-terministic Policy Gradient(MADDPG)algorithm is utilized to handle the convergence issues of a single agent in a dynamic envi-ronment,ensuring the efficient offloading of tasks.Finally,differential privacy and weighted federated learning are incorporated into the algorithm training process to mitigate the impact of heterogeneous edge node resources and Non-IID data on the training results,while also preventing attackers from inferring the model through parameter reverse engineering,thus protecting user pri-vacy.Simulation results show that the proposed algorithm can effectively improve system execution efficiency while ensuring user privacy during the training process.
孙静文;高赫
西安工程大学电子信息学院,陕西 西安 710048西安工程大学电子信息学院,陕西 西安 710048
信息技术与安全科学
车联网边缘计算深度强化学习任务卸载联邦学习差分隐私
Internet of Vehiclesedge computingdeep reinforcement learningtask offloadingfederal learningdifferential privacy
《计算机与现代化》 2026 (7)
1-11,11
国家自然科学基金资助项目(62207020)陕西省科技厅项目(2023QCY-LL-34,2023QYPY-14)西安市科技局项目(2023JH-QCYCK-0030)秦都区科技局项目(2024ZH001)
评论