首页|期刊导航|通信学报|基于多智能体深度强化学习的智能网联汽车服务迁移优化方法

基于多智能体深度强化学习的智能网联汽车服务迁移优化方法OA

Service migration optimization method for intelligent connected vehicles based on multi-agent deep reinforcement learning

中文摘要英文摘要

为应对智能网联汽车在高动态车联网环境中服务迁移所面临的多用户资源竞争与边缘节点可用性动态变化等挑战,提出了一种基于多智能体组相对策略优化(MAGRPO)的服务迁移方法,将服务迁移问题形式化为带资源约束的长期多用户联合优化问题,并设计了一种不需要显式Critic网络的MAGRPO算法.基于组内折扣回报的相对排序构建策略更新信号,有效缓解由强约束惩罚(如节点过载或故障)引起的训练不稳定问题,并降低训练开销.仿真结果表明,所提方法在服务总时延、迁移能耗及迁移成功率等关键指标上均优于现有基线方法,尤其在边缘节点资源受限且可用性动态变化的场景下,展现出更强的鲁棒性与可扩展性.

To address the challenges of multi-user resource competition and dynamic changes in edge node availability faced by intelligent connected vehicles during service migration in a highly dynamic Internet of vehicles environment,a service migration method based on multi-agent group relative policy optimization(MAGRPO)was proposed.The ser-vice migration problem was formalized as a long-term multi-user joint optimization problem with resource constraints,and a MAGRPO algorithm that did not require an explicit critic network was designed.A policy update signal was con-structed based on the relative ranking of discounted returns within the group,thereby effectively mitigating training insta-bility caused by severe penalties(e.g.,node overload or failure)and reducing training cost.Simulation results show that the proposed method outperforms existing baseline methods in key metrics such as total service delay,migration energy consumption,and migration success rate.It exhibits stronger robustness and scalability in scenarios where edge node re-sources are limited and their availability changes dynamically.

芮兰兰;邓淑予;陈子轩;高志鹏;邱雪松;郭少勇

北京邮电大学网络与交换技术全国重点实验室,北京 100876北京邮电大学网络与交换技术全国重点实验室,北京 100876北京邮电大学网络与交换技术全国重点实验室,北京 100876北京邮电大学网络与交换技术全国重点实验室,北京 100876北京邮电大学网络与交换技术全国重点实验室,北京 100876北京邮电大学网络与交换技术全国重点实验室,北京 100876

信息技术与安全科学

移动边缘计算智能网联汽车服务迁移多智能体深度强化学习组相对策略优化

mobile edge computingintelligent connected vehiclesservice migrationmulti-agent deep reinforcement learninggroup relative policy optimization

《通信学报》 2026 (1)

141-155,15

国家自然科学基金资助项目(No.62471051)河北省创新能力提升计划基金资助项目(No.V1755673688106)The National Natural Science Foundation of China(No.62471051),Hebei Provincial Innovation Capacity En-hancement Program Project(No.V1755673688106)

10.11959/j.issn.1000−436x.2026005

评论