首页|期刊导航|南京信息工程大学学报|基于APF-MASAC算法的多无人车路径规划研究

基于APF-MASAC算法的多无人车路径规划研究OA

Multi-unmanned vehicle path planning via APF-MASAC algorithm

中文摘要英文摘要

针对真实环境中多无人车路径规划问题,在多智能体柔性演员-评论家(Multi-Agent Soft Actor-Critic,MASAC)框架下提出一种算法设计方案.基于势能塑形回报技术,设计了稠密的奖励函数,为算法的学习过程提供更为丰富、及时有效的反馈信号,显著加速算法的收敛速度.采用双连帧技术对传统经验回放池进行改良.双连帧技术将连续的两帧观测数据作为一个整体单元纳入经验回放池,有效捕捉环境状态变化的动态信息,提升了训练效率与稳定性.依托 Ga-zebo 仿真平台搭建高度逼真的动态障碍物环境,为算法的训练提供了丰富多样且极具挑战性的训练样本,确保算法能够在模拟真实的条件下进行充分学习与优化.最后,通过消融实验和鲁棒性测试验证了算法的有效性.

To address the path planning problem for multiple unmanned vehicles in real-world environments,this paper proposes an algorithm design scheme under the Multi-Agent Soft Actor-Critic(MASAC)framework.To en-hance the algorithm's performance,we propose three improvements.First,drawing inspiration from the Artificial Po-tential Field(APF)concept,we design a dense reward function based on potential shaping techniques to provide abundant,timely and effective feedback signals during the learning process,thereby significantly accelerating con-vergence.Second,the traditional experience replay buffer is modified by adopting a double-consecutive-frame tech-nique.This approach incorporates two consecutive observation frames as unified units into the experience replay buffer,effectively capturing environmental dynamics and improving training stability.Third,a highly realistic dynam-ic obstacle environment is constructed using the Gazebo simulation platform,which provides diverse and challenging training samples,ensuring comprehensive learning and optimization under near-real conditions.Finally,the effective-ness of the proposed APF-MASAC algorithm is validated through ablation experiments and robustness tests.

闫冬梅;杨南禹;许佳佳;刘磊

安徽三联学院 安徽省普通高校交通信息与安全重点实验室,合肥,230601||南京邮电大学 现代邮政学院,南京,210003河海大学 数学学院,南京,211100安徽三联学院 安徽省普通高校交通信息与安全重点实验室,合肥,230601河海大学 数学学院,南京,211100

交通工程

强化学习多智能体人工势场路径规划无人车

reinforcement learningmulti-agentartificial potential field(APF)path planningunmanned vehicle

《南京信息工程大学学报》 2026 (1)

69-75,7

安徽省普通高校交通信息与安全重点实验室开放课题(KLAHEI180188)教育部海上智能网信技术教育部重点实验室开放课题(2014AA110501)

10.13878/j.cnki.jnuist.20241215002

评论