基于双中心化Q网络框架的多无人机路径规划算法OA
Multi-UAV Path Planning Algorithm Based on Twin Decentralized Q-Network Framework
路径规划作为多无人机系统实现自主协同工作的核心环节,直接决定了集群任务的执行效率和安全性.本文研究了同构多无人机路径规划问题,提出一种基于双中心化Q网络框架的多智能体强化学习算法来解决该问题.首先,利用无人机和障碍物模型,分析了无人机飞行中的碰撞、运动连贯性和任务执行约束,并将多无人机路径规划问题表述为一个具有高计算复杂度的多约束组合优化问题.然后,受到双延迟深度确定性策略梯度算法的启发,提出一种基于多智能体强化学习的方法,采用双中心化Q网络框架,自动为每架无人机生成可行且无碰撞的飞行路径.通过仿真试验验证了该算法在多无人机路径规划中的高效性,为无人机集群的自主路径规划提供了高效的解决方案.
Path planning,as the core component enabling autonomous collaborative operation in multi-UAV systems,directly determines the execution efficiency and safety of cluster missions.This paper investigates the homogeneous multi-UAV path planning problem and proposes a multi-agent reinforcement learning algorithm based on a dual-centralized Q-network framework to address this challenge.Initially,through modeling UAVs and obstacles.This paper analyzes collision risks,motion continuity constraints,and mission execution requirements during UAV flight,formulating the multi-UAV path planning problem as a multi-constrained combinatorial optimization problem with high computational complexity.Subsequently,inspired by the twin delayed deep deterministic policy gradient algorithm,this paper develops a multi-agent reinforcement learning approach employing a dual-centralized Q-network framework to automatically generate feasible and collision-free flight paths for each UAV.Simulation experiments validate the algorithm's effectiveness in multi-UAV path planning,providing an efficient solution for autonomous path planning in UAV swarms.
任崇德;陈进朝;赵爽;刘九如
西北工业大学,陕西西安 710129西北工业大学,陕西西安 710129西北工业大学,陕西西安 710129西北工业大学,陕西西安 710129
航空航天
双中心化Q网络框架自适应贪婪策略多无人机路径规划
twin centralized Q-network frameworkadaptive greedy strategymulti-UAVpath planning
《航空科学技术》 2026 (1)
14-23,10
国家自然科学基金(62106202)航空科学基金(2023M073053003)陕西省重点研发计划(2024GX-YBXM-118) National Natural Science Foundation of China(62106202)Aeronautical Science Foundation of China(2023M073053003)Key Research and Development Program of Shaanxi Province(2024GX-YBXM-118)
评论