首页|期刊导航|航空科学技术|基于角色多智能体强化学习的异构无人机集群任务分配方法

基于角色多智能体强化学习的异构无人机集群任务分配方法OA

Task Assignment Method of Heterogeneous UAV Swarm Based on Role Multi-agent Reinforcement Learning

中文摘要英文摘要

针对异构无人机集群协同对地攻击的任务分配问题,考虑到真实场景中存在的大规模、高动态、强对抗等特性,本文提出了注意力机制驱动的角色多智能体强化学习方法Role-MAAC.首先,对异构无人机集群协同对地攻击的任务分配场景进行建模,描述任务想定的同时建模无人机集群与地面目标的对抗交互过程.其次,为应对上述任务分配问题中的三种特性,建立由注意力机制驱动的集中式训练-分布式执行的网络架构,将无人机功能映射到不同角色,提出基于角色的多智能体强化学习方法,以重要状态触发每一轮新的决策并优化样本池构建.仿真结果证明,所提方法可有效解决异构无人机集群协同对地任务分配问题,相较于基线方法实现了模型效果和收敛性能的提升.

Aiming to address the task assignment problem for heterogeneous UAV swarm collaboration in ground attack missions,this paper considers the characteristics of large scale,high dynamics,and strong adversarial conditions typically presented in real-world scenarios.This paper propose a role-based multi-agent reinforcement learning role-based multiple attention actor critic,(Role-MAAC)method driven by the attention mechanism.First,model the task allocation for heterogeneous UAV swarm collaboration in ground attack missions,describing both the task assumptions and adversarial interactions between the UAV swarm and ground targets.Second,to tackle the three key features of the task allocation problem,establish a network architecture that combines centralized training with distributed execution,mapping UAV functions to different roles.This paper propose a role-based architecture,where key states trigger new decision-making cycles in each round and optimize the construction of the sampling pool.Simulation results demonstrate that the proposed method effectively addresses the task allocation problem for heterogeneous UAV swarm collaboration in ground attack missions,achieving improvements in both model performance and convergence compared to baseline methods.

付航;王景璟;何磊明;刘益辰

北京航空航天大学,北京 100191北京航空航天大学,北京 100191中国航空研究院,北京 100029中国航空研究院,北京 100029

航空航天

无人机集群任务分配多智能体强化学习注意力机制马尔可夫决策过程

UAV swarmtask assignmentmulti-agent reinforcement learningattention mechanismMarkov decision process

《航空科学技术》 2026 (2)

1-7,7

航空科学基金(2022Z071051013) Aeronautical Science Foundation of China(2022Z071051013)

10.19452/j.issn1007-5453.2026.02.001

评论