基于MADDPG算法的有人/无人机智能协同空战方法OA
Intelligent Cooperative Air Combat Method Based on MADDPG Algorithm for Manned/Unmanned Aerial Vehicle
有人/无人机智能协同空战是未来空战的重要发展方向,设计有人/无人机智能协同空战方法,形成灵活高效的作战体系,将对未来空战效能的提升发挥巨大作用.本文利用深度强化学习算法,通过有人机获取实时全局敌我态势,并将其共享给无人机,辅助无人机进行决策,从而实现有人/无人机的协同作战.首先,建立了完整的空战仿真环境,包括无人机的三维坐标、运动状态、动作空间以及奖励函数构造;其次,基于作战飞机的自身特点,设计了有人/无人机协同作战体系,使用多智能体深度确定性策略梯度(MADDPG)算法进行训练.仿真试验表明,本文所提出的有人/无人机协同作战体系在二对一截击任务和二对一格斗环境下都展现出优秀的性能,证明了 MADDPG算法在该领域的有效性,为有人/无人机协同作战提供了新的思路.
Manned aerial vehicles(MAVs)and unmanned aerial vehicles(UAVs)cooperative combat is an important development direction for future air warfare.The design of manned/unmanned aerial vehicle coordination intelligent cooperative air warfare methods and the formation of a flexible and efficient combat system will play a huge role in enhancing the effectiveness of future air warfare.This paper utilizes deep reinforcement learning(DRL)algorithms to assist UAV decision-making by sharing real-time global enemy-friendly situational awareness obtained by manned aircraft,thus achieving manned/unmanned cooperative combat.Firstly,a complete air combat simulation environment is established,including UAVs' three-dimensional coordinates,motion states,action space,and reward function construction.Then,based on the characteristics of the combat aircraft,a manned/unmanned cooperative combat system is designed,and the Multi-Agent Deep Deterministic Policy Gradient(MADDPG)algorithm is used for training.Simulation experiments show that the proposed manned/unmanned cooperative combat system exhibits excellent performance in both 2v1 interception tasks and 2v1 dogfighting environments,proving the effectiveness of the algorithm in this field and providing new insights for manned/unmanned cooperative combat.
陈蔚昊;郭正玉;陈才轶;张建;罗德林
厦门大学,福建厦门 361102中国空空导弹研究院,河南洛阳 471000||空基信息感知与融合全国重点实验室,河南洛阳 471000厦门大学,福建厦门 361102昌吉学院,新疆昌吉 831100厦门大学,福建厦门 361102||空基信息感知与融合全国重点实验室,河南洛阳 471000
航空航天
多智能体深度强化学习无人机空战有人/无人机协同MADDPG
multi-agent deep reinforcement learningUAV air combatmanned/unmanned aerial vehicle coordinationMADDPG
《航空科学技术》 2026 (2)
8-17,10
航空科学基金(20220001068001) Aeronautical Science Foundation of China(20220001068001)
评论