首页|期刊导航|自动化学报|深度强化学习驱动的超视距空战自主决策方法

深度强化学习驱动的超视距空战自主决策方法OA

An Autonomous Decision-making Method for Beyond Visual Range Air Combat Driven by Deep Reinforcement Learning

中文摘要英文摘要

随着机载传感器和中远距空空导弹技术的快速发展,超视距空战已经成为现代空战的主流形式.在这种复杂多变的作战环境中,开发能够实时掌握战场态势并制定合理机动决策的智能化技术,已成为军事技术研究领域的热点问题.首先,构建一个涵盖飞机六自由度动力学模型、导弹制导系统模型和雷达传感器系统的高保真仿真环境;接着,融合模仿学习和自博弈方法,提出基于对手学习的空战决策框架,以解决深度强化学习在空战中适应性和泛化性差的缺点,提升智能体在复杂多变战场环境中快速适应和策略优化的能力;最后,构建 10 种具有显著战术差异性的专家系统,在高保真空战仿真平台中与智能体进行博弈对抗.结果表明,在收敛速度和胜率等关键指标上,所提出的空战决策框架优于传统深度强化学习决策策略,有效性和泛化性强,可为复杂超视距空战态势下快速生成可靠策略提供技术支持.

With the rapid development of airborne sensor technologies and medium-to-long-range air-to-air missile technologies,beyond visual range air combat has become the dominant form of modern air warfare.In such a com-plex and dynamic operational environment,the development of intelligent technologies capable of real-time battle-field situation awareness and rational maneuver decision-making has emerged as a research hotspot in the field of mi-litary technology.First,a high-fidelity simulation environment is constructed,encompassing a six-degree-of-freedom aircraft dynamics model,a missile guidance system model,and a radar sensor system.Subsequently,integrating im-itation learning and self-play methods,an opponent-learning-based air combat decision-making framework is pro-posed to address the poor adaptability and generalization of deep reinforcement learning in aerial combat,thereby en-hancing the agent's ability to rapidly adapt and optimize strategies in complex and variable battlefield environ-ments.Finally,ten expert systems with significant tactical differences are developed to engage in game-based confron-tations with the agent within the high-fidelity air combat simulation platform.The results demonstrate that the propo-sed decision-making framework significantly outperform traditional deep reinforcement learning strategies in key met-rics such as convergence speed and winning rate,exhibiting strong effectiveness and generalization.This work can pro-vide technical support for the rapid generation of reliable strategies in complex beyond visual range air combat scenarios.

吕茂隆;王金河;韩浩然;丁晨博;万路军

空军工程大学空管领航学院 西安 710051||空军工程大学无人飞行器技术全国重点实验室 西安 710051空军工程大学研究生院 西安 710051电子科技大学信息与通信工程学院 成都 611731空军工程大学研究生院 西安 710051空军工程大学空管领航学院 西安 710051

深度强化学习对手学习超视距空战智能控制

deep reinforcement learningopponent learningbeyond visual range air combatintelligent control

《自动化学报》 2026 (3)

510-524,15

国家自然科学基金(62303489,GKJJ24050502),博士后面上基金(2022M723877),博士后特别资助(2023T160790),中国博士后国际交流引进计划(YJ20220347),军事科技领域青年人才托举工程(2022-JCJQ-QT-018),陕西省自然科学基础研究计划重点项目(2025JC-QYCX-052)资助Supported by National Natural Science Foundation of China(62303489,GKJJ24050502),Postdoctoral General Fund(2022M723877),Special Postdoctoral Funding(2023T160790),China Postdoctoral International Exchange and Introduction Program(YJ20220347),Youth Talent Support Program for Milit-ary Science and Technology(2022-JCJQ-QT-018),and Key Pro-ject of the Natural Science Basic Research Program of Shaanxi Province(2025JC-QYCX-052)

10.16383/j.aas.c250334

评论