面向空间防御的多航天器协同博弈方法OA
Multi-spacecraft Cooperation for Space Defense via Game Theory
针对空间防御场景中多航天器协同观测与拦截问题,提出一种基于博弈论与强化学习相结合的分层智能协同架构.该架构将观测任务分配与机动控制解耦:上层观测博弈层采用 Stackelberg博弈算法,综合考虑太阳角约束、观测距离、威胁度评估与信息熵等因素,实现时效性协同观测分配;下层控制执行层采用多智能体近端策略优化算法(multi-agent proximal policy optimization,MAPPO),基于集中式训练分布式执行范式,实现符合轨道动力学与推力约束的自主拦截控制.为模拟非合作航天器的不确定行为,本文基于 Clohessy-Wiltshire方程设计随机策略模型,通过叠加确定性基础策略与高斯扰动项刻画其机动意图.通过信息共享与融合机制,系统实现"一点观测、全局感知"的协同感知模式,显著提升态势感知能力.仿真结果表明,该分层架构能有效降低计算复杂度,提高系统可扩展性与决策效率,同时保证高拦截成功率与低燃料消耗,为空间对抗场景下的多航天器协同任务提供了新思路.
To address the cooperative observation and interception problem in multi-spacecraft space defense scenarios,this paper proposes a hierarchical intelligent cooperative architecture that integrates game theory and reinforcement learning.The architecture decouples observation task allocation and maneuver control:the upper-level observation game layer employs a Stackelberg game algorithm,which synthesizes solar angle constraints,observation distance,threat assessment,and information entropy for time-sensitive cooperative observation assignment.The lower-level control execution layer adopts the Multi-Agent Proximal Policy Optimization(MAPPO)algorithm,following a centralized training with decentralized execution paradigm,to realize autonomous interception control that complies with orbital dynamics and thrust constraints.To simulate the uncertain behaviors of non-cooperative spacecraft,a stochastic policy model is proposed based on the Clohessy-Wiltshire equations,by combining a deterministic baseline policy with Gaussian perturbations.Enabled by information sharing and fusion mechanisms,the system achieves a"one-point observation,global awareness"cooperative perception mode,significantly enhancing situational awareness.Simulation results demonstrate that the proposed hierarchical architecture effectively reduces computational complexity while improving system scalability and decision-making efficiency,and ensures high interception success rates with low fuel consumption.Thus,it provides a novel approach for multi-spacecraft cooperative missions in space confrontation scenarios.
于常平;刘杨;曹志成;谢心如;张嘉辉
北京航空航天大学,北京 100191北京航空航天大学,北京 100191北京航空航天大学,北京 100191北京控制工程研究所,北京 100094北京控制工程研究所,北京 100094
航空航天
多航天器空间防御协同控制Stackelberg博弈MAPPO算法
multi-spacecraftspace defensecooperative controlStackelberg gameMAPPO algorithm
《空间控制技术与应用(中英文)》 2026 (4)
53-63,11
国家自然科学基金资助项目(62227810,62376015)和空间智能体系与基础研究中心开放基金资助项目(RCSISF-2025-11) National Natural Science Foundation of China(62227810,62376015)and Supported by the Open Foundation of Research Center for Space Intelligent Systems and Fundamentals(RCSISF-2025-11)
评论