基于GRU-MAPPO的应急通信无人机轨迹优化与功率分配OA
GRU-MAPPO-based trajectory optimization and power allocation for emergency communication UAVs
在地面通信基础设施受损的灾后场景中,无人机可作为空中基站快速部署,构建临时应急通信网络.然而,灾区用户分布通常具有明显的不均匀性,且单架无人机的覆盖能力有限,这使得多智能体系统在动态环境下协同保障服务质量面临挑战.对此,提出一种基于门控循环单元(gated recurrent unit,GRU)多智能体近端策略优化(multi-agent proximal policy optimization,MAPPO)的轨迹与资源联合优化框架.该框架在策略学习过程中引入GRU模块,使无人机能够在部分可观测条件下自适应调整飞行轨迹与发射功率,从而改善系统吞吐量和能量效率.针对高维状态空间与连续动作空间带来的训练收敛缓慢和样本利用率不足问题,构建混合奖励函数,并结合课程学习的线性调度策略,以改善模型训练过程并促进收敛.仿真结果表明,所提算法具有较好的收敛稳定性,并在吞吐量和能量效率等指标上优于对比算法,能够提升复杂灾后救援场景下通信系统的可靠性与环境适应能力.
In post-disaster scenarios with damaged terrestrial communication infrastructure,unmanned aerial vehicles(UAVs)can be rapidly deployed as aerial base stations to establish a temporary emergency communication network.However,the distribution of users in disaster areas is often significantly uneven,and the coverage capability of a single UAV is limited.This poses challenges for multi-agent systems to collaboratively ensure service quality in dynamic environments.To address this issue,a joint trajectory and resource optimization framework based on gated recurrent unit multi-agent proximal policy optimization(GRU-MAPPO)was proposed.In this framework,a GRU module was introduced into the process of policy learning,enabling UAVs to adaptively adapt their flight trajectories and transmit power under partial observable conditions,thereby improving system throughput and energy efficiency.To address the slow training convergence and low sample efficiency issues caused by the high-dimensional state space and continuous action space,a hybrid reward function was designed and combined with a linear curriculum learning scheduling strategy to improve the training process and facilitate convergence.Simulation results show that the proposed algorithm achieves better convergence stability and outperforms benchmark algorithms in terms of throughput and energy efficiency,providing enhanced reliability and environmental adaptability of communication systems in complex post-disaster rescue scenarios.
吕梁玮;谭玲玲;刘臻
北京信息科技大学 自动化学院,北京 100192北京信息科技大学 自动化学院,北京 100192北京信息科技大学 计算机学院,北京 100192
信息技术与安全科学
无人机应急通信近端策略优化课程学习深度强化学习
unmanned aerial vehicle(UAV)emergency communicationproximal policy optimization(PPO)curriculum learningdeep reinforcement learning
《北京信息科技大学学报(自然科学版)》 2026 (4)
13-23,11
工信部高质量发展专项(DZBM2025-BJ-0025)
评论