动态电磁环境下RIS辅助的DRL抗干扰优化OA
DRL-Based Anti-Jamming Optimization Aided by RIS in Dynamic Electromagnetic Environments
在复杂电磁环境下,战术无线通信链路面临严重的干扰威胁,易导致通信中断,影响任务执行的稳定性与可靠性.为提升无线通信系统在动态干扰场景中的抗干扰能力,该文提出了一种融合可重构智能超表面(RIS)与深度强化学习(DRL)的自适应抗干扰架构.该架构从增强有效信号强度和生成动态抗干扰策略两个维度出发,协同提升通信链路的鲁棒性和智能决策能力.首先,利用RIS的波束赋形能力实现对无线传播环境的主动调控,从而提升用户信噪比,有效抑制干扰并加速学习策略的收敛;然后,将频点选择与功率控制建模为马尔可夫决策过程,引入结合历史价值评估的贪婪动作选择策略,构建基于双深度Q网络和优先经验回放机制的强化学习框架,通过RIS增强的信号提升策略的稳定性,并显著缩短训练周期.仿真结果表明,在宽带扫频、随机脉冲及智能博弈等典型干扰场景中,该架构的平均通信成功率相比仅采用深度强化学习或RIS的单一方案均有一定程度的提升,充分验证了该架构在高动态环境下的强鲁棒性与广泛适应能力.
In complex electromagnetic environments,tactical wireless communication links face severe jamming threats,which can easily lead to communication disruption and adversely affect the stability and reliability of mis-sion execution.To improve the anti-jamming capability of wireless communication systems in dynamic interference scenarios,this paper proposes an adaptive anti-jamming architecture that integrates reconfigurable intelligent sur-face(RIS)with deep reinforcement learning(DRL).The proposed architecture improves the robustness of the com-munication link and the intelligence of decision-making from two dimensions:enhancing the strength of useful sig-nals and generating dynamic anti-jamming strategies.In terms of methodology,the system first leverages the beam-forming capability of RIS to actively manipulate the wireless propagation environment,thereby improving the chan-nel signal-to-noise ratio,effectively suppressing the interference,and accelerating the convergence of learning strat-egies.Next,frequency selection and power control are modeled as a Markov decision process.A greedy action se-lection strategy incorporating historical value estimation is introduced,thus forming a reinforcement learning frame-work based on double deep Q-networks with prioritized experience replay.The RIS-enhanced signal improves the stability of the learning strategy and significantly shortens the training period.Simulation results demonstrate that,in such typical jamming scenarios as wideband frequency sweeping,random pulse jamming and intelligent adver-sarial games,the proposed architecture achieves a certain degree of improvement in average communication success rate,as compared with the solutions that rely solely on deep reinforcement learning or RIS.These results validate the strong robustness and broad adaptability of the proposed architecture in highly dynamic environments.
林玮;魏强;熊俊;周毅;蒋觉慧;郑天航;刘颢
武汉数字工程研究所,湖北 武汉 430205武汉数字工程研究所,湖北 武汉 430205||上海交通大学 自动化与感知学院,上海 200240武汉数字工程研究所,湖北 武汉 430205华中科技大学 电子信息与通信学院,湖北 武汉 430074华中科技大学 电子信息与通信学院,湖北 武汉 430074华中科技大学 电子信息与通信学院,湖北 武汉 430074武汉数字工程研究所,湖北 武汉 430205
信息技术与安全科学
战术通信抗干扰深度强化学习可重构智能超表面
tactical communicationanti-jammingdeep reinforcement learningreconfigurable intelligent surface
《华南理工大学学报(自然科学版)》 2026 (4)
110-118,9
国家自然科学基金项目(62071192)国家重点研发计划项目(2024YFE0103800)山东省自然科学基金项目(ZR2022LZH006) Supported by the National Natural Science Foundation of China(62071192),the National Key Research and Development Program of China(2024YFE0103800)and the Natural Science Foundation of Shandong Province(ZR2022LZH006)
评论