复杂电磁环境下基于HRDQN的智能干扰决策算法OA
Intelligent jamming decision-making algorithm based on HRDQN in complex electromagnetic environments
针对通信对抗中现有智能干扰决策面对复杂电磁环境收敛速度慢以及干扰能效低等问题,提出了一种基于分层Rainbow DQN(HRDQN)的智能干扰决策算法.首先,构建了存在非合作智能干扰的通信系统模型,将干扰决策过程建模为马尔可夫决策过程(MDP),并推导了压制系数门限作为干扰效果的判断依据;其次,基于分层结构设计了智能体的动作空间和决策方法,从而提升了决策效率;最后,结合压制系数门限及所估计干信比(JSR)设计了算法的奖励函数,确保算法稳定收敛.仿真结果表明,所提算法能够在快速生成理想干扰决策的同时降低干扰功耗,相较于传统智能干扰决策算法,具有更快的收敛速度,验证了所提算法的有效性.
To address the issues of slow convergence speed and poor energy efficiency of existing intelligent jamming decision-making in communication countermeasures scenarios,a hierarchical Rainbow deep Q-network(HRDQN)algo-rithm was proposed.Firstly,a communication system model subject to non-cooperative intelligent jamming was formu-lated,and the jamming decision-making process was modeled as a Markov decision process(MDP),deriving the sup-pression coefficient threshold to quantify jamming effectiveness.Secondly,the action space and decision-making method of the agent were designed to improve decision-making efficiency based on a hierarchical structure.Finally,the reward function was designed to combine the suppression coefficient threshold with the estimated jamming-to-signal ratio(JSR)to guarantee stable convergence of the algorithm.Simulation results demonstrate that the proposed algorithm rapidly gen-erates ideal jamming decisions while reducing power consumption,and outperforms traditional algorithms in conver-gence speed,thereby corroborating the merits of the proposed algorithm.
刘天一;吴宣利;许涛;王吉彬;李广华
哈尔滨工业大学电子与信息工程学院,黑龙江 哈尔滨 150001||中国人民解放军63861部队,吉林 白城 137001哈尔滨工业大学电子与信息工程学院,黑龙江 哈尔滨 150001哈尔滨工业大学电子与信息工程学院,黑龙江 哈尔滨 150001中国人民解放军63861部队,吉林 白城 137001中国人民解放军63861部队,吉林 白城 137001
信息技术与安全科学
通信对抗智能干扰决策马尔可夫决策过程分层Rainbow-DQN算法能量效率
communication countermeasureintelligent jamming decision-makingMarkov decision processhierarchical Rainbow-DQN algorithmenergy efficiency
《通信学报》 2026 (2)
94-108,15
国家自然科学基金资助项目(No.U23A20278) The National Natural Science Foundation of China(No.U23A20278)
评论