基于深度强化学习的双模通信超帧时隙分配算法OA
Super Frame Time Slot Allocation Algorithm for Dual-Mode Communication Based on Deep-Reinforcement Learning
电力线与无线双模通信混合组网可实现优势互补,在电力物联网、智能家居等领域具备重要的应用前景.为提升双模通信MAC算法的接入灵活性与网络资源利用率,提出了一种基于深度强化学习的双模网关超帧时隙资源分配算法.首先构建了双模通信网关与终端的交互模型,梳理了超帧结构及每个阶段的具体执行步骤;接着定义了机器学习应用的关键奖励函数、状态空间与动作空间,由网关对超帧接入的吞吐量等参数进行监测统计,通过迭代学习与训练得到优化后的超帧时隙数、占比等参数.最后通过仿真验证了该算法的有效性与可靠性,将所提算法与固定超帧结构、无超帧结构等算法进行对比,分析了不同算法下网络吞吐量、平均时延、丢包率的表现以及关键参数对系统性能的影响规律.仿真结果表明,所提出的算法可有效提升系统吞吐量、时延等方面的性能,能够实现资源的灵活高效分配.
The hybrid networking of power line and wireless dual-mode communication can achieve complementary advantages,demonstrating significant application prospects in fields such as the Internet of Things for power systems and smart homes.To enhance the access flexibility and network resource utilization of dual-mode communication MAC algorithms,a superframe time slot resource allocation algorithm for dual-mode gateways based on deep reinforcement learning is proposed.Firstly,an interaction model between the dual-mode communication gateway and terminals is established,detailing the superframe structure and the specific execu-tion steps of each phase.Secondly,key reward functions,state spaces,and action spaces for machine learning applications are defined,with the gateway monitoring and collecting parameters such as superframe access throughput.Through iterative learning and training,optimized parameters including the number and proportion of superframe time slots are obtained.Finally,simulations are conducted to verify the effectiveness and reliability of the proposed algorithm.Comparisons are made with fixed superframe structure and non-superframe structure algorithms,analyzing network throughput,average delay,packet loss rate under different algorithms,as well as the influence patterns of key parameters on system performance.Simulation results indicate that the proposed algorithm can effectively improve system performance in terms of throughput and delay,enabling flexible and efficient resource allocation.
冯俊豪;詹学滋;颜宇帆;王朋姣;陈智雄
南方电网科学研究院,广州 510663||广东省电网智能量测与先进计量企业重点实验室,广州 510603华北电力大学电子与通信工程系,河北 保定 071003电力物联智慧化技术河北省工程研究中心,河北 保定 071003电力物联智慧化技术河北省工程研究中心,河北 保定 071003华北电力大学电子与通信工程系,河北 保定 071003||电力物联智慧化技术河北省工程研究中心,河北 保定 071003
信息技术与安全科学
双模通信双深度Q网络MAC层接入超帧结构时隙分配
dual-mode communicationdouble deep Q-networkMAC layer accesssuper frame structuretime slot allocation
《南方电网技术》 2026 (7)
58-66,121,10
国家自然科学基金青年基金项目(61601182)南方电网科学研究院科技项目(SEPRI-K23B060)广东省科技计划项目(2021B1212050014). Supported by the Youth Funds of National Natural Science Foundation of China(61601182)the Science and Technology Projects of Electric Power Research Institute of China Southern Power Grid Co.,Ltd.(SEPRI-K23B060)the Science and Technology Projects of Guangdong Province(2021B1212050014).
评论