首页|期刊导航|重庆邮电大学学报(自然科学版)|基于深度强化学习的基站协作与服务缓存研究

基于深度强化学习的基站协作与服务缓存研究OA

Research on base station collaboration and service caching based on DRL

中文摘要英文摘要

边缘缓存技术通过就近存储内容,可以有效降低传输冗余和服务延迟,是移动边缘网络的关键技术之一.基站缓存容量受限的问题,协作式边缘缓存可以通过基站间资源共享有效提升存储利用率.针对移动边缘网络中基站协作与服务缓存的联合优化问题,提出一种融合李雅普诺夫优化与深度确定性策略梯度(deep deterministic policy gradient,DDPG)的高效动态决策算法.该算法将长期成本约束下的时延最小化问题转化为时隙级优化任务,通过 DDPG 处理高维非线性环境中的动态优化问题,实现对系统资源的高效调配.仿真结果表明,所提算法与其他算法相比,在满足成本约束的同时,可以更有效地降低系统时延.

Edge caching technology,which stores content in proximity to end users,can effectively reduce transmission redundancy and service latency,making it one of the key enabling technologies for mobile edge networks.Given the limited cache capacity of individual base stations,cooperative edge caching can significantly improve storage utilization through resource sharing among base stations.To address the joint optimization problem of base station cooperation and service caching in mobile edge networks,this study proposes an efficient dynamic decision-making algorithm that integrates Lyapunov optimization with the deep deterministic policy gradient(DDPG)algorithm.The proposed approach transforms the latency minimization problem under long-term cost constraints into a time-slot-level optimization task.By leveraging DDPG to handle dynamic optimization in high-dimensional and nonlinear environments,the algorithm achieves efficient allocation and coordination of system resources.Simulation results demonstrate that,compared with existing approaches,the proposed algorithm is more effective in reducing overall system latency while satisfying cost constraints.

唐宏;燕星芮;施杰;刘子兴

重庆邮电大学 通信与信息工程学院,重庆 400065||移动通信技术重庆市重点实验室,重庆 400065重庆邮电大学 通信与信息工程学院,重庆 400065||移动通信技术重庆市重点实验室,重庆 400065重庆邮电大学 通信与信息工程学院,重庆 400065||移动通信技术重庆市重点实验室,重庆 400065重庆邮电大学 通信与信息工程学院,重庆 400065||移动通信技术重庆市重点实验室,重庆 400065

信息技术与安全科学

移动边缘计算深度强化学习边缘缓存深度确定性策略梯度算法

mobile edge computingdeep reinforcement learningedge cachingdeep deterministic policy gradient(DDPG)algorithm

《重庆邮电大学学报(自然科学版)》 2026 (3)

391-400,10

国家自然科学基金资助项目(61971080) National Natural Science Fondation of China(61971080)

10.3979/j.issn.1673-825X.202505110113

评论