基于改进强化学习的移动机器人最短路径寻找方法OA
A shortest path finding method for mobile robots based on improved reinforcement learning
路径规划是移动机器人领域中的重要问题,良好的路径规划能够显著提高机器人的工作效率.因此,如何加快移动机器人对环境的探索速度并找到最短路径是问题的核心所在.目前基于强化学习的最短路径寻找方法存在更新速度过慢的问题,导致其在较小的模型上,初始化和数据迭代需花费大量时间.为此,提出了一种基于强化学习的移动机器人最短路径寻找方法.针对未知环境的特点,对栅格法进行修改,采用边探索、边交互、边建模的策略.同时,引入回溯更新策略到传统的Q学习中,以加快收敛速度.实验结果表明,在使用ε-贪婪算法和归一化方法作为更新策略时,本文的方法在提高训练精度的同时,大大缩短了机器人寻路所需的训练时间,仿真结果验证了所提方案的有效性和优势.
Path planning is a pivotal concern in mobile robotics,with effective planning significantly enhancing the operational efficiency of robots.The crux of the issue lies in accelerating the environ-mental exploration speed of mobile robots and identifying the shortest possible path.Current rein-forcement learning-based methods for shortest path discovery suffer from slow update speeds,resul-ting in excessive time spent on initialization and data iteration,particularly in smaller models.To address this,a novel method for shortest path discovery in mobile robots were proposed,leveraging reinforce-ment learning.Given the unique characteristics of unknown environments,the grid method was adap-ted and a strategy that simultaneously explores,interacts,and models was implemented.Further-more,a back tracking update strategy into traditional Q-learning to expedite convergence speed was incorporated.The experimental results demonstrate that when the ε-greedy algorithm and normaliza-tion methods are employed as update strategies,the proposed method significantly reduces the train-ing time required for robot pathfinding,while also enhancing training accuracy.The efficacy and ad-vantages of the proposed scheme are further validated by simulation results.
柴泽;高志鹏
北京邮电大学 计算机学院(国家示范性软件学院),北京 100876网络与交换技术国家重点实验室(北京邮电大学),北京 100876
信息技术与安全科学
强化学习Q学习栅格法智能机器人路径规划
reinforcement learningQ-learninggrid methodintelligent robotpath planning
《常州大学学报(自然科学版)》 2026 (1)
57-65,9
国家自然科学基金资助项目(62072049)北京市自然科学基金资助项目(4232029).
评论