首页|期刊导航|自动化学报|基于部分可观蒙特卡洛树搜索算法的无人系统异步任务规划

基于部分可观蒙特卡洛树搜索算法的无人系统异步任务规划OA

Unmanned System Asynchronous Task Planning Based on Partially Observable Monte Carlo Tree Search Algorithm

中文摘要英文摘要

无人系统正深刻重塑社会生活方式与战争形态.围绕无人系统动态规划领域,首先,将环境抽象为由节点和边组成的拓扑网络.其次,针对异步规划中变步长时间推进的问题,提出一种新颖的异步规划算法,即半马尔科夫环境下的部分可观蒙特卡洛树搜索算法(SPOMCP),其创新之处在于将拓扑网络转化为具有最简信息表示的子目标图,并实现基于变步长时间推进机制的策略快速寻优.通过理论分析,证明了SPOMCP能够生成最优策略,且计算复杂度与子目标节点数呈指数相关.最后,仿真实验表明了SPOMCP的性能高于基准算法,用不到基准算法 89.18%的计算时间,得到高于基准算法的平均回报值.

Unmanned systems are profoundly reshaping social lifestyles and modes of warfare.In the field of dy-namic planning for unmanned systems,the environment is first abstracted as a topological network composed of nodes and edges.Second,for the variable step time advancement problem of asynchronous planning,a novel asyn-chronous planning algorithm,namely,a partially observable Monte Carlo tree search algorithm in the semi-Markov environment(SPOMCP)is proposed.The innovation is that the topological network is transformed into a sub-goal graph with the simplest information representation,and enabling rapid policy optimization based on a variable step time advancement mechanism.Through theoretical analysis,it is proven that SPOMCP can generate the optimal strategies,and the computational complexity is exponentially correlated with the number of sub-goal nodes.Finally,simulation experiments demonstrate that SPOMCP outperforms the benchmark algorithm in terms of performance,with less than 89.18%of the benchmark algorithm's computation time,resulting in higher average rewards.

周鑫;陈子夷;周天

国防科技大学系统工程学院 长沙 410073国防科技大学系统工程学院 长沙 410073国防科技大学系统工程学院 长沙 410073

异步规划最简信息表示半马尔科夫环境蒙特卡洛树搜索

asynchronous planningsimplest information representationsemi-Markov environmentMonte Carlo tree search

《自动化学报》 2026 (1)

65-77,13

国家自然科学基金(72471234)资助 Supported by National Natural Science Foundation of China(72471234)

10.16383/j.aas.c250313

评论