首页|期刊导航|计算机科学与探索|从语言到动作:大型语言模型赋能的机器人操纵范式综述

从语言到动作:大型语言模型赋能的机器人操纵范式综述OA

From Language to Action:Survey of LLM-Driven Robotic Manipulation Paradigms

中文摘要英文摘要

编程复杂、泛化能力弱及高度依赖专家等是传统机器人控制范式在非结构化场景中面临的瓶颈问题,对大型语言模型(LLM)赋能机器人控制这一新兴领域的研究现状与技术路径进行了系统性梳理.陈述了传统机器人范式在指令、数据和知识层面存在的三大鸿沟,而LLM凭借其语义理解、常识推理及代码生成等基础能力,为构建统一的机器人认知核心提供了有效路径.研究的核心工作在于对当前从语言到动作的三种主流技术范式进行了归纳与深度对比,相较现有综述多侧重语言理解、视觉感知、运动控制划分,进一步突出不同范式在物理世界接地与执行反馈闭环方面的差异:(1)以符号化动作序列为输出的高层规划器范式,其在可靠性与可解释性上具备优势;(2)以生成可执行程序为核心的代码生成器范式,其显著提升了处理复杂逻辑与长时程任务的灵活性;(3)以直接映射感知到动作的端到端策略范式,其在构建通用物理智能体方面展现了巨大潜力.系统梳理并纳入近年来端到端视觉-语言-动作策略的相关进展,以提升综述的覆盖范围与时效性.系统性地辨析了当前领域在物理世界接地、安全性与可靠性、动态反馈与闭环控制以及实时性与计算效率等方面面临的核心技术挑战.结论指出,LLM正驱动机器人控制向以自然语言为核心的意图驱动模式发生深刻转变,未来的研究将主要聚焦于多模态具身智能的深度融合、从被动执行到人机主动协作的演进,以及模型在边缘设备上的高效部署.

Traditional robot control in unstructured environments is often hindered by programming complexity,limited generalization,and heavy reliance on domain experts.This paper provides a systematic review of robot control empowered by large language models(LLMs),summarizing recent progress and major technical pathways.This paper first identifies the"three gaps"in instruction,data,and knowledge that constrain traditional paradigms,and discusses how LLMs enable the construction of a unified cognitive core for robotics through semantic understanding,commonsense reasoning,and code generation.The main contribution is an in-depth synthesis and comparison of three mainstream language-to-action paradigms.Unlike prior surveys that are commonly organized by functional modules(language understanding,visual per-ception,and motion control),this paper emphasizes the differences among paradigms in physical-world grounding and execution-feedback closed-loop mechanisms.Specifically,this paper reviews:(1)high-level planners that output symbolic action sequences and offer reliability and interpretability;(2)code generators that produce executable programs and improve flexibility for complex logic and long-horizon tasks;and(3)end-to-end policies that directly map perception to actions and show strong potential for building generalist physical agents.Meanwhile,this paper systematically reviews and incorporates recent progress on end-to-end vision-language-action policies,thereby improving the coverage and time-liness of the survey.This paper further analyzes key challenges,including grounding,safety and reliability,dynamic feed-back and closed-loop control,and real-time performance versus computational efficiency.This paper concludes that LLMs are reshaping robot control toward an intent-driven paradigm centered on natural language,and outlines future direc-tions in multimodal embodied intelligence,proactive human-robot collaboration,and efficient edge deployment.

蒋世奇;张定祈;顾硕鑫;朱育沛;彭海

成都信息工程大学 自动化学院,成都 610225||成都信息工程大学 机器人与智能系统国际联合研究中心,成都 610225成都信息工程大学 自动化学院,成都 610225成都信息工程大学 自动化学院,成都 610225||成都信息工程大学 机器人与智能系统国际联合研究中心,成都 610225成都信息工程大学 自动化学院,成都 610225成都信息工程大学 自动化学院,成都 610225

信息技术与安全科学

大型语言模型机器人控制具身智能任务规划人机交互

large language modelsrobot controlembodied intelligencetask planninghuman-robot interaction

《计算机科学与探索》 2026 (9)

2469-2483,15

四川省自然科学基金青年基金(2024NSFSC1425)四川省自然科学基金面上项目(2024NSFSC0522). This work was supported by the Sichuan Provincial Natural Science Foundation Youth Fund(2024NSFSC1425),and the Natural Science Foundation of Sichuan Province(2024NSFSC0522).

10.3778/j.issn.1673-9418.2510037

评论