大模型与智能机器人的融合:智能感知、导航与操作OA
Integration of Large Models and Intelligent Robots:Intelligent Perception,Navigation and Manipulation
系统梳理了大语言模型及多模态大模型赋能机器人智能感知、导航与操作的关键进展:在感知层面,通过多模态融合与语言-空间联合推理,增强了对环境语义与几何属性的深度理解;在导航层面,利用思维链任务分解与常识推理,实现了对模糊指令的解析与在未知环境中的自主探索;在操作层面,借助视觉-语言-动作模型与物理常识耦合,提升了复杂交互任务的灵巧性与适应性.研究表明,大模型的引入推动了机器人技术从"感知驱动"到"认知驱动"的范式转变,显著提升了系统的上下文推理与自主决策能力.然而,跨模态对齐精度、实时性能、安全可靠性及仿真到现实的泛化等核心问题仍有待突破.本文为构建通用化、认知增强的智能机器人系统提供了系统的技术参考与发展路线.
This survey systematically reviews key advancements in intelligent perception,navigation,and manipulation empowered by large language models and multimodal large models.At the perception level,deep understanding of environmental semantics and geometric attributes is enhanced through multimodal fusion and language-spatial joint reasoning.For navigation,techniques such as chain-of-thought task decomposition and commonsense reasoning enable the parsing of ambiguous instructions and autonomous exploration in unknown environments.In manipulation,the dexterity and adaptability for complex interactive tasks are improved by vision-language-action models coupled with physical commonsense.Research indicates that the introduction of large models drives a paradigm shift in robotics from"perception-driven"to"cognition-driven",significantly enhancing the system capabilities in contextual reasoning and autonomous decision-making.However,core challenges remain,including cross-modal alignment accuracy,real-time performance,safety,reliability,and Sim2Real generalization.A systematic technical reference and development roadmap are provided for building general-purpose,cognition-enhanced intelligent robotic systems.
谢远龙;李文龙;张友民;唐剑;周雪峰;郑世祺;杨恺伦;谢胜泉;王书亭
华中科技大学机械科学与工程学院,湖北 武汉 430074华中科技大学机械科学与工程学院,湖北 武汉 430074加拿大康考迪亚大学机械与航天航空学院,加拿大 蒙特利尔 H3G 1M8国家地方共建具身智能机器人创新中心,北京 101100广东省科学院智能制造研究所,广东 广州 510650中国地质大学(武汉)自动化学院,湖北 武汉 430074湖南大学机器人学院,湖南 长沙 410082英国利兹大学电子与电气工程学院,英国 利兹 LS2 9JT华中科技大学机械科学与工程学院,湖北 武汉 430074
智能机器人人工智能多模态大模型智能导航灵巧操作
intelligent robotartificial intelligencemultimodal large modelintelligent navigationdexterous manipulation
《机器人》 2026 (4)
745-767,792,24
国家自然科学基金(52275488,52575573,52205524,52188102)国家重点研发计划(2023YFB4703800).
评论