首页|期刊导航|信息通信技术与政策|克服人工神经网络灾难性遗忘的连续学习算法研究

克服人工神经网络灾难性遗忘的连续学习算法研究OA

Research on continual learning method for overcoming catastrophic forgetting of artificial neural networks

中文摘要英文摘要

传统的人工神经网络训练通常聚焦于封闭、静态的独立同分布数据,并在完成离线训练后执行单一任务.然而,当数据分布随环境不断变化时,模型会忘记在先前任务中学到的知识,即发生"灾难性遗忘".连续学习作为一个新的学习范式,旨在赋予模型从分布不断变化的数据流中持续学习、累计和巩固知识的能力,使得人工神经网络达到"稳定性-可塑性"平衡,进而克服灾难性遗忘.通过深入分析当前连续学习算法的主要特点,搭建真实机器人实物验证平台,在机器人实物抓取场景下验证连续学习算法的有效性.试验结果表明,将对比相关性保留回放算法应用到机器人实物抓取任务,抓取任务的平均准确率提高26.67%,能更好地帮助机器人执行目标任务.

Traditional artificial neural network training typically focuses on closed,static,independent and identically distributed data,and performs a single task after completing offline training.However,when the data distribution continuously changes with the environment,the model will forget the knowledge learned from previous tasks,a phenomenon known as"catastrophic forgetting".As an emerging learning paradigm,continual learning aims to endow models with the ability to continuously learn,accumulate,and consolidate knowledge from data streams with constantly changing distributions.This enables artificial neural networks to achieve a"stability-plasticity"balance,thereby overcoming catastrophic forgetting.Through in-depth analysis of the key characteristics of current continual learning algorithms,a real-world robotic physical verification platform was established.The effectiveness of continual learning algorithms was verified in the scenario of robotic physical object grasping.Experimental results show that when the Contrastive Correlation Preserving Replay(CCPR)algorithm is applied to the robotic physical object grasping task,the average accuracy of the grasping task increases by 26.67%,better assisting the robot in performing the target task.

于达;董晓飞;曹峰;查富生;孙立宁

中国信息通信研究院人工智能研究所,北京 100191||人工智能关键技术和应用评测工业和信息化部重点实验室,北京 100191中国信息通信研究院人工智能研究所,北京 100191||人工智能关键技术和应用评测工业和信息化部重点实验室,北京 100191中国信息通信研究院人工智能研究所,北京 100191||人工智能关键技术和应用评测工业和信息化部重点实验室,北京 100191哈尔滨工业大学机器人技术与系统全国重点实验室,哈尔滨 150000哈尔滨工业大学机器人技术与系统全国重点实验室,哈尔滨 150000

信息技术与安全科学

人工智能人工神经网络连续学习灾难性遗忘

artificial intelligenceartificial neural networkscontinual learningcatastrophic forgetting

《信息通信技术与政策》 2026 (1)

75-83,9

10.12267/j.issn.2096-5931.2026.01.010

评论