类增量学习研究进展OA
Recent advances in class-incremental learning
类增量学习要求模型在学习新类别的同时保持对已学类别的判别能力,但训练过程中易发生灾难性遗忘.本文系统综述与分析类增量学习及其发展趋势:阐述类增量学习的基本定义,厘清其与其他增量学习设定的区别;从记忆回放、参数与优化约束、模型预测校正、模型结构设计、预训练模型迁移五个维度,对主流的方法进行分类总结;进一步梳理类增量学习常用的评价指标和数据集,总结其在图像生成、目标检测、语义分割等典型视觉任务,以及在视频理解、三维视觉等新兴领域中的应用情况;最后对类增量学习的未来研究方向进行展望.
CIL(class-incremental learning)aims to enable models to maintain discriminative ability on previously learned classes while incrementally acquiring new ones,a process in which catastrophic forgetting often occurs.This paper provided a comprehensive survey and analysis of CIL and its development trends.It clarified the definition of CIL and distinguished it from other incremental learning settings.Mainstream approaches were categorized and summarized from five perspectives:memory replay,parameter and optimization constraints,model prediction calibration,model architecture design,and transfer of pre-trained models.In addition,the commonly used evaluation metrics and datasets of CIL were reviewed,and its applications in typical vision tasks such as image generation,object detection,and semantic segmentation,as well as in emerging areas including video understanding and 3D vision were summarized.Finally,the future research directions of CIL were prospected.
张文卓;徐昕;蒯杨柳;崔家宝;丁智勇;谢旭辉
国防科技大学智能科学学院,湖南长沙 410073国防科技大学智能科学学院,湖南长沙 410073国防科技大学智能科学学院,湖南长沙 410073国防科技大学智能科学学院,湖南长沙 410073国防科技大学智能科学学院,湖南长沙 410073国防科技大学智能科学学院,湖南长沙 410073
信息技术与安全科学
类增量学习灾难性遗忘记忆回放参数与优化约束模型预测校正模型结构设计预训练模型迁移
class-incremental learningcatastrophic forgettingmemory replayparameter and optimization constraintsmodel prediction calibrationmodel architecture designtransfer of pre-trained models
《国防科技大学学报》 2026 (3)
316-338,23
国家自然科学基金资助项目(62403485)
评论