首页|期刊导航|计算机工程与应用|神经网络滤波器剪枝技术研究综述

神经网络滤波器剪枝技术研究综述OA

Survey of Neural Network Filter Pruning Technology

中文摘要英文摘要

随着软硬件资源水平和计算能力的提高,深度神经网络在计算机视觉、自然语言处理、图像生成等多个领域迅速发展,引领深度学习在自动驾驶、医疗诊断等方向上不断突破.然而,随着模型深度的增加,庞大的参数量和计算资源消耗导致模型变得过于复杂,难以在资源受限的环境进行训练和部署.为了减少网络模型的复杂度,提高模型的效率,研究者们提出了剪枝方法,通过减少模型中的冗余参数和连接实现模型的压缩和加速.滤波器剪枝是优化卷积神经网络的重要方法之一,通过改变网络中滤波器组和特征通道的数目来加速网络,且不依赖于特定算法或硬件平台.梳理了近年来国内外滤波器剪枝技术的研究进展,从滤波器重要性评估、剪枝及微调方式设计两个方面进行分类总结,并对主流滤波器剪枝方法的实验进行归纳,分析滤波器剪枝对模型精度和参数量的影响,并对未来的研究方向加以探讨.

With the improvement of software and hardware resources and computing capabilities,deep neural networks have rapidly developed in various fields such as computer vision,natural language processing,and image generation,leading to breakthroughs in areas such as autonomous driving and medical diagnosis through deep learning.However,as the depth of the model increases,the large number of parameters and the consumption of computing resources cause the model to become too complex to train and deploy in resource-constrained environments.To reduce the complexity of network models and improve their efficiency,researchers have proposed pruning methods to compress and accelerate models by reducing redundant parameters and connections.Filter pruning is one of the most important methods to optimize convolu-tional neural networks.It mainly changes the number of filter groups and feature channels to accelerate the network and does not depend on specific algorithm or hardware platform.So the paper reviews the research progress of filter pruning technology at home and abroad in recent years,classifies and summarizes the filter importance evaluation,pruning and fine-tuning mode design,and summarizes the experiments of the mainstream filter pruning methods to analyze the influ-ence of filter pruning on model accuracy and parameter number,and also discusses the future research direction.

王琳;宋权润;耿世超;栾钟治

山东师范大学 信息科学与工程学院,济南 250358山东师范大学 信息科学与工程学院,济南 250358山东师范大学 新闻与传媒学院,济南 250358北京航空航天大学计算机学院,北京 100191

信息技术与安全科学

深度学习深度卷积神经网络模型压缩滤波器剪枝模型优化加速

deep learningdeep convolutional neural networkmodel compressionfilter pruningacceleration of model optimization

《计算机工程与应用》 2026 (2)

1-25,25

国家自然科学基金(62102237)山东省重点研发计划(科技型中小企业创新能力提升工程)项目(2024TSGC0142).

10.3778/j.issn.1002-8331.2503-0280

评论