基于注意力机制的多视觉任务混合学习策略OA
A Mixed Learning Strategy for Multi-visual Tasks Based on Attention Mechanism
随着计算机视觉任务复杂度和数据规模的增加,单任务的视觉模型往往容易忽略其他任务的特征信息,导致训练冗余并且模型泛化能力较差.针对上述问题,提出一种结合注意力机制的多视觉任务混合学习策略,在多任务进行特征共享的同时,也能提取各自任务的关键特征.同时提出了一种自适应加权方案,防止个别任务在多任务学习中占据主导地位,使所有参与学习的任务都能得到更好的收敛.在公开的PASCAL VOC07+12、miniImageNet等数据集上的实验表明,该策略对比单任务基线模型,预测精度在图像分类、图像检测问题上分别提升了1.7%和2.9%,模型参数量减少了48.2%,解决了常规多任务学习在计算机视觉领域应用中的参数冗余和收敛不平衡等问题.
With the increase of computer vision task complexity and data scale,single-task vision models tend to ignore the feature information of other tasks,resulting in redundant training and poor model generalization ability.In response to these prob-lems,this method proposes a mixed learning strategy for multi-visual tasks based on attention mechanism,so that the model en-ables to extract the key features of each task while sharing features in multiple tasks.At the same time,this method proposes an adaptive weighting scheme to prevent individual tasks from dominating the multi-task learning,so that all the tasks involved in the learning can be better converged.Experiments on the public data sets such as PASCAL VOC 07+12 and miniImageNet show that compared with the single-task baseline model,the prediction accuracy of this strategy is improved by 1.7%and 2.9%in image clas-sification and image detection,respectively,and the amount of model parameters is reduced by 48.2%.This method solves the prob-lems of parameter redundancy and convergence imbalance in the application of conventional multi-task learning in the field of com-puter vision.
王康;施必成;顾越;阮俊豪
南京烽火天地通信科技有限公司 南京 210019南京烽火天地通信科技有限公司 南京 210019南京烽火天地通信科技有限公司 南京 210019南京烽火天地通信科技有限公司 南京 210019||武汉邮电科学研究院 武汉 430074
信息技术与安全科学
多任务学习注意力机制卷积神经网络自适应任务权重
multi-task learningattention mechanismconvolution neural networkadaptive weight
《计算机与数字工程》 2026 (3)
595-600,622,7
国家重点研发计划项目(编号:2017YFB1400704)资助.
评论