基于MSR-OverLoCK的唐卡图像识别OA
Tangka Image Recognition Based on MSR-OverLoCK
唐卡作为藏族传统绘画艺术的重要载体,具有构图复杂、细节丰富、类间差异微小等视觉特征,给自动识别带来了巨大挑战.针对这一问题,该文提出了一种基于改进的OverLoCK 网络模型,用于唐卡图像的精细化识别.该模型在Over-LoCK 全局-局部协同框架的基础上进行了三方面的关键改进:首先,在 Base-Net 中引入多尺度门控注意力模块(MSGA),通过多分支并行卷积结构捕获不同尺度的特征信息,并结合 SE 注意力机制实现自适应特征融合,增强了网络对多尺度纹理细节的提取能力;其次,将 Base-Net 中的 ConvFFN 替换为 MK-ConvGLU 模块,提升了模型对局部细节的感知能力;最后,在 Focus-Net 中引入聚合注意力特征增强模块(AAFE),实现对关键区域的精准定位和特征增强.在唐卡数据集上的对比实验表明,MSR-OverLoCK 相比基础 OverLoCK 模型,准确率从 93.23%提升至 96.85%,F1 值从 92.40%提升至 96.11%,显著优于 ResNet-50、ConvNeXt-T、Swin Transformer 等主流模型,验证了所提改进策略的有效性,为唐卡图像的智能识别与文化遗产数字化保护提供了可行的技术方案.
As an important carrier of Tibetan traditional painting art,Thangka exhibits visual characteristics such as complex composition,rich details,and slight inter-class differences,posing significant challenges to automatic recognition.To address this issue,we propose an improved OverLoCK network model for refined recognition of Thangka images.Based on the global-local collaborative framework of OverLoCK,the model incorporates three key improvements.Firstly,a Multi-Scale Gated Attention(MSGA)module is introduced into the Base-Net,which captures multi-scale feature information through a multi-branch parallel convolution structure and achieves adaptive feature fusion combined with the SE attention mechanism,enhancing the network's ability to extract multi-scale texture details.Second-ly,the ConvFFN in the Base-Net is replaced with the MK-ConvGLU module,improving the model's perception of local details.Finally,an Aggregated Attention Feature Enhancement(AAFE)module is integrated into the Focus-Net to realize accurate localization and fea-ture enhancement of key regions.Comparative experiments on the Thangka dataset show that compared with the baseline OverLoCK model,MSR-OverLoCK achieves an accuracy increase from 93.23%to 96.85%and an F1 improvement from 92.40%to 96.11%,out-performing mainstream models such as ResNet-50,ConvNeXt-T,and Swin Transformer significantly.These results verify the effective-ness of the proposed improvement strategies,providing a feasible technical solution for the intelligent recognition of Thangka images and the digital protection of cultural heritage.
王雪晴;史伟;白科
宁夏大学 信息工程学院,宁夏 银川 750021宁夏大学 信息工程学院,宁夏 银川 750021宁夏大学 信息工程学院,宁夏 银川 750021
信息技术与安全科学
唐卡图像识别MSR-OverLoCK多尺度特征融合注意力机制文化遗产数字化保护
Thangka image recognitionMSR-OverLoCKmulti-scale feature fusionattention mechanismdigital preservation of cultur-al heritage
《计算机技术与发展》 2026 (9)
45-53,9
国家自然科学基金项目(62166030)
评论