基于Swin-UNet的破损碑刻文字识别方法OA
A Character Recognition Method for Damaged Inscriptions Based on Swin-UNet
提出了基于Swin-UNet的破损碑刻文字识别方法.为了能够获取准确的碑刻文字信息,采用Swin Transformer结构代替U-Net结构在分割任务中的下采样和上采样过程,并在其中添加了优化融合特征信息的注意力模块CBAM与SENet模块,同时使用带权重的交叉熵损失函数对损失函数进行优化.自然场景下的碑刻文字往往会受到各种各样的损害,故之后在数据集的基础上建立文字的语义分割数据库,同时设计算法对缺损的碑刻文字基于数据库进行识别.实验表明,在真实碑刻图片中,文字缺失2个笔画以内,识别正确率为32.60%,识别结果前5个文字中有正确的汉字视为识别正确的概率为64.20%,识别结果前10个文字中有正确的汉字视为识别正确的概率为77.20%.所提方法相较于其他的语义分割模型对笔画的分割更为准确,效果更好.
This paper presents a method for recognizing damaged stone inscription characters based on Swin-UNet.To accurately extract textual information from stone inscriptions,the Swin transformer ar-chitecture is employed to replace the down-sampling and up-sampling processes of the original U-Net structure in the segmentation task.The CBAM(Convoluted Basin Aggregation Module)and SENet mod-ules are integrated to optimize the feature fusion.The loss function is also refined using a weighted cross-entropy loss.Stone inscription characters in natural environments often suffer from various forms of degra-dation.Consequently,a semantic segmentation database for these characters is constructed based on real-world data sets,and an algorithm is designed to identify damaged characters by leveraging this database.Experimental results demonstrate that on real stone inscription images,the recognition accuracy reaches 32.60%for missing up to two strokes,64.20%when identifying the first five correct characters,and 77.20%for the first ten characters.Compared with other semantic segmentation models,the proposed method achieves more accurate stroke-level segmentation and yields superior performance.
李晓亮;李光亚;孟志琳
中北大学信息与通信工程学院,山西 太原 030051中北大学信息与通信工程学院,山西 太原 030051中北大学信息与通信工程学院,山西 太原 030051
信息技术与安全科学
碑刻文字文字识别Swin TransformerU-Net语义分割
stone inscription characterscharacter recognitionSwin TransformerU-Netsemantic segmenta-tion
《机械与电子》 2026 (1)
28-34,7
科技部国家重点研发计划(2020YFB2009102)
评论