边缘信息与线描稿引导下的敦煌壁画多尺度特征修复网络OA
Multi-Scale Feature Inpainting Network of Dunhuang Murals Guided by Marginal Informa-tion and Line Drawings
为解决敦煌壁画图像修复过程中出现的修复结构不合理、纹理修复不一致的问题,提出一种结合边缘信息和线描稿共同引导的多尺度特征提取修复网络.为达到促进壁画结构修复合理的目的,设计第一阶段边缘信息预测网络,对Canny算法提取到的边缘信息以及线描稿信息传入线性可变形卷积与残差网络结合的预测网络中进行边缘提取预测,得到可以引导第二阶段图像修复的边缘预测图.为促进模型对纹理细节的理解,在第二阶段图像修复网络中,使用残差网络对壁画特征进行保留,同时设计多尺度特征提取模块与门控单元对壁画信息进行提取和筛选,并对提取到的壁画信息进行融合,进而完成对图像的修复.在霉斑掩码修复实验上与其他四种算法结果相对比,PSNR值提升5.457~13.411 dB,SSIM提升0.041~0.077,L2损失降低0.004~0.02.实验结果表明,所提模型在对比实验中的主客观评价指标上具有更好的表现性,能够得到结构和纹理更加合理化的修复结果.
To solve the problems of unreasonable repair structure and inconsistent texture inpainting that arise in the pro-cess of restoring Dunhuang mural images,this paper proposes a multi-scale feature extraction inpainting network that combines edge information and line drawings for guidance.In order to facilitate a rational repair of the mural structure,the paper designs a first stage edge information prediction network,in which the edge information extracted by the Canny algorithm and the line drawing information are input into a predictive network that combines linear deformable convolu-tion with a residual network for edge extraction predictions,resulting in an edge prediction map that can guide the second stage of image inpainting.To enhance the model's understanding of texture details in the second stage image inpainting network,a residual network is used to preserve mural features,while a multi-scale feature extraction module with gating units is designed to extract and filter mural information,which is then fused to complete the image repair.By comparing the results with four other algorithms in the mold spot mask repair experiment,the PSNR value improves by about 5.457~13.411 dB,the SSIM increases by about 0.041~0.077,and the L2 loss decreases by about 0.004~0.02.The experimental results indicate that the proposed model outperforms the comparison experiments in both subjective and objective evalua-tion metrics,achieving more rational inpainting results in terms of structure and texture.
曹岩;辛子昊;邬开俊
兰州交通大学 电子与信息工程学院,兰州 730070兰州交通大学 电子与信息工程学院,兰州 730070兰州交通大学 电子与信息工程学院,兰州 730070
信息技术与安全科学
敦煌壁画修复边缘信息线描稿多尺度特征提取
Dunhuang mural inpaintingedge informationline drawing draftcontext aggregation
《计算机工程与应用》 2026 (17)
261-269,9
甘肃省自然科学基金(23JRRA913)内蒙古自治区重点研发与成果转化计划项目(2023YFSH0043,2023YFDZ0043).
评论