参考图像引导与风格增强的古壁画图像修复方法OA
A Reference Image-Guided and Style-Enhanced Restoration Method for Ancient Mural Images
针对现有深度学习方法在古壁画图像修复过程中仅依赖自身先验信息、缺乏外部特征信息引导,导致修复结果易出现语义不一致与细节模糊问题,提出一种参考图像引导与风格增强的古壁画图像修复方法.首先,构建壁画图像修复主干网络,设计基于自适应跨尺度卷积的壁画特征编码模块,跨尺度提取壁画内容特征,增强模型细节修复能力.其次,设计风格特征编码模块,通过其学习并提取参考壁画图像不同尺度的风格特征.接着,设计特征对齐融合模块,将壁画图像修复网络编码器提取的壁画内容特征与参考壁画图像风格特征进行对齐并融合,作为外部风格特征引导信息.然后,构建风格感知增强模块,对融合后的风格特征进一步细化,同时在修复网络解码部分设计动态特征引导层,引导模型解码修复过程,提升修复结果的语义一致性,输出修复后壁画图像.最后,在敦煌壁画数集上进行修复实验,并采用峰值信噪比与结构相似性指数客观评价指标进行量化分析.结果表明,所提方法能够有效完成破损壁画图像的修复,且主客观评价结果优于比较方法.
To address the issues of semantic inconsistency and detail blurring in the restoration of ancient mural images using existing deep learning methods,which often solely rely on their own internal prior information and lack external feature guidance,this paper proposes a reference image-guided and style-enhanced restoration method for ancient mural images.First,a backbone network for mural image restoration was constructed,along with a mural feature encoding module based on adaptive cross-scale convolution,which extracts mural content features across scales,thereby enhancing the model's ability to restore fine details.Second,a style feature encoding module was designed to learn and extract multi-scale style features from reference mural images.Third,a feature alignment and fusion module was introduced to align and fuse the mural content features extracted by the encoder of the mural image restoration network with the style features of the reference mural image,serving as external style feature gui-dance.Fourth,a style perception enhancement module was constructed to further refine the fused style features.Meanwhile,a dynamic feature guidance layer was designed within the decoding part of the restoration network to guide the restoration process,improving the semantic consistency of the final restored mural image.Finally,restora-tion experiments were conducted on the Dunhuang mural dataset.Quantitative analysis was performed using Peak Signal-to-Noise Ratio(PSNR)and Structural Similarity Index Measure(SSIM)as objective evaluation metrics.The results indicate that the proposed method can effectively restore the damaged mural images,achieving superior per-formance in both objective and subjective evaluations compared with competing methods.
陈永;张世龙;范志欣
兰州交通大学 电子与信息工程学院,甘肃 兰州 730070兰州交通大学 电子与信息工程学院,甘肃 兰州 730070兰州交通大学 电子与信息工程学院,甘肃 兰州 730070
信息技术与安全科学
壁画图像修复参考图像引导风格增强特征对齐融合引导修复
mural image restorationreference image guidancestyle enhancementfeature alignment and fu-sionguided restoration
《华南理工大学学报(自然科学版)》 2026 (5)
28-36,9
国家自然科学基金项目(62462043,61963023)甘肃省创新之星项目(2025CXZX-680)Supported by the National Natural Science Foundation of China(62462043,61963023)and the Innovation Star Project Fund of Gansu Province(2025CXZX-680)
评论