条件扩散模型驱动的两阶段近红外图像着色方法OA
A two-stage near-infrared image colorization method driven by a conditional diffusion model
针对现有近红外图像着色方法输出结果普遍存在的亮度-色度混淆、纹理模糊及结构伪影几个问题,本文提出一种双阶段学习框架.第1阶段采用条件扩散模型,将近红外图像映射至与目标可见光彩色图像灰度分布对齐,且保留高频细节的中间灰度域;第2阶段复用成熟的预训练灰度图着色网络对第1阶段预测结果进行着色,实现高保真彩色图像重构.该策略有效解耦了亮度与纹理映射以及色彩重构过程,显著降低了对大规模近红外与可见光彩色图像配对样本的依赖.实验结果表明,在公开数据集上,所提出的双阶段学习框架在感知质量相关指标上表现出显著优势,其中弗雷歇初始距离和感知相似性指标分别达到36.03和0.369 6,均优于Multi-Fusion、MCF-Net、IR-Color、ColorMamba和RING这5种方法;同时在结构保真相关指标上与现有先进方法保持相当性能.
Existing near-infrared(NIR)image colorization methods often suffer from luminance-chrominance confu-sion,texture blurring,and structural artifacts in the generated results.To address these issues,this paper proposes a dual-stage learning framework.In the first stage,a conditional diffusion model is employed to map NIR images into an intermediate grayscale domain that is aligned with the grayscale distribution of target visible-light(VIS)color im-ages while preserving high-frequency details.In the second stage,a mature pre-trained grayscale image colorization network is reused to colorize the predictions from the first stage,enabling high-fidelity color image reconstruction.This strategy effectively decouples the luminance and texture mapping process from the color reconstruction process,significantly reducing the dependence on large-scale paired NIR and VIS color image samples.Experimental results on the public dataset demonstrate that the proposed dual-stage learning framework achieves significant advantages in perceptual quality-related metrics,with the Fréchet distance and perceptual similarity metrics reaching 36.03 and 0.369 6,respectively,outperforming the compared methods,while maintaining comparable performance to state-of-the-art approaches in structure fidelity-related metrics.subjective visual comparisons indicate that the proposed method produces better color consistency and texture detail preservation.
唐林瑞泽;刘澍民;陈捷
西北工业大学 航海学院,陕西 西安 710072西北工业大学 航海学院,陕西 西安 710072||西北工业大学深圳研究院,广东 深圳 518057西北工业大学 航海学院,陕西 西安 710072||西北工业大学深圳研究院,广东 深圳 518057
信息技术与安全科学
深度学习图像着色图像重构近红外光可见光条件扩散模型图像转换病态问题
deep learningimage colorizationimage reconstructionnear-infrared lightvisible lightcondi-tional diffusion modelimage translationill-posed problem
《哈尔滨工程大学学报》 2026 (5)
1117-1126,10
中央高校基本科研基金项目(G2023KY05108)国家自然科学基金青年项目(62201470).
评论