首页|期刊导航|计算机工程与应用|频域与空间域协同的生成对抗网络图像去雾算法

频域与空间域协同的生成对抗网络图像去雾算法OA

Frequency and Spatial Domain Synergistic Image Defogging Algorithm for Cycles-Consistent Generative Adversarial Networks

中文摘要英文摘要

目前的去雾方法依赖于有雾和无雾图像对,而这种近乎完美的数据获取非常困难,并且基于这种数据模型的学习结果在现实世界中具有较差的适应性和鲁棒性.因此基于域迁移思想,提出了频率与空间域协同的循环一致性生成对抗网络图像去雾算法(DWTF-CycleGAN).在生成器中构造基于离散小波变换的变压器模块DWT-Former,包含高频支路和低频支路;高频分支通过频域引导多头自注意机制对纹理和边缘信息赋予更高的权重.相反,低频分支包含低频子域和上部图像特征.高频支路输出通过跳接连接到上采样模块,低频支路输出直接进入编码过程的下一段.提出了一种使用自适应大气光值计算图像雾密度的方法,以评估雾分布情况.进一步,引入循环雾密度损失函数来约束生成器,使网络以除雾为优化目标,以减少域迁移过程中的偏差.实验结果表明,与目前主流的去雾算法相比,DWTF-CycleGAN去雾方法提高了平均梯度,FADE和NIQE值明显下降,图像细节变得丰富,去雾性得到改善.

Foggy weather degrades the quality of images acquired by imaging devices,further increasing the difficulty of advanced vision tasks.Current defogging methods rely on foggy and non-foggy image pairs,and acquiring near-perfect data is difficult.The learning results based on this data model are poor adaptability and robustness in the real world.Based on domain migration,the frequency and spatial domain synergistic cycles-consistent generative adversarial network image defogging algorithm(DWTF-CycleGAN)is proposed.A discrete wavelet transform-based Transformer module DWT-Former is constructed in the generator,containing high-frequency branches and low-frequency branches.The high-frequency branch assigns higher weights to texture and edge information through a frequency-domain guided multi-head self-attention mechanism.On the contrary,the low-frequency branch contains low-frequency subdomains and upper image features.The output of the high-frequency branch is connected to the upsampling module via a jumper,and the out-put of the low-frequency branch goes directly to the next segment of the encoding process.A method using adaptive atmo-spheric light estimation is proposed to compute image haze density for evaluating haze distribution.Furthermore,a cyclic haze density loss function is introduced to constrain the generator,guiding the network to focus on dehazing as the optimi-zation objective and to reduce deviations during the domain transfer process.Experimental results show that proposed fog removal method improves the average gradient compared to the current mainstream fog removal algorithms.The FADE and NIQE values decrease significantly,the image details become rich,and the defogging is improved.

赵亮;王华

西安建筑科技大学 信息与控制工程学院,西安 710055西安建筑科技大学 信息与控制工程学院,西安 710055

信息技术与安全科学

CycleGAN非成对图像去雾Transformer离散小波变换

CycleGANdefogging of unpaired imagesTransformerdiscrete wavelet transform

《计算机工程与应用》 2026 (12)

236-246,11

国家自然科学基金(51209167,52178393,51578447)陕西省创新能力支撑计划-创新团队(2020TD-005)陕西省杰出青年科学基金(2022JC-20)西安市科学家+工程师队伍建设项目(2024JH-KGDW-0112)陕西省自然科学基金面上项目(2024JC-YBMS-286)西安市科技计划项目(2023JH-GXRC-0216,2024JH-KGDW-0112).

10.3778/j.issn.1002-8331.2503-0331

评论