首页|期刊导航|智能系统学报|基于多尺度协调卷积与自适应加权的红外与可见光图像融合

基于多尺度协调卷积与自适应加权的红外与可见光图像融合OA

Infrared and visible image fusion based on multi-scale coordinated convolution and adaptive weighting

中文摘要英文摘要

针对当前基于卷积神经网络的图像融合模型在全局信息感知、高频细节保持及损失函数权重设定上的局限性,提出一种集成卷积和多层感知器架构的多尺度协调网络,以实现红外与可见光图像的高质量融合.提出一种卷积加权重排多层感知器模块,通过模拟特征排列增强空间维度理解,并结合自适应特征重加权机制有效整合全局信息.同时,提出多尺度协调卷积模块,利用中心差分卷积增强高频信息的保留能力,并通过多尺度并行子网络优化多层次特征表达;其内嵌的坐标注意力机制,通过通道-空间联合调制强化互补信息并抑制冗余特征.此外,还提出一种数据驱动的自适应权重策略,基于图像特征统计量动态调整监督信号的贡献度,降低调参复杂性并提升损失函数的自适应性.在RoadScene、TNO和M3FD这3个公开数据集上的实验结果表明,本文算法生成的融合图像在边缘保持、纹理过渡方面表现更优,且在信息熵、标准差、空间频率、视觉信息保真度和平均梯度等指标上全面超越主流融合方法,为红外与可见光图像融合提供了新的思路,为图像融合领域的进一步发展打下了坚实的基础.

To address the limitations of convolution neural networks-based image fusion models,such as restricted glob-al information perception,high-frequency detail preservation,and the loss function weights configuration,this article proposes a convolution and multilayer perceptron-integrated multiscale coordinate network(CM-MCNet)for high-qual-ity infrared and visible image fusion.In the encoder of CM-McNet,a convolutional weighted permute multilayer per-ceptron module is introduced to enhance spatial understanding by simulating feature permutation and integrates an ad-aptive feature reweighting mechanism to effectively capture global information.Meanwhile,a multiscale coordinate convolution(MsCConv)module is designed,leveraging the advantages of central difference convolution to enhance the retention and expression of high-frequency details.By incorporating multiscale parallel sub-networks,MsCConv en-sures the comprehensive preservation of multi-level features.Moreover,the embedded coordinate attention mechanism jointly modulates channel and spatial dimensions,enhancing complementary information while suppressing redundancy.Furthermore,a data-driven adaptive loss weighting strategy is proposed,which can dynamically adjust the contribution of supervision signals based on image feature statistics.This reduces the complexity of hyperparameter tuning while en-suring the loss function more accurately reflects the characteristics of the source images.Experimental results on the RoadScene,TNO,and M3FD public datasets demonstrate that CM-MCNet generates fused images with sharper edge preservation and more natural texture transitions.Additionally,our method achieves superior performance across vari-ous objective metrics,including information entropy,standard deviation,spatial frequency,visual information fidelity,and average gradient,outperforming existing state-of-the-art fusion methods.This work provides a novel perspective for infrared and visible image fusion and lays a solid foundation for further advancements in the field.

刘诗怡;刘金平;黄丽娟;蒋嘉豪;宋殿义;杨广益

湖南师范大学信息科学与工程学院,湖南长沙 410081湖南师范大学信息科学与工程学院,湖南长沙 410081湖南省智能康复机器人与辅助设备工程技术研究中心,湖南长沙 410004湖南师范大学信息科学与工程学院,湖南长沙 410081国防科技大学军政基础教育学院,湖南长沙 410072湖南省计量检测院,湖南长沙 410081

信息技术与安全科学

图像融合红外图像可见光图像多尺度协调卷积卷积加权重排多层感知器坐标注意力自适应权重

image fusioninfrared imagevisible imagemultiscale coordinate convolutionconvolutional multilayer perceptroncoordinate attentionadaptive weighting

《智能系统学报》 2026 (1)

95-108,14

国家自然科学基金项目(62371187)湖南省自然科学基金项目(2024JJ8309).

10.11992/tis.202504002

评论