首页|期刊导航|测试科学与仪器|基于混合Mamba-Transformer架构与交叉注意力引导的遥感语义变化检测

基于混合Mamba-Transformer架构与交叉注意力引导的遥感语义变化检测OA

Remote sensing semantic change detection via hybrid Mamba-Transformer architecture and cross-attention guidance

中文摘要英文摘要

遥感语义变化检测(Semantic change detection,SCD)旨在同时识别双时相图像中的变化区域并确定其语义类别.在实际应用中,遥感图像易受光照波动和季节性植被演替等无关环境因素干扰,常导致传统模型产生伪变化检测或语义误分类.为应对这些挑战,提出了一种新型Mamba-Transformer混合双支路架构,旨在平衡全局上下文建模效率与细粒度特征提取精度.首先,编码器引入了Vision Mamba模块,利用其线性复杂度的长序列建模能力,有效捕捉大尺度地物的时空依赖关系.其次,为缓解光照变化和植被生长引起的特征漂移,设计了交叉注意力引导融合模块.该模块通过计算双时相特征间的相关性,动态增强与真实变化相关的特征响应,同时抑制环境噪声.最后,解码器集成Transformer自注意力机制,进一步细化复杂场景下的地物边界勾勒.在SECOND和Landsat-SCD数据集上进行的实验结果显示,该方法在SECOND数据集上达到了73.85%mIoU和23.12%SeK,在Landsat-SCD数据集上达到了 96.15%的总体精度.实验结果证实,该模型较主流基准模型具有显著性能优势,验证了所提混合架构在增强环境鲁棒性和语义一致性方面的核心贡献.Mamba的全局建模能力与Transformer的局部细化机制相结合,为复杂环境条件下的大规模遥感监测提供了一种稳健的解决方案,能够从噪声背景中有效提取关键变化信息并保持高精度的边界定位.

Semantic change detection(SCD)in remote sensing aims to identify change regions and recognize semantic categories between bi-temporal images simultaneously.In practical applications,remote sensing images are often susceptible to irrelevant environmental factors such as illumination fluctuations and seasonal vegetation succession,which frequently lead traditional models to pseudo-change detections or semantic misclassifications.To address these challenges,we propose a novel hybrid Mamba-Transformer dual-branch architecture designed to balance efficiency of global context modeling with precision of fine-grained feature extraction.Specifically,vision Mamba blocks are incorporated into encoder stage to leverage their ability to model long sequences with linear complexity,effectively capturing spatiotemporal dependencies of ground objects across large scales.Furthermore,to mitigate feature drift caused by illumination variations and vegetation growth,a cross-attention-guided fusion module is introduced.By calculating correlation between bi-temporal features,this module dynamically enhances feature responses associated with genuine changes while suppressing environmental noise.Finally,decoder integrates Transformer self-attention mechanism to further refine delineation of object boundaries in complex scenes.Extensive experiments were conducted on SECOND and Landsat-SCD datasets to evaluate proposed method.On SECOND dataset,HMTNet achieved 73.85%mIoU and 23.12%SeK,while on Landsat-SCD dataset,it yielded 96.15%overall accuracy.Results confirmed significant performance advantages over mainstream baselines and validated core contributions of proposed hybrid architecture in enhancing environmental robustness and semantic consistency.Integration of Mamba's global modeling and Transformer's local refinement provides a robust solution for large-scale remote sensing monitoring under varying environmental conditions,effectively distilling change-relevant information from noisy backgrounds while maintaining high-fidelity boundary localization.

陈国俊;贶骏尧;葛洪伟

无锡太湖学院 物联网工程学院,江苏 无锡 214064江南大学 人工智能与计算机学院,江苏 无锡 214122江南大学 人工智能与计算机学院,江苏 无锡 214122

语义变化检测Mamba架构Transformer交叉注意力遥感影像处理环境鲁棒性

semantic change detection(SCD)Mamba architectureTransformercross-attentionremote sensing image processingenvironmental robustness

《测试科学与仪器》 2026 (3)

407-420,14

This work was supported by National Natural Science Foundation of China(No.52374155).

10.62756/jmsi.1674-8042.2026035

评论