基于扩散薛定谔桥的SAR到光学图像转换方法OA
A New Model of Translating SAR into Optical Images Based on Diffusion Schrödinger Bridge
针对SAR图像判读难度大的问题,提出一种SAR到光学图像转换新模型,模型训练不依赖严格配准的数据集,经模型转换后的图像可辅助完成SAR图像判读任务.该模型基于扩散薛定谔桥理论将SAR到光学图像间的复杂转换关系分解为多步递进生成过程,通过嵌入AD-DPM降噪预处理模块消除相干斑噪声对特征提取的影响,利用ViT-UNet生成器深度提取图像特征,在损失函数中增加PatchNCE正则化项提高生成过程中的图像底层结构保持能力.在SEN1-2数据集上对本文方法进行评估,实验结果表明,该方法可以转换生成符合视觉感知的光学图像,与尺度方法CUT相比,PSNR、SSIM、FID和LPIPS 4项指标分别提升了 38.4%、42.2%、30.6%和21.0%,能够为SAR图像的高效精准判读提供参考.
In view of the problem that effective interpretation of SAR images is extremely difficult,this paper pro-poses a new model of translating SAR into optical images.The model is very unlike the existing methods relying on strictly aligned datasets for training,and does not depend on such preconditions,enabling the generation of images to assist in the interpretation tasks associated with SAR imagery.And the proposed method is to utilize the diffu-sion Schroinger bridge theory for decomposing the complex transformation relationships between SAR and optical images into multi-step generative processes.Through mitigating the impact of coherent spot noise(CSN)on feature extraction,an AD-DPM denoising preprocessing module is incorporated into the model.Furthermore,a ViT-UNet generator is employed for deep feature extraction,while incorporating PatchNCE regularization terms into the loss function to enhance the preservation of underlying structural components during the generation process.The exper-iments conducted by using the SEN1-2 dataset demonstrate that the proposed method can effectively convert SAR images into high-quality optical images that align with visual perception standards.Compared to the baseline meth-od CUT,the PSNR、SSIM、FID and LPIPS metrics improved by 38.4%、42.2%、30.6%and 21.0%,respectively.These results provide a valuable reference for improving the efficient and accurate interpretation of SAR images.
贠相亚;董恩志;左晓桐;赵月飞;王长龙
陆军工程大学石家庄校区,石家庄,050003||71901部队,山东聊城,252000陆军工程大学石家庄校区,石家庄,050003陆军工程大学石家庄校区,石家庄,050003陆军工程大学石家庄校区,石家庄,050003陆军工程大学石家庄校区,石家庄,050003
信息技术与安全科学
SAR图像光学图像图像转换辅助判读
SAR imageoptical imageimage to image translationsupportive interpretation
《空军工程大学学报》 2026 (2)
110-119,10
基础加强计划领域基金(2019-JCJQ-JJ-05)
评论