首页|期刊导航|北京测绘|思维链赋能多模态遥感影像云智能识别与修复

思维链赋能多模态遥感影像云智能识别与修复OA

Chain-of-thought-empowered intelligent cloud detection and restoration for multimodal remote sensing images

中文摘要英文摘要

为解决现有方法孤立处理遥感影像云检测与薄、厚云修复,缺乏统一推理框架的问题,本文提出基于思维链(CoT)的多模态遥感影像云智能处理模型.该模型将任务解耦为"云检测-薄云去除-厚云填补"三阶段:采用语义分割网络生成精准云掩膜并分类云厚;基于改进去噪扩散概率模型(DDPM)恢复薄云区域信息;通过流匹配(FM)生成模型融合合成孔径雷达(SAR)与光学数据完成厚云填补.基于湖南地区高分二号影像的定量与定性实验表明,该方法薄云去除峰值信噪比(PSNR)达30.3 dB、结构相似性指数(SSIM)达0.928、均方根误差(RMSE)为0.029,厚云填补PSNR达27.9 dB、SSIM达0.894、Fréchet初始距离(FID)低至25.4,均优于主流方法,实验验证了思维链框架的有效性与先进性,为复杂遥感影像云处理提供了高效连贯的技术方案.

To address the limitation of existing methods that isolate cloud detection and thin/thick cloud restoration in remote sensing images and lack a unified reasoning framework,this paper proposed a chain-of-thought(CoT)-based intelligent cloud processing model for multimodal remote sensing images.The model decomposed the task into three stages:"cloud detection,thin cloud removal,and thick cloud inpainting".First,a semantic segmentation network was adopted to generate precise cloud masks and classify cloud thickness;then,a modified denoising diffusion probabilistic model(DDPM)was employed to restore information in thin cloud regions;finally,thick cloud inpainting was completed by fusing synthetic aper-ture radar(SAR)and optical data through a flow matching(FM)-based generative model.Quantitative and qualitative experiments on Gaofen-2 imagery of the Hunan region demonstrate that for thin cloud removal,the proposed method achieves a peak signal-to-noise ratio(PSNR)of 30.3 dB,a structural similarity index(SSIM)of 0.928,and a root mean square error(RMSE)of 0.029;for thick cloud inpainting,it achieves a PSNR of 27.9 dB,an SSIM of 0.894,and a Fréchet inception distance(FID)as low as 25.4,all of which outperform mainstream methods.The results validate the effec-tiveness and advancement of the CoT framework,providing an efficient and coherent technical solution for cloud processing in complex remote sensing images.

唐先龙;童超南;王永凤;李冠良;杨阳;孙家阔

湖南师范大学,湖南 长沙 410009||湖南省第二测绘院,湖南 长沙 410009||自然资源部南方丘陵区自然资源监测监管重点实验室,湖南 长沙 410009北京数慧时空信息技术有限公司,北京 100070||山东省黄河流域土壤修复技术创新中心,山东 济南 250014北京数慧时空信息技术有限公司,北京 100070||山东省黄河流域土壤修复技术创新中心,山东 济南 250014北京数慧时空信息技术有限公司,北京 100070||山东省黄河流域土壤修复技术创新中心,山东 济南 250014湖南省第二测绘院,湖南 长沙 410009||自然资源部南方丘陵区自然资源监测监管重点实验室,湖南 长沙 410009北京数慧时空信息技术有限公司,北京 100070||山东省黄河流域土壤修复技术创新中心,山东 济南 250014

天文与地球科学

遥感影像思维链多模态数据云检测去噪扩散概率模型(DDPM)流匹配(FM)合成孔径雷达(SAR)

remote sensing imagechain-of-thoughtmultimodal datacloud detectiondenoising diffusion probabilistic model(DDPM)flow matching(FM)synthetic aperture radar(SAR)

《北京测绘》 2026 (6)

765-771,7

湖南省科技创新计划(2025RC3235)

10.19580/j.cnki.1007-3000.2025120027

评论