面向TDI CCD噪声建模的物理引导深度神经网络OA
Physics-guided deep neural network for TDI CCD noise modeling
时间延迟积分CCD(Time Delay Integration CCD,TDI CCD)在遥感成像领域应用广泛,由于其存在暗电流、复位噪声及量化噪声等复杂噪声源,导致现有方法难以表征微光环境下真实传感器中的信号无关性噪声分布.针对该问题,提出一种面向TDI CCD噪声建模的物理引导深度神经网络(Physics-guided Deep Neural Network,PDNN),通过从暗场图像中学习信号无关性噪声,并将其与基于泊松分布建模的信号相关性噪声叠加得到合成噪声,从而准确表征TDI CCD在微光条件下的噪声分布.首先,该网络通过TDI CCD噪声解耦(TDI CCD Noise Decoupling,TND)模块将暗场图像解耦成空间无关性的像素噪声.然后,TDI CCD噪声建模(TDI CCD Noise Modeling,TNM)主干网络中的增益多级自适应(Gain and Multi-stage Adaptive,GMA)模块和 1×1卷积模块将初始噪声映射到接近真实噪声水平的分布空间,并保持像素噪声的独立性.最后,使用任务平衡损失(Task Balanced Loss,TBL)对网络进行约束,通过动态调整权重因子以维持训练过程的相对均衡,进一步优化网络性能.实验结果表明,在自建数据集中所提方法的平均KL散度(Average Kullback-Leibler Divergence,AKLD)达到0.106 9,在现有方法中具备显著优势,且使用合成噪声图像训练得到的PSNR与SSIM指标接近真实数据水平.PDNN能够准确描述TDI CCD在微光条件下的噪声分布,对提升微光遥感影像的视觉质量具有实际应用价值.
Time-Delay Integration CCDs(TDI CCDs)are widely used in remote-sensing imaging.However,complex noise sources-including dark current,reset noise,and quantization noise-hinder accu-rate characterization of the signal-independent noise distribution of real sensors under low-light condi-tions.To address this challenge,a physics-guided deep neural network for TDI CCD noise modeling(PDNN)is proposed.Signal-independent noise is learned from dark-frame images and combined with signal-dependent noise modeled by a Poisson distribution,enabling accurate representation of the TDI CCD noise distribution in low-light scenes.First,a TDI CCD Noise Decoupling(TND)module de-composes dark-frame images into pixel-level noise with spatial independence.Next,a Gain and Multi-stage Adaptive(GMA)module,together with 1×1 convolutional layers in the TDI CCD Noise Model-ing(TNM)backbone,maps the initial noise into a distribution space that closely matches the true noise level while preserving pixel-wise independence.Finally,a Task Balanced Loss(TBL)dynamically ad-justs weighting factors to maintain training equilibrium,further improving performance.On a self-con-structed dataset,the proposed method achieves an average Kullback-Leibler divergence(AKLD)of 0.106 9,demonstrating substantial improvements over existing approaches.Moreover,PSNR and SSIM obtained from models trained with synthetic noisy images closely approximate those achieved with real data.Experimental results indicate that PDNN effectively characterizes the low-light noise distribu-tion of TDI CCDs,providing practical value for enhancing the visual quality of low-light remote-sensing imagery.
夏波;黄鸿;周建勇;杨利平;王陶
重庆大学 光电技术与系统教育部重点实验室,重庆 400044重庆大学 光电技术与系统教育部重点实验室,重庆 400044中国电子科技集团公司第四十四研究所,重庆 400060重庆大学 光电技术与系统教育部重点实验室,重庆 400044中国电子科技集团公司第四十四研究所,重庆 400060
信息技术与安全科学
TDI CCD物理引导神经网络噪声解耦任务平衡损失
TDI CCDphysics-guidedneural networknoise decouplingtask balanced loss
《光学精密工程》 2026 (3)
466-480,15
国家自然科学基金资助项目(No.42571416,No.42071302)北京市航空智能遥感装备工程技术研究中心开放基金资助项目(No.AIRSE202412)
评论