首页|期刊导航|煤矿安全|基于光流与稀疏注意力的红外视频去运动模糊算法

基于光流与稀疏注意力的红外视频去运动模糊算法OA

Infrared video motion deblurring algorithm based on optical flow and sparse attention

中文摘要英文摘要

煤矿井下作业环境具有空间结构复杂且存在大量设备振动等显著特点,这些特殊性导致红外视频质量面临严峻挑战.其中,目标快速移动和井下设备自身振动所产生的视频帧内与帧间运动模糊问题尤为突出,该问题会引发图像纹理丢失、目标轮廓不清晰及细节退化,从而降低后续视觉处理任务的精度与效果.针对上述问题,提出了基于光流引导稀疏注意力的 Trans-former 红外视频去运动模糊算法.首先,利用光流信息引导 Transformer 的稀疏注意力矩阵计算过程,并应用分层稀疏注意力机制自适应聚焦低对比度关键区域,以分离红外特征与运动模糊成分,同时引入循环时空依赖建模,捕捉并利用相邻多帧间的运动信息与特征连续性,解决单帧去模糊上下文信息不足的问题;其次,通过全局运动聚合模块优化光流估计,该模块能够根据周边可靠光流信息与上下文语义特征,精确推断并修复遮挡区域的光流矢量以克服传统光流算法在遮挡区域的局限性,为前序去模糊处理提供更准确可靠的运动信息支撑;最后,基于物理轨迹建模的运动模糊增强方法构建面向煤矿重尘雾的煤矿岩巷掘进场景数据集(CMRRD-HCDF,该数据集覆盖了不同作业状态、干扰程度以及复杂遮挡场景),用于验证算法在真实煤矿井下场景的泛化能力评估.试验结果表明,算法在非制冷红外图像去模糊数据集(UIRD)中峰值信噪比达29.508 2 dB,结构相似度达0.889 3;CMRRD-HCDF 数据集中峰值信噪比达33.136 7 dB,结构相似度达 0.958 6.

The underground coal mine working environment is characterized by complex spatial structures and significant factors such as widespread equipment vibration.These unique conditions pose severe challenges to the quality of infrared video.Among them,the issues of intra-frame and inter-frame motion blur caused by rapid target movement and the inherent vibration of under-ground equipment are particularly prominent.Such blurring leads to the loss of image texture,unclear target contours,and degrada-tion of details,thereby reducing the accuracy and effectiveness of subsequent visual processing tasks.To address these challenges,this paper proposes a Transformer-based infrared video deblurring algorithm guided by optical flow with sparse attention.First,op-tical flow information is utilized to guide the computation of the sparse attention matrix in the Transformer.A hierarchical sparse at-tention mechanism is applied to adaptively focus on low-contrast key regions,separating infrared features from motion blur compon-ents.Simultaneously,recurrent spatiotemporal dependency modeling is introduced to capture and leverage motion information and feature continuity across adjacent frames,addressing the issue of insufficient contextual information in single-frame deblurring.Second,the optical flow estimation is refined through a global motion aggregation module.This module accurately infers and cor-rects optical flow vectors in occluded areas based on surrounding reliable optical flow information and contextual semantic features,overcoming the limitations of traditional optical flow algorithms in occluded regions,thereby providing more accurate and reliable motion information for the subsequent deblurring process.Finally,a motion blur enhancement method based on physical trajectory modeling is employed to construct a coal mine rock roadway drilling scene dataset with heavy coal dust fog dataset(CMRRD-HCDF,this dataset covers various operational states,interference levels,and complex occlusion scenarios)tailored for heavy dust and fog conditions in coal mine to evaluate the algorithm's generalization capability in real underground coal mine environments.Experimental results show that the algorithm achieves a peak signal-to-noise ratio(PSNR)of 29.508 2 dB and a structural SIMilarity index(SSIM)of 0.889 3 on the uncooled infrared image deblurring dataset(UIRD),and a PSNR of 33.136 7 dB and an SSIM of 0.958 6 on the CMRRD-HCDF dataset.

白天昕;冯文彬;于重重;谢涛;郑彤

北京工商大学 计算机与人工智能学院,北京 100048中煤科工集团沈阳研究院有限公司,辽宁 抚顺 113122||煤矿灾害防控全国重点实验室,辽宁 抚顺 113122北京工商大学 计算机与人工智能学院,北京 100048北京工商大学 计算机与人工智能学院,北京 100048北京工商大学 计算机与人工智能学院,北京 100048

矿业与冶金

图像智能检测深度学习计算机视觉红外图像去运动模糊光流估计

intelligent image detectiondeep learningcomputer visioninfrared imagemotion deblurringoptical flow estimation

《煤矿安全》 2026 (5)

247-257,11

"十四五"国家重点研发计划资助项目(2023YFB3211003)北京市自然科学基金面上资助项目(4252031)

10.13347/j.cnki.mkaq.20250792

评论