首页|期刊导航|液晶与显示|基于OFCA-Transformer的轻量化视频超分辨率重建

基于OFCA-Transformer的轻量化视频超分辨率重建OA

Lightweight video super-resolution reconstruction based on OFCA-Transformer

中文摘要英文摘要

针对现有视频超分辨率方法在复杂运动场景下存在的帧间对齐不准确、时序信息利用不充分,以及传统注意力机制计算复杂度高等问题,本文提出一种融合光流引导交叉注意力的视频超分辨率网络(OFCA-Transformer).首先,设计一个轻量级的多尺度光流估计模块,生成多粒度运动信息;其次,创新性引入光流引导的交叉注意力机制,以光流预测位置为中心建立局部注意力窗口,实现显式几何先验与隐式内容感知的深度融合,在提升对齐精度的同时显著降低计算复杂度;最后,构建分层特征聚合模块,在Transformer架构内实现更有效的时空特征融合.在放大因子分别为×2、×3、×4时,将本文的研究方法与其他方法在3个公开数据集进行对比.结果表明,OFCA-Transformer在多个数据集上的PSNR值与其他先进方法相比仅差0.16 dB,而模型参数量降低82.8%,有效地提高了计算效率.此外,本文所提的研究方法在复杂运动场景下表现出更精确的细节恢复和更好的时间一致性,客观上在各个放大因子下均取得较好的定量指标.

To address the limitations of existing video super-resolution methods in complex motion scenes-including inaccurate frame-to-frame alignment,insufficient utilization of temporal information,and high computational complexity of traditional attention mechanisms,this paper proposes an optical flow-guided cross-attention video super-resolution network(OFCA-Transformer).First,a lightweight multi-scale optical flow estimation module is designed to generate multi-granularity motion information.Second,we innovatively introduce a flow-guided cross-attention mechanism.By establishing local attention windows centered on flow-predicted positions,we achieve an explicit fusion of geometric priors with implicit content awareness.This approach significantly enhances alignment accuracy while substantially reducing computational complexity.Additionally,we construct a hierarchical feature aggregation module to enable more efficient spatio-temporal feature fusion within the Transformer architecture.Our method was evaluated against other approaches on three public datasets at magnification factors of×2,×3,and×4.The results demonstrate that OFCA-Transformer achieves PSNR values only 0.16 dB lower than the state-of-the-art methods across multiple datasets,while reducing model parameters by 82.8%,effectively improving computational efficiency.Furthermore,the proposed method exhibits more precise detail recovery and better temporal consistency in complex motion scenes,objectively achieving superior quantitative metrics across all magnification factors.

任朋炀;庞凯

合肥工业大学 机械工程学院,安徽 合肥 230002东北大学 机械工程与自动化学院,辽宁 沈阳 110167

信息技术与安全科学

视频超分辨率Transformer光流估计交叉注意力运动对齐

video super-resolutionTranformeroptical flow estimationcross-attentionfeature fusion

《液晶与显示》 2026 (3)

440-451,12

10.37188/CJLCD.2025-0256

评论