基于全局特征增强和几何先验的多视图立体方法OA
Multi-view stereo method based on global feature enhancement and geometry-priors
虽然基于深度学习的多视图立体方法取得了较大的研究进展,但是在弱纹理和无纹理区域深度估计的精度仍需进一步提高.对此,提出一种基于全局特征增强和几何先验指导的多视图立体方法(MPMVS),通过全局特征增强模块融合原始RGB图像与深度语义特征,结合Transformer的全局建模能力与卷积网络的局部细节提取优势,生成包含多尺度信息的优化特征,显著提升了对弱纹理区域的感知能力.此外,提出了一种几何先验指导模块,采用跨阶段代价体融合策略,将粗糙阶段的几何信息融入精细阶段的代价体优化过程,同时利用卷积网络对级联结构不同阶段的几何先验进行联合推理,从而提高了深度图的精度.在多个开源数据集上的实验结果均表明,所提方法的图像重建性能相比于现有经典方法具有优势.
Although deep learning-based multi-view stereo(MVS)methods have made significant progress,the depth estimation accuracy of MVS for points in weak-texture and texture-less regions still requires further improvement.To address this issue,this paper proposes a multi-view stereo method based on global feature enhancement and geometric priors.The proposed method employs a global feature enhancement module to fuse raw RGB images with depth features while leveraging the global modeling capability of Transformers and the local detail extraction advantages of convolutional networks.This integration generates optimized multi-scale features,significantly enhancing the model's perception of weak-texture regions.Additionally,a geometric prior-guided module is introduced,which adopts a cross-stage cost volume fusion strategy.This strategy incorporates geometric information from the coarse stage into the fine-stage cost volume optimization process while utilizing convolutional networks for joint reasoning of geometric priors across different stages of the cascaded structure,consequently,improves depth estimation accuracy.Experimental results on multiple public datasets demonstrate that the proposed method outperforms existing state-of-the-art approaches,highlighting its effectiveness and superiority.
曹明伟;年四旗;彭圣洁;李宁;赵海峰
安徽大学 计算机科学与技术学院,安徽 合肥 230601安徽大学 计算机科学与技术学院,安徽 合肥 230601安徽大学 计算机科学与技术学院,安徽 合肥 230601安徽大学 计算机科学与技术学院,安徽 合肥 230601安徽大学 计算机科学与技术学院,安徽 合肥 230601
信息技术与安全科学
多视图立体深度估计特征增强三维重建
multi-view stereodepth estimationfeature enhancement3D reconstruction
《浙江大学学报(理学版)》 2026 (2)
181-190,10
国家自然科学基金项目(62372153)安徽省高等学校科学研究项目(2024AH050045).
评论