首页|期刊导航|Computers, Materials & Continua|Semantic-Guided Stereo Matching Network Based on Parallax Attention Mechanism and Seg Former

Semantic-Guided Stereo Matching Network Based on Parallax Attention Mechanism and Seg FormerOA

中文摘要

Stereo matching is a pivotal task in computer vision,enabling precise depth estimation from stereo image pairs,yet it encounters challenges in regions with reflections,repetitive textures,or fine structures.In this paper,we propose a Semantic-Guided Parallax Attention Stereo Matching Network(SGPASMnet)that can be trained in unsupervised manner,building upon the Parallax Attention Stereo Matching Network(PASMnet).Our approach leverages unsupervised learning to address the scarcity of ground truth disparity in stereo matching datasets,facilitating robust training across diverse scene-specific datasets and enhancing generalization.SGPASMnet incorporates two novel components:a Cross-Scale Feature Interaction(CSFI)block and semantic feature augmentation using a pre-trained semantic segmentation model,SegFormer,seamlessly embedded into the parallax attention mechanism.The CSFI block enables effective fusion ofmulti-scale features,integrating coarse and fine details to enhance disparity estimation accuracy.Semantic features,extracted by SegFormer,enrich the parallax attention mechanism by providing high-level scene context,significantly improving performance in ambiguous regions.Our model unifies these enhancements within a cohesive architecture,comprising semantic feature extraction,an hourglass network,a semantic-guided cascaded parallax attentionmodule,outputmodule,and a disparity refinement network.Evaluations on the KITTI2015 dataset demonstrate that our unsupervised method achieves a lower error rate compared to the original PASMnet,highlighting the effectiveness of our enhancements in handling complex scenes.By harnessing unsupervised learning without ground truth disparity needed,SGPASMnet offers a scalable and robust solution for accurate stereo matching,with superior generalization across varied real-world applications.

Zeyuan Chen;Yafei Xie;Jinkun Li;Song Wang;Yingqiang Ding

School of Electrical and Information Engineering,Zhengzhou University,Zhengzhou,450001,ChinaSchool of Electrical and Information Engineering,Zhengzhou University,Zhengzhou,450001,ChinaSchool of Electrical and Information Engineering,Zhengzhou University,Zhengzhou,450001,ChinaSchool of Electrical and Information Engineering,Zhengzhou University,Zhengzhou,450001,ChinaSchool of Electrical and Information Engineering,Zhengzhou University,Zhengzhou,450001,China

信息技术与安全科学

Stereo matchingparallax attentionunsupervised learningconvolutional neural networkstereo correspondence

《Computers, Materials & Continua》 2026 (4)

P.1322-1340,19

supported by the National Natural Science Foundation of China,No.62301497the Science and Technology Research Program of Henan,No.252102211024the Key Research and Development Program of Henan,No.231111212000.

10.32604/cmc.2025.073846

评论