内窥镜三维重建中的多尺度注意力机制特征匹配OA
Multi-scale Attentional Feature Matching for Endoscopic 3D Reconstruction
三维重建是微创手术精准医疗的关键基础,但腔内纹理匮乏、光照不足等问题,严重影响特征匹配这一核心环节,为此,提出一种基于层次结构强化的特征点匹配方法.首先,设计集成多尺度注意力机制的C-SuperPoint特征提取模型,通过融合多尺度信息增强弱纹理区域检测能力,实验表明其特征点提取数量相较原算法平均提升33.70%;其次,构建基于Transformer架构的P-LightGlue特征匹配算法,先通过粗匹配确定特征点对应关系,再利用渐进一致性采样模块筛选误匹配并拟合模型,实现高精度匹配.多数据集验证显示,P-LightGlue匹配准确率最高达 98.72%,最小平均匹配误差仅 1.065 1像素,结 果 证 实,C-SuperPoint 可有效提升特征提取效果,P-LightGlue则显著提高了微创手术图像处理的精度与可靠性.
3D reconstruction serves as a key foundation for precise minimally invasive surgery.However,poor texture and insufficient lighting in cavities pose significant challenges to feature matching,a crucial part of 3D reconstruction.a hierarchical structure-enhanced feature matching method is proposed.A C-SuperPoint feature extraction model,integrated with multi-scale attention mechanisms,enhances detection in weak texture areas,increasing the number of extracted feature points by 33.70%on average.Additionally,a P-LightGlue feature matching algorithm based on the transformer architecture performs initial rough matching and refines results through progressive consistency sampling,effectively filtering mismatches and fitting the model.This approach achieves up to 98.72%accuracy and a minimum average matching error of 1.065 1 pixels across multiple datasets.The results confirm that C-SuperPoint can effectively improve feature extraction performance,while P-LightGlue significantly enhances the accuracy and reliability of image processing in minimally invasive surgery.
潘漫凌;陈刚;王洪雁
浙江理工大学 信息科学与工程学院,浙江 杭州 310018||嘉兴大学 信息科学与工程学院,浙江 嘉兴 314001嘉兴大学 信息科学与工程学院,浙江 嘉兴 314001浙江理工大学 信息科学与工程学院,浙江 杭州 310018
通用工业技术
图像三维重建内窥镜特征提取特征匹配微创手术注意力机制C-SuperPointP-LightGlue
3D reconstruction from imageendoscopefeature extractionfeature matchingminimally invasive surgeryattention mechanismC-SuperPointP-LightGlue
《计量学报》 2026 (5)
662-670,9
浙江省自然科学基金联合基金(LBMHY25F030001)浙江省尖兵领雁研发攻关计划(2024C04052)
评论