首页|期刊导航|计算机技术与发展|基于2D分割引导的3D高斯泼溅分割

基于2D分割引导的3D高斯泼溅分割OA

3D Gaussian Splatting Segmentation Guided by 2D Segmentation

中文摘要英文摘要

3D Gaussian Splatting作为一种新兴的 3D 表示方法,在复杂场景的重建和渲染中展现了卓越的性能.在 3D Gaussian Splatting目标分割中,大多数方法需要重新训练3D Gaussian Splatting的内置分割属性,不仅耗时较长,还可能导致边界区域的分割结果模糊.为了解决这些问题,提出了一种以2D特征为引导的高效三维分割方法.该分割方法将2D视觉信息与3D空间信息相关联,通过2D提示分割出3D高斯函数表示的目标物体,整个流程无需通过第二次迭代梯度下降为每个高斯函数添加新的分割属性.具体来说,首先根据2D掩码为3D高斯函数分配初始分割标签,随后通过邻界细化算法,细化目标物体的边界,成功克服了边界模糊的挑战,显著提升了分割精度.实验结果表明,该方法能够实现高质量的三维分割,处理时间减少了80%以上,同时分割精度显著提升,mIoU提高了1 百分点以上,mACC提高了0.3 百分点.

3D Gaussian Splatting,as an emerging 3D representation method,has demonstrated remarkable performance in complex scene reconstruction and rendering.In the context of 3D Gaussian Splatting object segmentation,most existing methods require retraining a dedicated segmentation property within the 3D Gaussian Splatting representation.This process is not only time-consuming but can also lead to ambiguous segmentation results,particularly in boundary regions.To address these issues,an efficient 3D segmentation method guided by 2D features is proposed.This method correlates 2D visual information with 3D spatial information to segment target objects re-presented by 3D Gaussians using 2D prompts.The entire process eliminates the need for a second iterative gradient descent to add new segmentation properties to each Gaussian.Specifically,it first assigns initial segmentation labels to the 3D Gaussians based on 2D masks.Subsequently,a neighboring boundary refinement algorithm is employed to refine the boundaries of the target objects,successfully overcoming the challenge of boundary blurring and significantly improving segmentation accuracy.Experimental results show that the proposed method achieves high-quality 3D segmentation,reduces processing time by over80%,and significantly enhances segmentation accuracy,with mIoU increasing by more than1 percentage point and mACC increasing by0.3 percentage points.

朱雨馨;朱烨;魏敏;邹鑫;童攀

成都信息工程大学 计算机学院,四川 成都 610225成都信息工程大学 计算机学院,四川 成都 610225成都信息工程大学 计算机学院,四川 成都 610225成都信息工程大学 计算机学院,四川 成都 610225成都信息工程大学 计算机学院,四川 成都 610225

信息技术与安全科学

三维分割3D高斯泼溅三维重建邻界细化算法高斯分裂

3D segmentation3D Gaussian Splatting3D reconstructionneighboring boundary refinement algorithmGaussian decompo-sition

《计算机技术与发展》 2026 (3)

68-76,9

四川省科技计划项目(2023YFQ0072)

10.20165/j.cnki.ISSN1673-629X.2025.0255

评论