基于语义嵌入三维高斯溅射的双路径重建算法OA
Dual-path reconstruction algorithm based on semantically embedded 3D Gaussian splatting
三维高斯溅射(3D Gaussian splatting,3DGS)在显式高斯分布中未能嵌入语义信息,阻碍了其在语义感知重建中的应用.针对上述问题,提出一种将语义嵌入三维高斯溅射的双路径重建算法SDP-GS.首先,基于空间关系将来自预训练模型的二维语义特征投影到三维高斯分布中;然后,采用双路径协同渲染策略,融合快速光栅化渲染和深度感知体渲染以提升渲染质量;最后,引入曝光补偿图像损失优化模型抑制因光照变化产生的伪影.在Tanks&Tempels数据集上的实验结果表明,SDP-GS相比基线PSNR、SSIM分别提升9%和8%,LPIPS降低41%.SDP-GS不仅成功将语义特征嵌入三维高斯溅射模型中,还实现了高保真的重建效果.
3DGS lacks the capability to incorporate semantic information within its explicit Gaussian distributions,which re-stricts its use in semantic perception reconstruction.In response to the above,this work proposed a dual-path reconstruction al-gorithm that embedded semantics into 3D Gaussian splatting.Firstly,the algorithm operated by projecting 2D semantic features from pre-trained models into 3D Gaussian distributions,utilizing their spatial relationships.Then,a dual-path collaborative ren-dering strategy fused fast rasterized rendering and depth-aware volume rendering to enhance output quality.Finally,an expo-sure-compensated image loss optimization model suppressed artifacts caused by lighting variations.Experimental results on the Tanks&Tempels dataset show that SDP-GS improves PSNR and SSIM by 9%and 8%,respectively,and reduces LPIPS by 41%compared to the baseline PSNR and SSIM.SDP-GS not only successfully embeds the semantic features into the 3D Gaussian splatting model,but also realizes the high-fidelity reconstruction.
王博;李少波;潘家兴;任皓
内蒙古科技大学自动化与电气工程学院,内蒙古包头 014010内蒙古科技大学自动化与电气工程学院,内蒙古包头 014010内蒙古科技大学自动化与电气工程学院,内蒙古包头 014010内蒙古科技大学自动化与电气工程学院,内蒙古包头 014010
信息技术与安全科学
三维高斯溅射语义特征投影双路径协同渲染曝光补偿
3D Gaussian splattingsemantic feature projectiondual-path collaborative renderingexposure compensation
《计算机应用研究》 2026 (4)
1245-1250,6
内蒙古自然科学基金资助项目(2022LHMS06002)
评论