Research on Performance Improvement of 3D Gaussian Splatting Model Driven by Optimized Point Cloud Data

Citation Author(s):
BOTAO
ZHANG
Submitted by:
BOTAO ZHANG
Last updated:
Sat, 06/29/2024 - 02:50
DOI:
10.21227/21nf-rn18
License:
430 Views
Categories:
Keywords:
0
0 ratings - Please login to submit your rating.

Abstract 

3D Gaussian Splatting performs 3D reconstruction by densifying sparse point clouds into Gaussian ellipsoids of the order of 100,000, and the reconstruction results show excellent visual effects. However, the point cloud data derived from 3D Gaussian Splatting is not fully utilized in the reconstruction process. To this end, this paper proposes to optimize the point cloud data derived from 3D Gaussian Splatting to improve the rendering quality of 3D Gaussian Splatting. First, the sparse point cloud is input into 3D Gaussian Splatting for reconstruction. During the reconstruction process, the color of the center point of the ellipsoid is extracted from the spherical harmonic characteristic coefficients of the Gaussian ellipsoid, and then the color and Gaussian ellipsoid center coordinate attributes are stored as new point cloud data. The radius filtering method is used to denoise the point cloud. Finally, the denoised point cloud is re-input into 3D Gaussian Splatting for reconstruction to obtain the optimized rendering results. The experiments are conducted on three public datasets. The quantitative comparison results show that the proposed method is improved compared with the original 3D Gaussian Splatting, and the qualitative comparison results show that the proposed method optimizes the blurred area rendered by 3D Gaussian Splatting. The method proposed in this paper optimizes 3D Gaussian Splatting-derived point cloud data for 3D reconstruction, obtains higher quality rendering results, and can obtain reconstruction effects that are better than the original 3D Gaussian Splatting on public datasets.

Instructions: 

3D Gaussian Splatting 选中疏点云加密为十万量级的高斯椭球进行重建,重建结果标题优异的效果。但3D Gaussian Splatting 导出的点云数据在重建过程中并未得到很有效的提升。为此,本文提出对3D Gaussian Splatting 导出的点云数据进行优化,为3D Gaussian Splatting 的渲染质量提供保障。首先将疏点云输入到3D Gaussian Splatting 中进行重建,重建过程中从高斯椭球的球谐特征系数中提取椭球中心点的颜色,然后将颜色和高斯椭球中心坐标属性存储为新的点云数据。采用半径滤波法对点云进行去噪。最后将去噪后的点云重新输入3D Gaussian Splatting 进行重建,得到优化的受试结果。在3个公开数据集上进行实验,定量对比数据所提方法较原3D Gaussian Splatting 有所提升,定性对比数据所提方法对3D Gaussian Splatting受精的模糊区域进行了优化。提出的方法是对3D高斯电镀得到的点云数据进行三维重建,获得了更高质量受精的图像数据,在公开数据库中重建效果优于3D高斯电镀。