3Dガウスプリミティブと深度事前分布を用いた新規視点合成可能なVisual SLAM
Visual SLAM with 3D Gaussian Primitives and Depth Priors Enabling Novel View Synthesis
3DガウススプラッティングをRGB-D SLAMに統合し、リアルタイムで密な3D再構成とカメラ姿勢推定を両立させる手法を提案。
著者: Zhongche Qu, Zhi Zhang, Cong Liu, Jianhua Yin
分類: cs.CV, cs.RO
原文アブストラクト
Conventional geometry-based SLAM systems lack dense 3D reconstruction capabilities since their data association usually relies on feature correspondences. Additionally, learning-based SLAM systems often fall short in terms of real-time performance and accuracy. Balancing real-time performance with dense 3D reconstruction capabilities is a challenging problem. In this paper, we propose a real-time RGB-D SLAM system that incorporates a novel view synthesis technique, 3D Gaussian Splatting, for 3D scene representation and pose estimation. This technique leverages the real-time rendering performance of 3D Gaussian Splatting with rasterization and allows for differentiable optimization in real time through CUDA implementation. We also enable mesh reconstruction from 3D Gaussians for explicit dense 3D reconstruction. To estimate accurate camera poses, we utilize a rotation-translation decoupled strategy with inverse optimization. This involves iteratively updating both in several iterations through gradient-based optimization. This process includes differentiably rendering RGB, depth, and silhouette maps and updating the camera parameters to minimize a combined loss of photometric loss, depth geometry loss, and visibility loss, given the existing 3D Gaussian map. However, 3D Gaussian Splatting (3DGS) struggles to accurately represent surfaces due to the multi-view inconsistency of 3D Gaussians, which can lead to reduced accuracy in both camera pose estimation and scene reconstruction. To address this, we utilize depth priors as additional regularization to enforce geometric constraints, thereby improving the accuracy of both pose estimation and 3D reconstruction. We also provide extensive experimental results on public benchmark datasets to demonstrate the effectiveness of our proposed methods in terms of pose accuracy, geometric accuracy, and rendering performance.
関連論文
- ブラケティングで道を切り開く:ロバストなVisual SLAMのための適応的マルチ露出ポリシーVisual SLAM
- 線特徴拡張cuVSLAM:低テクスチャ環境における堅牢な視覚オドメトリVisual SLAM
- ヒューマン・イン・ザ・ループ型ニューロシンボリックドリフト予測による信頼性の高いVisual SLAMVisual SLAM
- Know-Your-Scene (KYS)-SLAM: ステレオ視覚SLAMにおける特徴マッチングのための階層的意味・運動事前分布Visual SLAM
- HuMemSLAM: 人間の記憶に着想を得た効率的な意味的場所認識による堅牢なVisual SLAMVisual SLAM
- 深層単眼Visual SLAMはスケール問題を克服したのか?ScaleMasterデータセットとベンチマークVisual SLAM
