SO(2)同変ガウシアン彫刻ネットワークによる単視点3D再構成
Single-View 3D Reconstruction via SO(2)-Equivariant Gaussian Sculpting Networks
単一視点画像からSO(2)同変なガウシアンスプラッティング表現を生成し、高速(150FPS以上)で3D物体を再構成する手法を提案。ロボット把持への応用可能性も示す。
著者: Ruihan Xu, Anthony Opipari, Joshua Mah, Stanley Lewis, Haoran Zhang, Hanzhe Guo, Odest Chadwicke Jenkins
分類: cs.CV, cs.RO
原文アブストラクト
This paper introduces SO(2)-Equivariant Gaussian Sculpting Networks (GSNs) as an approach for SO(2)-Equivariant 3D object reconstruction from single-view image observations. GSNs take a single observation as input to generate a Gaussian splat representation describing the observed object's geometry and texture. By using a shared feature extractor before decoding Gaussian colors, covariances, positions, and opacities, GSNs achieve extremely high throughput (>150FPS). Experiments demonstrate that GSNs can be trained efficiently using a multi-view rendering loss and are competitive, in quality, with expensive diffusion-based reconstruction algorithms. The GSN model is validated on multiple benchmark experiments. Moreover, we demonstrate the potential for GSNs to be used within a robotic manipulation pipeline for object-centric grasping.
