TranSplat: 表面埋め込み誘導による透明物体操作のための3Dガウシアンスプラッティング
TranSplat: Surface Embedding-guided 3D Gaussian Splatting for Transparent Object Manipulation
透明物体の表面埋め込みを拡散モデルで生成し、3Dガウシアンスプラッティングに統合することで、高精度で密な深度補完を実現し、ロボット把持を可能にした研究。
著者: Jeongyun Kim, Jeongho Noh, Dong-Guw Lee, Ayoung Kim
分類: cs.CV, cs.RO
原文アブストラクト
Transparent object manipulation remains a significant challenge in robotics due to the difficulty of acquiring accurate and dense depth measurements. Conventional depth sensors often fail with transparent objects, resulting in incomplete or erroneous depth data. Existing depth completion methods struggle with interframe consistency and incorrectly model transparent objects as Lambertian surfaces, leading to poor depth reconstruction. To address these challenges, we propose TranSplat, a surface embedding-guided 3D Gaussian Splatting method tailored for transparent objects. TranSplat uses a latent diffusion model to generate surface embeddings that provide consistent and continuous representations, making it robust to changes in viewpoint and lighting. By integrating these surface embeddings with input RGB images, TranSplat effectively captures the complexities of transparent surfaces, enhancing the splatting of 3D Gaussians and improving depth completion. Evaluations on synthetic and real-world transparent object benchmarks, as well as robot grasping tasks, show that TranSplat achieves accurate and dense depth completion, demonstrating its effectiveness in practical applications. We open-source synthetic dataset and model: https://github. com/jeongyun0609/TranSplat
