NARF22: 関節物体の構成に応じたレンダリングのためのニューラル放射輝度場
NARF22: Neural Articulated Radiance Fields for Configuration-Aware Rendering
関節物体を構成パラメータで制御可能なNeRFとして学習し、少ない構成データでも高品質なレンダリングと姿勢推定を可能にする手法を提案した。
著者: Stanley Lewis, Jana Pavlasek, Odest Chadwicke Jenkins
分類: cs.RO, cs.CV
原文アブストラクト
Articulated objects pose a unique challenge for robotic perception and manipulation. Their increased number of degrees-of-freedom makes tasks such as localization computationally difficult, while also making the process of real-world dataset collection unscalable. With the aim of addressing these scalability issues, we propose Neural Articulated Radiance Fields (NARF22), a pipeline which uses a fully-differentiable, configuration-parameterized Neural Radiance Field (NeRF) as a means of providing high quality renderings of articulated objects. NARF22 requires no explicit knowledge of the object structure at inference time. We propose a two-stage parts-based training mechanism which allows the object rendering models to generalize well across the configuration space even if the underlying training data has as few as one configuration represented. We demonstrate the efficacy of NARF22 by training configurable renderers on a real-world articulated tool dataset collected via a Fetch mobile manipulation robot. We show the applicability of the model to gradient-based inference methods through a configuration estimation and 6 degree-of-freedom pose refinement task. The project webpage is available at: https://progress.eecs.umich.edu/projects/narf/.
関連論文
- CLA-NeRF:カテゴリレベル関節物体ニューラル放射輝度場NeRF/関節物体
