3次元不確かさ場の推定:ニューラル放射輝度場の不確かさを定量化
Estimating 3D Uncertainty Field: Quantifying Uncertainty for Neural Radiance Fields
NeRFが未観測領域で予測の不確かさを定量化できない問題に対し、学習した不完全な幾何から3D不確かさ場を推定する手法を提案し、次善視点選択などのロボティクスタスクへの有用性を示した。
著者: Jianxiong Shen, Ruijie Ren, Adria Ruiz, Francesc Moreno-Noguer
分類: cs.CV, cs.RO
原文アブストラクト
Current methods based on Neural Radiance Fields (NeRF) significantly lack the capacity to quantify uncertainty in their predictions, particularly on the unseen space including the occluded and outside scene content. This limitation hinders their extensive applications in robotics, where the reliability of model predictions has to be considered for tasks such as robotic exploration and planning in unknown environments. To address this, we propose a novel approach to estimate a 3D Uncertainty Field based on the learned incomplete scene geometry, which explicitly identifies these unseen regions. By considering the accumulated transmittance along each camera ray, our Uncertainty Field infers 2D pixel-wise uncertainty, exhibiting high values for rays directly casting towards occluded or outside the scene content. To quantify the uncertainty on the learned surface, we model a stochastic radiance field. Our experiments demonstrate that our approach is the only one that can explicitly reason about high uncertainty both on 3D unseen regions and its involved 2D rendered pixels, compared with recent methods. Furthermore, we illustrate that our designed uncertainty field is ideally suited for real-world robotics tasks, such as next-best-view selection.
