WildFusion: 実環境におけるマルチモーダル暗黙的3D再構成
WildFusion: Multimodal Implicit 3D Reconstructions in the Wild
LiDAR・RGBカメラ・接触マイク・触覚センサ・IMUを統合したマルチモーダル暗黙的ニューラル表現により、非構造化野外環境の3Dシーン再構成を行い、脚式ロボットの森林ナビゲーションで走行可能性予測の精度向上を示した。
著者: Yanbaihui Liu, Boyuan Chen
分類: cs.RO, cs.MM, eess.SP
原文アブストラクト
We propose WildFusion, a novel approach for 3D scene reconstruction in unstructured, in-the-wild environments using multimodal implicit neural representations. WildFusion integrates signals from LiDAR, RGB camera, contact microphones, tactile sensors, and IMU. This multimodal fusion generates comprehensive, continuous environmental representations, including pixel-level geometry, color, semantics, and traversability. Through real-world experiments on legged robot navigation in challenging forest environments, WildFusion demonstrates improved route selection by accurately predicting traversability. Our results highlight its potential to advance robotic navigation and 3D mapping in complex outdoor terrains.
