ロボットが見えないものを見る:視覚ナビゲーションのための協調知覚学習
See What the Robot Can't See: Learning Cooperative Perception for Visual Navigation
未知環境で移動ロボットが目標へ向かうため、複数の視覚センサーがGraph Neural Networkで情報を集約・通信し、最短経路方向を予測する手法を提案。シミュレーションと実世界で有効性を示した。
著者: Jan Blumenkamp, Qingbiao Li, Binyu Wang, Zhe Liu, Amanda Prorok
分類: cs.RO, cs.LG, cs.MA, cs.SY, eess.SY
原文アブストラクト
We consider the problem of navigating a mobile robot towards a target in an unknown environment that is endowed with visual sensors, where neither the robot nor the sensors have access to global positioning information and only use first-person-view images. In order to overcome the need for positioning, we train the sensors to encode and communicate relevant viewpoint information to the mobile robot, whose objective it is to use this information to navigate to the target along the shortest path. We overcome the challenge of enabling all the sensors (even those that cannot directly see the target) to predict the direction along the shortest path to the target by implementing a neighborhood-based feature aggregation module using a Graph Neural Network (GNN) architecture. In our experiments, we first demonstrate generalizability to previously unseen environments with various sensor layouts. Our results show that by using communication between the sensors and the robot, we achieve up to 2.0x improvement in SPL (Success weighted by Path Length) when compared to a communication-free baseline. This is done without requiring a global map, positioning data, nor pre-calibration of the sensor network. Second, we perform a zero-shot transfer of our model from simulation to the real world. Laboratory experiments demonstrate the feasibility of our approach in various cluttered environments. Finally, we showcase examples of successful navigation to the target while both the sensor network layout as well as obstacles are dynamically reconfigured as the robot navigates. We provide a video demo, the dataset, trained models, and source code. https://www.youtube.com/watch?v=kcmr6RUgucw https://github.com/proroklab/sensor-guided-visual-nav
関連論文
- 履歴観測からの証拠的BEV補完による視覚ナビゲーション視覚ナビゲーション
- オプティカルフローから安全へ:スケールフリー相対運動による視覚的安全認証視覚ナビゲーション
- VIGOR-MPC: 視覚誘導型目的調整MPC視覚ナビゲーション
- SkipWorld: 蒸留ワールドモデルによる潜在スキップ計画で効率的な視覚ナビゲーション視覚ナビゲーション
- RingNav: タスクに合わせた円環メモリによる視覚的方位推定視覚ナビゲーション
- PathLift:視覚ナビゲーションのための深度条件付きメートル法変換視覚ナビゲーション
