ObjectReact: 物体相対制御を学習する視覚ナビゲーション
ObjectReact: Learning Object-Relative Control for Visual Navigation
単眼カメラとトポロジカルマップを用いた視覚ナビゲーションにおいて、画像相対ではなく物体相対の制御を学習する新手法を提案し、センサ高さの変化に対する頑健性を示した。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Sourav Garg, Dustin Craggs, Vineeth Bhat, Lachlan Mares, Stefan Podgorski, Madhava Krishna, Feras Dayoub, Ian Reid
分類: cs.RO, cs.AI, cs.CV, cs.LG, cs.SY, eess.SY
原文アブストラクト
Visual navigation using only a single camera and a topological map has recently become an appealing alternative to methods that require additional sensors and 3D maps. This is typically achieved through an "image-relative" approach to estimating control from a given pair of current observation and subgoal image. However, image-level representations of the world have limitations because images are strictly tied to the agent's pose and embodiment. In contrast, objects, being a property of the map, offer an embodiment- and trajectory-invariant world representation. In this work, we present a new paradigm of learning "object-relative" control that exhibits several desirable characteristics: a) new routes can be traversed without strictly requiring to imitate prior experience, b) the control prediction problem can be decoupled from solving the image matching problem, and c) high invariance can be achieved in cross-embodiment deployment for variations across both training-testing and mapping-execution settings. We propose a topometric map representation in the form of a "relative" 3D scene graph, which is used to obtain more informative object-level global path planning costs. We train a local controller, dubbed "ObjectReact", conditioned directly on a high-level "WayObject Costmap" representation that eliminates the need for an explicit RGB input. We demonstrate the advantages of learning object-relative control over its image-relative counterpart across sensor height variations and multiple navigation tasks that challenge the underlying spatial understanding capability, e.g., navigating a map trajectory in the reverse direction. We further show that our sim-only policy is able to generalize well to real-world indoor environments. Code and supplementary material are accessible via project page: https://object-react.github.io/
関連論文
- 履歴観測からの証拠的BEV補完による視覚ナビゲーション視覚ナビゲーション
- オプティカルフローから安全へ:スケールフリー相対運動による視覚的安全認証視覚ナビゲーション
- VIGOR-MPC: 視覚誘導型目的調整MPC視覚ナビゲーション
- SkipWorld: 蒸留ワールドモデルによる潜在スキップ計画で効率的な視覚ナビゲーション視覚ナビゲーション
- RingNav: タスクに合わせた円環メモリによる視覚的方位推定視覚ナビゲーション
- PathLift:視覚ナビゲーションのための深度条件付きメートル法変換視覚ナビゲーション
