Graph2Nav: ロボットナビゲーションのための3D物体関係グラフ生成
Graph2Nav: 3D Object-Relation Graph Generation to Robot Navigation
2Dのパノプティックシーングラフを3D意味マッピングで拡張し、屋内・屋外両方で使えるリアルタイム3D物体関係グラフを生成する枠組みを提案。LLMベースのプランナーと統合し、実環境の物体探索タスクで探索効率が向上することを示した。
著者: Tixiao Shan, Abhinav Rajvanshi, Niluthpol Mithun, Han-Pang Chiu
分類: cs.RO
原文アブストラクト
We propose Graph2Nav, a real-time 3D object-relation graph generation framework, for autonomous navigation in the real world. Our framework fully generates and exploits both 3D objects and a rich set of semantic relationships among objects in a 3D layered scene graph, which is applicable to both indoor and outdoor scenes. It learns to generate 3D semantic relations among objects, by leveraging and advancing state-of-the-art 2D panoptic scene graph works into the 3D world via 3D semantic mapping techniques. This approach avoids previous training data constraints in learning 3D scene graphs directly from 3D data. We conduct experiments to validate the accuracy in locating 3D objects and labeling object-relations in our 3D scene graphs. We also evaluate the impact of Graph2Nav via integration with SayNav, a state-of-the-art planner based on large language models, on an unmanned ground robot to object search tasks in real environments. Our results demonstrate that modeling object relations in our scene graphs improves search efficiency in these navigation tasks.
