制御トランスフォーマ:PRMガイド付きリターン条件付き系列モデリングによる未知環境でのロボットナビゲーション
Control Transformer: Robot Navigation in Unknown Environments through PRM-Guided Return-Conditioned Sequence Modeling
サンプリングベースのPRMプランナで低レベル方策をガイドし、リターン条件付き系列をモデル化するControl Transformerを提案。部分観測迷路ナビゲーションをMuJoCoロボットで評価し、未知環境への転移とTurtlebot3でのゼロショットsim2real転移を示した。
著者: Daniel Lawson, Ahmed H. Qureshi
分類: cs.RO, cs.AI, cs.LG
原文アブストラクト
Learning long-horizon tasks such as navigation has presented difficult challenges for successfully applying reinforcement learning to robotics. From another perspective, under known environments, sampling-based planning can robustly find collision-free paths in environments without learning. In this work, we propose Control Transformer that models return-conditioned sequences from low-level policies guided by a sampling-based Probabilistic Roadmap (PRM) planner. We demonstrate that our framework can solve long-horizon navigation tasks using only local information. We evaluate our approach on partially-observed maze navigation with MuJoCo robots, including Ant, Point, and Humanoid. We show that Control Transformer can successfully navigate through mazes and transfer to unknown environments. Additionally, we apply our method to a differential drive robot (Turtlebot3) and show zero-shot sim2real transfer under noisy observations.
