模倣学習によるシミュレーション四輪ドローンの高レベルナビゲーション指示追従
Following High-level Navigation Instructions on a Simulated Quadcopter with Imitation Learning
画像・指示・姿勢推定から低レベル速度指令を直接出力するGSMNを提案し、ピンホールカメラモデルを組み込んだ明示的セマンティックマップ構築により、四輪ドローンのシミュレータ上で強いベースラインを上回り専門家方策に迫る性能を示した。
著者: Valts Blukis, Nataly Brukhim, Andrew Bennett, Ross A. Knepper, Yoav Artzi
分類: cs.AI, cs.CL, cs.CV, cs.LG, cs.RO
原文アブストラクト
We introduce a method for following high-level navigation instructions by mapping directly from images, instructions and pose estimates to continuous low-level velocity commands for real-time control. The Grounded Semantic Mapping Network (GSMN) is a fully-differentiable neural network architecture that builds an explicit semantic map in the world reference frame by incorporating a pinhole camera projection model within the network. The information stored in the map is learned from experience, while the local-to-world transformation is computed explicitly. We train the model using DAggerFM, a modified variant of DAgger that trades tabular convergence guarantees for improved training speed and memory use. We test GSMN in virtual environments on a realistic quadcopter simulator and show that incorporating an explicit mapping and grounding modules allows GSMN to outperform strong neural baselines and almost reach an expert policy performance. Finally, we analyze the learned map representations and show that using an explicit map leads to an interpretable instruction-following model.
