ニューラルネットと木探索を組み合わせた困難環境でのタスク・動作計画
Combining Neural Networks and Tree Search for Task and Motion Planning in Challenging Environments
LTL制約と報酬関数の下で、深層強化学習による低レベル制御とタスク方策をモンテカルロ木探索と統合し、自動運転シミュレーションで交通規則を守りつつ交差点を通過する計画を実現した。
著者: Chris Paxton, Vasumathi Raman, Gregory D. Hager, Marin Kobilarov
分類: cs.RO
原文アブストラクト
We consider task and motion planning in complex dynamic environments for problems expressed in terms of a set of Linear Temporal Logic (LTL) constraints, and a reward function. We propose a methodology based on reinforcement learning that employs deep neural networks to learn low-level control policies as well as task-level option policies. A major challenge in this setting, both for neural network approaches and classical planning, is the need to explore future worlds of a complex and interactive environment. To this end, we integrate Monte Carlo Tree Search with hierarchical neural net control policies trained on expressive LTL specifications. This paper investigates the ability of neural networks to learn both LTL constraints and control policies in order to generate task plans in complex environments. We demonstrate our approach in a simulated autonomous driving setting, where a vehicle must drive down a road in traffic, avoid collisions, and navigate an intersection, all while obeying given rules of the road.
