性能保証を損なわずにニューラルネットワーク制御器をビヘイビアツリーに追加する手法
Adding Neural Network Controllers to Behavior Trees without Destroying Performance Guarantees
安全性と目標収束の保証を持つビヘイビアツリーに、機械学習で設計した制御コンポーネントを保証を壊さず組み込む方法を提案し、倒立振子の例で示した。
著者: Christopher Iliffe Sprague, Petter Ögren
分類: cs.RO, cs.AI, cs.LG, cs.NE
原文アブストラクト
In this paper, we show how Behavior Trees that have performance guarantees, in terms of safety and goal convergence, can be extended with components that were designed using machine learning, without destroying those performance guarantees. Machine learning approaches such as reinforcement learning or learning from demonstration can be very appealing to AI designers that want efficient and realistic behaviors in their agents. However, those algorithms seldom provide guarantees for solving the given task in all different situations while keeping the agent safe. Instead, such guarantees are often easier to find for manually designed model-based approaches. In this paper we exploit the modularity of behavior trees to extend a given design with an efficient, but possibly unreliable, machine learning component in a way that preserves the guarantees. The approach is illustrated with an inverted pendulum example.
