逆強化学習とモンテカルロ木探索による協調軌道計画のための報酬モデル学習
Learning Reward Models for Cooperative Trajectory Planning with Inverse Reinforcement Learning and Monte Carlo Tree Search
特徴量ベースの最大エントロピー逆強化学習とモンテカルロ木探索を組み合わせ、複数エージェントの協調的な専門家軌道から人間らしい報酬モデルを学習する手法を提案した。
著者: Karl Kurzer, Matthias Bitzer, J. Marius Zöllner
分類: cs.LG, cs.RO
原文アブストラクト
Cooperative trajectory planning methods for automated vehicles can solve traffic scenarios that require a high degree of cooperation between traffic participants. However, for cooperative systems to integrate into human-centered traffic, the automated systems must behave human-like so that humans can anticipate the system's decisions. While Reinforcement Learning has made remarkable progress in solving the decision-making part, it is non-trivial to parameterize a reward model that yields predictable actions. This work employs feature-based Maximum Entropy Inverse Reinforcement Learning combined with Monte Carlo Tree Search to learn reward models that maximize the likelihood of recorded multi-agent cooperative expert trajectories. The evaluation demonstrates that the approach can recover a reasonable reward model that mimics the expert and performs similarly to a manually tuned baseline reward model.
