ベイズ最適化に基づくカリキュラム学習による自動運転向け深層強化学習の環境ロバスト性向上
Improving Environment Robustness of Deep Reinforcement Learning Approaches for Autonomous Racing Using Bayesian Optimization-based Curriculum Learning
ベイズ最適化でカリキュラム報酬関数を推定し、障害物回避を伴う自動運転タスクにおいて、手設計カリキュラムや通常の深層強化学習よりロバストな方策を学習できることを示した。
著者: Rohan Banerjee, Prishita Ray, Mark Campbell
分類: cs.RO, cs.LG
原文アブストラクト
Deep reinforcement learning (RL) approaches have been broadly applied to a large number of robotics tasks, such as robot manipulation and autonomous driving. However, an open problem in deep RL is learning policies that are robust to variations in the environment, which is an important condition for such systems to be deployed into real-world, unstructured settings. Curriculum learning is one approach that has been applied to improve generalization performance in both supervised and reinforcement learning domains, but selecting the appropriate curriculum to achieve robustness can be a user-intensive process. In our work, we show that performing probabilistic inference of the underlying curriculum-reward function using Bayesian Optimization can be a promising technique for finding a robust curriculum. We demonstrate that a curriculum found with Bayesian optimization can outperform a vanilla deep RL agent and a hand-engineered curriculum in the domain of autonomous racing with obstacle avoidance. Our code is available at https://github.com/PRISHIta123/Curriculum_RL_for_Driving.
関連論文
- 安全フィルタリングを超えて:制御バリア関数を活用した連結自動運転車の強化学習強化学習/自動運転
- 運転意図の増幅による計画指向強化学習の性能向上強化学習/自動運転
- 実世界アジャイル運転のためのリセットフリー強化学習:実証研究強化学習/自動運転
- 減衰残差方策最適化による実世界自動運転レースの効率化強化学習/自動運転
- 報酬拡張強化学習による精密自動駐車の連続制御強化学習/自動運転
- 強化学習によるレーシングポリシーの学習強化学習/自動運転
