準最適方策による強化学習のブートストラップで自動運転を実現
Bootstrapping Reinforcement Learning with Sub-optimal Policies for Autonomous Driving
専門家でなくてもよいルールベースの車線変更コントローラをSACに組み込み、探索と学習効率を改善する自動運転手法を提案した。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Zhihao Zhang, Chengyang Peng, Ekim Yurtsever, Keith A. Redmill
分類: cs.RO, cs.AI, cs.LG, cs.SY, eess.SY
原文アブストラクト
Automated vehicle control using reinforcement learning (RL) has attracted significant attention due to its potential to learn driving policies through environment interaction. However, RL agents often face training challenges in sample efficiency and effective exploration, making it difficult to discover an optimal driving strategy. To address these issues, we propose guiding the RL driving agent with a demonstration policy that need not be a highly optimized or expert-level controller. Specifically, we integrate a rule-based lane change controller with the Soft Actor Critic (SAC) algorithm to enhance exploration and learning efficiency. Our approach demonstrates improved driving performance and can be extended to other driving scenarios that can similarly benefit from demonstration-based guidance.
