自律走行レースのための文脈認識型モデルベース強化学習
Context-Aware Model-Based Reinforcement Learning for Autonomous Racing
対戦相手の運転挙動をエピソードの文脈としてパラメータ化し、モデルベース強化学習に文脈認識機構cMaskを導入することで、未知の対戦相手挙動への汎化性能を向上させた。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Emran Yasser Moustafa, Ivana Dusparic
分類: cs.LG, cs.RO
原文アブストラクト
Autonomous vehicles have shown promising potential to be a groundbreaking technology for improving the safety of road users. For these vehicles, as well as many other safety-critical robotic technologies, to be deployed in real-world applications, we require algorithms that can generalize well to unseen scenarios and data. Model-based reinforcement learning algorithms (MBRL) have demonstrated state-of-the-art performance and data efficiency across a diverse set of domains. However, these algorithms have also shown susceptibility to changes in the environment and its transition dynamics. In this work, we explore the performance and generalization capabilities of MBRL algorithms for autonomous driving, specifically in the simulated autonomous racing environment, Roboracer (formerly F1Tenth). We frame the head-to-head racing task as a learning problem using contextual Markov decision processes and parameterize the driving behavior of the adversaries using the context of the episode, thereby also parameterizing the transition and reward dynamics. We benchmark the behavior of MBRL algorithms in this environment and propose a novel context-aware extension of the existing literature, cMask. We demonstrate that context-aware MBRL algorithms generalize better to out-of-distribution adversary behaviors relative to context-free approaches. We also demonstrate that cMask displays strong generalization capabilities, as well as further performance improvement relative to other context-aware MBRL approaches when racing against adversaries with in-distribution behaviors.
関連論文
- 専門知識駆動型強化学習による自律レーシング:軌道誘導と動的制約の活用強化学習/自律走行
- 速く走り、速く学ぶ:高性能自律レースのためのオンボード強化学習強化学習/自律走行
- 局所計画サブシステムを学習する自律レーシング強化学習/自律走行
