InDRiVE: 好奇心駆動型汎用世界モデルによる車両探索のための内在的不一致ベース強化学習
InDRiVE: Intrinsic Disagreement based Reinforcement for Vehicle Exploration through Curiosity Driven Generalized World Model
Dreamerベースのモデルベース強化学習に、世界モデルのアンサンブル間の不一致を利用した純粋な内在的報酬を導入し、タスク非依存の表現を学習して車線追従や衝突回避などの運転タスクへゼロショット/少数ショット適応を可能にした研究。
著者: Feeza Khan Khanzada, Jaerock Kwon
分類: cs.RO, cs.AI, cs.ET, cs.LG, cs.NE
原文アブストラクト
Model-based Reinforcement Learning (MBRL) has emerged as a promising paradigm for autonomous driving, where data efficiency and robustness are critical. Yet, existing solutions often rely on carefully crafted, task specific extrinsic rewards, limiting generalization to new tasks or environments. In this paper, we propose InDRiVE (Intrinsic Disagreement based Reinforcement for Vehicle Exploration), a method that leverages purely intrinsic, disagreement based rewards within a Dreamer based MBRL framework. By training an ensemble of world models, the agent actively explores high uncertainty regions of environments without any task specific feedback. This approach yields a task agnostic latent representation, allowing for rapid zero shot or few shot fine tuning on downstream driving tasks such as lane following and collision avoidance. Experimental results in both seen and unseen environments demonstrate that InDRiVE achieves higher success rates and fewer infractions compared to DreamerV2 and DreamerV3 baselines despite using significantly fewer training steps. Our findings highlight the effectiveness of purely intrinsic exploration for learning robust vehicle control behaviors, paving the way for more scalable and adaptable autonomous driving systems.
