アクションマッピング強化学習による自律レース走行の学習
Learning Autonomous Race Driving with Action Mapping Reinforcement Learning
タイヤと路面の摩擦による入力制約をアクションマッピングで扱う強化学習手法を提案し、レースシミュレータで従来法より優れたラップタイムと成功率、異なる摩擦条件への汎化を実証した。
著者: Yuanda Wang, Xin Yuan, Changyin Sun
分類: cs.RO, cs.SY, eess.SY
原文アブストラクト
Autonomous race driving poses a complex control challenge as vehicles must be operated at the edge of their handling limits to reduce lap times while respecting physical and safety constraints. This paper presents a novel reinforcement learning (RL)-based approach, incorporating the action mapping (AM) mechanism to manage state-dependent input constraints arising from limited tire-road friction. A numerical approximation method is proposed to implement AM, addressing the complex dynamics associated with the friction constraints. The AM mechanism also allows the learned driving policy to be generalized to different friction conditions. Experimental results in our developed race simulator demonstrate that the proposed AM-RL approach achieves superior lap times and better success rates compared to the conventional RL-based approaches. The generalization capability of driving policy with AM is also validated in the experiments.
