画像入力と行動方策平滑化による自律ミニカー走行の安定化
Image-Based Conditioning for Action Policy Smoothness in Autonomous Miniature Car Racing with Reinforcement Learning
画像ベースの強化学習でミニカーを自律走行させる際に、CAPSとCycleGANによるsim2real転移を組み合わせ、制御を滑らかにして高速でも安定走行を実現し平均周回タイムを21.8%短縮した。
著者: Bo-Jiun Hsu, Hoang-Giang Cao, I Lee, Chih-Yu Kao, Jin-Bo Huang, I-Chen Wu
分類: cs.RO, cs.SY, eess.SY
原文アブストラクト
In recent years, deep reinforcement learning has achieved significant results in low-level controlling tasks. However, the problem of control smoothness has less attention. In autonomous driving, unstable control is inevitable since the vehicle might suddenly change its actions. This problem will lower the controlling system's efficiency, induces excessive mechanical wear, and causes uncontrollable, dangerous behavior to the vehicle. In this paper, we apply the Conditioning for Action Policy Smoothness (CAPS) with image-based input to smooth the control of an autonomous miniature car racing. Applying CAPS and sim-to-real transfer methods helps to stabilize the control at a higher speed. Especially, the agent with CAPS and CycleGAN reduces 21.80% of the average finishing lap time. Moreover, we also conduct extensive experiments to analyze the impact of CAPS components.
