未知の変形地形におけるオフロード走行のための強化学習補償モデル予測制御
Reinforcement Learning Compensated Model Predictive Control for Off-road Driving on Unknown Deformable Terrain
未知のタイヤ・地形間の相互作用に対処するため、深層強化学習でモデル予測制御を補償し、変形地形での高速オフロード自律走行を実現するフレームワークを提案した。
著者: Prakhar Gupta, Jonathon M. Smereka, Yunyi Jia
分類: cs.RO, cs.SY, eess.SY
原文アブストラクト
This study presents an Actor-Critic reinforcement learning Compensated Model Predictive Controller (AC2MPC) designed for high-speed, off-road autonomous driving on deformable terrains. Addressing the difficulty of modeling unknown tire-terrain interaction and ensuring real-time control feasibility and performance, this framework integrates deep reinforcement learning with a model predictive controller to manage unmodeled nonlinear dynamics. We evaluate the controller framework over constant and varying velocity profiles using high-fidelity simulator Project Chrono. Our findings demonstrate that our controller statistically outperforms standalone model-based and learning-based controllers over three unknown terrains that represent sandy deformable track, sandy and rocky track and cohesive clay-like deformable soil track. Despite varied and previously unseen terrain characteristics, this framework generalized well enough to track longitudinal reference speeds with the least error. Furthermore, this framework required significantly less training data compared to purely learning based controller, converging in fewer steps while delivering better performance. Even when under-trained, this controller outperformed the standalone controllers, highlighting its potential for safer and more efficient real-world deployment.
