不確かなダイナミクスを持つ知能車両のための学習ベース準最適運動計画
Learning-based Near-optimal Motion Planning for Intelligent Vehicles with Uncertain Dynamics
スパースカーネル強化学習とガウス過程回帰を組み合わせ、不確かなモデルダイナミクス下でもオンライン適応しながら安全で準最適な運動計画を実現する手法を提案し、実車実験で有効性を示した。
著者: Yang Lu, Xinglong Zhang, Xin Xu, Weijia Yao
分類: cs.RO
原文アブストラクト
Motion planning has been an important research topic in achieving safe and flexible maneuvers for intelligent vehicles. However, it remains challenging to realize efficient and optimal planning in the presence of uncertain model dynamics. In this paper, a sparse kernel-based reinforcement learning (RL) algorithm with Gaussian Process (GP) Regression (called GP-SKRL) is proposed to achieve online adaption and near-optimal motion planning performance. In this algorithm, we design an efficient sparse GP regression method to learn the uncertain dynamics. Based on the updated model, a sparse kernel-based policy iteration algorithm with an exponential barrier function is designed to learn the near-optimal planning policies with the capability to avoid dynamic obstacles. Thereby, batch-mode GP-SKRL with online adaption capability can estimate the changing system dynamics. The converged RL policies are then deployed on vehicles efficiently under a safety-aware module. As a result, the produced driving actions are safe and less conservative, and the planning performance has been noticeably improved. Extensive simulation results show that GP-SKRL outperforms several advanced motion planning methods in terms of average cumulative cost, trajectory length, and task completion time. In particular, experiments on a Hongqi E-HS3 vehicle demonstrate that superior GP-SKRL provides a practical planning solution.
