障害物環境における最短時間飛行の学習
Learning Minimum-Time Flight in Cluttered Environments
深層強化学習とトポロジカル経路計画を組み合わせ、障害物の多い環境でクアッドロータが最短時間で飛行する頑健なニューラルネットワーク制御器を訓練した。計画と制御をオンラインで同時に解くことで外乱に対応し、従来法を大きく上回る成功率と性能を実現した。
著者: Robert Penicka, Yunlong Song, Elia Kaufmann, Davide Scaramuzza
分類: cs.RO
原文アブストラクト
We tackle the problem of minimum-time flight for a quadrotor through a sequence of waypoints in the presence of obstacles while exploiting the full quadrotor dynamics. Early works relied on simplified dynamics or polynomial trajectory representations that did not exploit the full actuator potential of the quadrotor, and, thus, resulted in suboptimal solutions. Recent works can plan minimum-time trajectories; yet, the trajectories are executed with control methods that do not account for obstacles. Thus, a successful execution of such trajectories is prone to errors due to model mismatch and in-flight disturbances. To this end, we leverage deep reinforcement learning and classical topological path planning to train robust neural-network controllers for minimum-time quadrotor flight in cluttered environments. The resulting neural network controller demonstrates substantially better performance of up to 19\% over state-of-the-art methods. More importantly, the learned policy solves the planning and control problem simultaneously online to account for disturbances, thus achieving much higher robustness. As such, the presented method achieves 100% success rate of flying minimum-time policies without collision, while traditional planning and control approaches achieve only 40%. The proposed method is validated in both simulation and the real world, with quadrotor speeds of up to 42km/h and accelerations of 3.6g.
関連論文
- 強化学習による固定翼機の自律迎撃強化学習/飛行制御
- 重心再構成による劣駆動飛行船の二段階強化学習制御強化学習/飛行制御
- AcroRL: 双方向推力を用いたアグレッシブなクアッドローター反転飛行の学習強化学習/飛行制御
- クアッドロータ低レベル制御のための同変強化学習フレームワーク強化学習/飛行制御
- トンボ型タンデム翼実験機のためのConcert強化学習によるリアルタイム制御強化学習/飛行制御
- TD3によるFPVゲートを通過するクアッドコプターのニューラルネットワーク制御強化学習/飛行制御
