人間のデモンストレーションと不確実性に基づく介入による飛行制御システムの学習
Learning Flight Control Systems from Human Demonstrations and Real-Time Uncertainty-Informed Interventions
人間のデモンストレーションから模倣学習で初期モデルを訓練し、不確実性が閾値を超えた際に人間が介入してモデルを改善する飛行制御学習手法を提案し、クアッドロータの着陸タスクで有効性を示した。
著者: Prashant Ganesh, J. Humberto Ramos, Vinicius G. Goecks, Jared Paquet, Matthew Longmire, Nicholas R. Waytowich, Kevin Brink
分類: cs.RO
原文アブストラクト
This paper describes a methodology for learning flight control systems from human demonstrations and interventions while considering the estimated uncertainty in the learned models. The proposed approach uses human demonstrations to train an initial model via imitation learning and then iteratively, improve its performance by using real-time human interventions. The aim of the interventions is to correct undesired behaviors and adapt the model to changes in the task dynamics. The learned model uncertainty is estimated in real-time via Monte Carlo Dropout and the human supervisor is cued for intervention via an audiovisual signal when this uncertainty exceeds a predefined threshold. This proposed approach is validated in an autonomous quadrotor landing task on both fixed and moving platforms. It is shown that with this algorithm, a human can rapidly teach a flight task to an unmanned aerial vehicle via demonstrating expert trajectories and then adapt the learned model by intervening when the learned controller performs any undesired maneuver, the task changes, and/or the model uncertainty exceeds a threshold
