ProxFly: 残差強化学習による近接飛行のためのロバスト制御
ProxFly: Robust Control for Close Proximity Quadcopter Flight via Residual Reinforcement Learning
カスケード制御器に残差強化学習モジュールを追加し、機体間通信なしで近接飛行時のダウンウォッシュ外乱や推力損失を補償する制御手法を提案。実機の近接飛行や空中ドッキングで有効性を検証した。
著者: Ruiqi Zhang, Dingqi Zhang, Mark W. Mueller
分類: cs.RO
原文アブストラクト
This paper proposes the ProxFly, a residual deep Reinforcement Learning (RL)-based controller for close proximity quadcopter flight. Specifically, we design a residual module on top of a cascaded controller (denoted as basic controller) to generate high-level control commands, which compensate for external disturbances and thrust loss caused by downwash effects from other quadcopters. First, our method takes only the ego state and controllers' commands as inputs and does not rely on any communication between quadcopters, thereby reducing the bandwidth requirement. Through domain randomization, our method relaxes the requirement for accurate system identification and fine-tuned controller parameters, allowing it to adapt to changing system models. Meanwhile, our method not only reduces the proportion of unexplainable signals from the black box in control commands but also enables the RL training to skip the time-consuming exploration from scratch via guidance from the basic controller. We validate the effectiveness of the residual module in the simulation with different proximities. Moreover, we conduct the real close proximity flight test to compare ProxFly with the basic controller and an advanced model-based controller with complex aerodynamic compensation. Finally, we show that ProxFly can be used for challenging quadcopter mid-air docking, where two quadcopters fly in extreme proximity, and strong airflow significantly disrupts flight. However, our method can stabilize the quadcopter in this case and accomplish docking. The resources are available at https://github.com/ruiqizhang99/ProxFly.
関連論文
- バッテリー状態を考慮した強化学習によるアグレッシブなクアッドロータ飛行飛行制御/強化学習
- CORB-Planner: 高速飛行におけるRLプランニングのための観測としてのコリドー飛行制御/強化学習
- 強化学習によるクアッドコプターの耐故障制御飛行制御/強化学習
- 大きな外乱を受けるUASのRLに基づく制御飛行制御/強化学習
- スケール対応深層強化学習による動特性不変なクアッドロータ制御飛行制御/強化学習
- 深層強化学習によるソフトアクチュエータ昆虫サイズ飛行ロボットのホバリング飛行飛行制御/強化学習
