外乱下でのマルチコプタ衝突回避追従のための安全強化学習フィルタ
Safe Reinforcement Learning Filter for Multicopter Collision-Free Tracking under disturbances
外乱がある環境でマルチコプタが衝突せずに軌道追従できるよう、ロバスト制御バリア関数と二次計画法を組み合わせた安全フィルタを強化学習に導入した研究。
著者: Qihan Qi, Xinsong Yang, Gang Xia
分類: cs.RO
原文アブストラクト
This paper proposes a safe reinforcement learning filter (SRLF) to realize multicopter collision-free trajectory tracking with input disturbance. A novel robust control barrier function (RCBF) with its analysis techniques is introduced to avoid collisions with unknown disturbances during tracking. To ensure the system state remains within the safe set, the RCBF gain is designed in control action. A safety filter is introduced to transform unsafe reinforcement learning (RL) control inputs into safe ones, allowing RL training to proceed without explicitly considering safety constraints. The SRLF obtains rigorous guaranteed safe control action by solving a quadratic programming (QP) problem that incorporates forward invariance of RCBF and input saturation constraints. Both simulation and real-world experiments on multicopters demonstrate the effectiveness and excellent performance of SRLF in achieving collision-free tracking under input disturbances and saturation.
