ベイズ最適化による再学習不要のニューラルネットワーク近似MPCのファインチューニング
Fine-Tuning of Neural Network Approximate MPC without Retraining via Bayesian Optimization
ベイズ最適化を用いて、再学習なしにニューラルネットワーク近似モデル予測制御のパラメータを実験データから自動調整する手法を提案し、倒立振子や一輪車ロボットのハードウェア実験で有効性を示した。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Henrik Hose, Paul Brunzema, Alexander von Rohr, Alexander Gräfe, Angela P. Schoellig, Sebastian Trimpe
分類: cs.RO, cs.SY, eess.SY
原文アブストラクト
Approximate model-predictive control (AMPC) aims to imitate an MPC's behavior with a neural network, removing the need to solve an expensive optimization problem at runtime. However, during deployment, the parameters of the underlying MPC must usually be fine-tuned. This often renders AMPC impractical as it requires repeatedly generating a new dataset and retraining the neural network. Recent work addresses this problem by adapting AMPC without retraining using approximated sensitivities of the MPC's optimization problem. Currently, this adaption must be done by hand, which is labor-intensive and can be unintuitive for high-dimensional systems. To solve this issue, we propose using Bayesian optimization to tune the parameters of AMPC policies based on experimental data. By combining model-based control with direct and local learning, our approach achieves superior performance to nominal AMPC on hardware, with minimal experimentation. This allows automatic and data-efficient adaptation of AMPC to new system instances and fine-tuning to cost functions that are difficult to directly implement in MPC. We demonstrate the proposed method in hardware experiments for the swing-up maneuver on an inverted cartpole and yaw control of an under-actuated balancing unicycle robot, a challenging control problem.
関連論文
- トカマクのプラズマ安定化に向けたマルチタイムスケール動力学モデルベイズ最適化制御/ベイズ最適化
- モデルパラメータ不確実性下でのロバストMPCのためのベイズ最適化制御/ベイズ最適化
- 環境条件に応じたモデル予測制御の文脈的チューニング制御/ベイズ最適化
