自律サンゴ礁モニタリングのための文脈型マルチタスク強化学習
Contextual Multi-Task Reinforcement Learning for Autonomous Reef Monitoring
水中ロボットの不確実な動的環境下での制御を、文脈型マルチタスク強化学習を用いて学習し、サンゴ礁監視タスクの汎用性と堅牢性を向上させる手法を提案・評価した。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Melvin Laux, Yi-Ling Liu, Rina Alo, Sören Töpper, Mariela De Lucas Alvarez, Frank Kirchner, Rebecca Adam
分類: cs.RO, cs.AI
原文アブストラクト
Although autonomous underwater vehicles promise the capability of marine ecosystem monitoring, their deployment is fundamentally limited by the difficulty of controlling vehicles under highly uncertain and non-stationary underwater dynamics. To address these challenges, we employ a data-driven reinforcement learning approach to compensate for unknown dynamics and task variations. Traditional single-task reinforcement learning has a tendency to overfit the training environment, thus, limit the long-term usefulness of the learnt policy. Hence, we propose to use a contextual multi-task reinforcement learning paradigm instead, allowing us to learn controllers that can be reused for various tasks, e.g., detecting oysters in one reef and detecting corals in another. We evaluate whether contextual multi-task reinforcement learning can efficiently learn robust and generalisable control policies for autonomous underwater reef monitoring. We train a single context-dependent policy that is able to solve multiple related monitoring tasks in a simulated reef environment in HoloOcean. In our experiments, we empirically evaluate the contextual policies regarding sample-efficiency, zero-shot generalisation to unseen tasks, and robustness to varying water currents. By utilising multi-task reinforcement learning, we aim to improve the training effectiveness, as well as the reusability of learnt policies to take a step towards more sustainable procedures in autonomous reef monitoring.
関連論文
- 深層強化学習による6自由度自律水中ロボットの省エネ位置制御強化学習/水中ロボット
- 深層強化学習による自律型水中ロボットの3D経路追従と衝突回避制御強化学習/水中ロボット
- PID制御と強化学習を組み合わせた自律水中ロボットの経路追従強化学習/水中ロボット
- 強化学習による自律型水中ロボット制御のレビュー強化学習/水中ロボット
- モデルフリー強化学習によるAUVの深度制御強化学習/水中ロボット
