深層強化学習による自律表面艇の経路追従と衝突回避の制御
Taming an autonomous surface vehicle for path following and collision avoidance using deep reinforcement learning
近接方策最適化(PPO)を用いて、水中の自律表面艇が既知の経路を追従しつつ障害物を回避する制御を学習させ、シミュレーションで84〜100%の成功率を達成した。
著者: Eivind Meyer, Haakon Robinson, Adil Rasheed, Omer San
分類: cs.LG, cs.AI, cs.RO
原文アブストラクト
In this article, we explore the feasibility of applying proximal policy optimization, a state-of-the-art deep reinforcement learning algorithm for continuous control tasks, on the dual-objective problem of controlling an underactuated autonomous surface vehicle to follow an a priori known path while avoiding collisions with non-moving obstacles along the way. The artificial intelligent agent, which is equipped with multiple rangefinder sensors for obstacle detection, is trained and evaluated in a challenging, stochastically generated simulation environment based on the OpenAI gym python toolkit. Notably, the agent is provided with real-time insight into its own reward function, allowing it to dynamically adapt its guidance strategy. Depending on its strategy, which ranges from radical path-adherence to radical obstacle avoidance, the trained agent achieves an episodic success rate between 84 and 100%.
関連論文
- 深層強化学習による短時間高高度気球の季節別定位置保持強化学習/経路計画
- 低視界環境における強化学習ベースの避難経路生成強化学習/経路計画
- データ効率の良い深層強化学習によるUASミッション再計画のためのマルチスタートチームオリエンテーリング問題強化学習/経路計画
- 自律型車両による距離のみの水中目標位置推定のための強化学習経路計画手法強化学習/経路計画
