オープンエンドなロボット問題を学習するための多目的アルゴリズム
Multi-Objective Algorithms for Learning Open-Ended Robotic Problems
多目的進化アルゴリズムを自動カリキュラム学習として用いる手法(MOL)を提案し、四足歩行ロボットの強化学習において安定性と適応性を向上させた。
著者: Martin Robert, Simon Brodeur, Francois Ferland
分類: cs.RO, cs.NE
原文アブストラクト
Quadrupedal locomotion is a complex, open-ended problem vital to expanding autonomous vehicle reach. Traditional reinforcement learning approaches often fall short due to training instability and sample inefficiency. We propose a novel method leveraging multi-objective evolutionary algorithms as an automatic curriculum learning mechanism, which we named Multi-Objective Learning (MOL). Our approach significantly enhances the learning process by projecting velocity commands into an objective space and optimizing for both performance and diversity. Tested within the MuJoCo physics simulator, our method demonstrates superior stability and adaptability compared to baseline approaches. As such, it achieved 19\% and 44\% fewer errors against our best baseline algorithm in difficult scenarios based on a uniform and tailored evaluation respectively. This work introduces a robust framework for training quadrupedal robots, promising significant advancements in robotic locomotion and open-ended robotic problems.
