REAL-X:真にエンドツーエンドな感覚運動自律学習を実現するロボットのオープンエンド学習アーキテクチャ
REAL-X -- Robot open-Ended Autonomous Learning Architectures: Achieving Truly End-to-End Sensorimotor Autonomous Learning Systems
カメラアームロボットが自律的に物体と関わり感覚運動能力を獲得し、未知タスクに汎化するベンチマークREALに取り組み、探索・疎報酬・物体学習・目標自己生成などを統合したREAL-Xアーキテクチャを提案した論文。
著者: Emilio Cartoni, Davide Montella, Jochen Triesch, Gianluca Baldassarre
分類: cs.RO, cs.AI
原文アブストラクト
Open-ended learning is a core research field of developmental robotics and AI aiming to build learning machines and robots that can autonomously acquire knowledge and skills incrementally as infants and children. The first contribution of this work is to study the challenges posed by the previously proposed benchmark `REAL competition' aiming to foster the development of truly open-ended learning robot architectures. The competition involves a simulated camera-arm robot that: (a) in a first `intrinsic phase' acquires sensorimotor competence by autonomously interacting with objects; (b) in a second `extrinsic phase' is tested with tasks unknown in the intrinsic phase to measure the quality of knowledge previously acquired. This benchmark requires the solution of multiple challenges usually tackled in isolation, in particular exploration, sparse-rewards, object learning, generalisation, task/goal self-generation, and autonomous skill learning. As a second contribution, we present a set of `REAL-X' robot architectures that are able to solve different versions of the benchmark, where we progressively release initial simplifications. The architectures are based on a planning approach that dynamically increases abstraction, and intrinsic motivations to foster exploration. REAL-X achieves a good performance level in very demanding conditions. We argue that the REAL benchmark represents a valuable tool for studying open-ended learning in its hardest form.
関連論文
- ロボットのオープンエンド学習課題に向けた動機付けアーキテクチャオープンエンド学習
- ユーザーの目的に焦点を当てたロボットのオープンエンド強化学習オープンエンド学習
- オープンエンド学習ロボットにおける自律性と整合性の問題:目的フレームワークの形式化オープンエンド学習
- 非定常な相互依存タスクの自律的オープンエンド学習オープンエンド学習
- 相互依存タスクの自律的オープンエンド学習オープンエンド学習
