オープンエンド学習ロボットにおける自律性と整合性の問題:目的フレームワークの形式化
The Autonomy-Alignment Problem in Open-Ended Learning Robots: Formalising the Purpose Framework
オープンエンド学習ロボットが人間の目的や価値観と整合しながら自律的に学ぶための「目的」概念を導入し、自律性と整合性の問題を4つの部分問題に分解して形式化する計算フレームワークを提案した。
著者: Gianluca Baldassarre, Richard J. Duro, Emilio Cartoni, Mehdi Khamassi, Alejandro Romero, Vieri Giuliano Santucci
分類: cs.RO, cs.AI, cs.LG
原文アブストラクト
The rapid advancement of artificial intelligence is enabling the development of increasingly autonomous robots capable of operating beyond engineered factory settings and into the unstructured environments of human life. This shift raises a critical autonomy-alignment problem: how to ensure that a robot's autonomous learning focuses on acquiring knowledge and behaviours that serve human practical objectives while remaining aligned with broader human values (e.g., safety and ethics). This problem remains largely underexplored and lacks a unifying conceptual and formal framework. Here, we address one of its most challenging instances of the problem: open-ended learning (OEL) robots, which autonomously acquire new knowledge and skills through interaction with the environment, guided by intrinsic motivations and self-generated goals. We propose a computational framework, introduced qualitatively and then formalised, to guide the design of OEL architectures that balance autonomy with human control. At its core is the novel concept of purpose, which specifies what humans (designers or users) want the robot to learn, do, or avoid, independently of specific task domains. The framework decomposes the autonomy-alignment problem into four tractable sub-problems: the alignment of robot purposes (hardwired or learnt) with human purposes; the arbitration between multiple purposes; the grounding of abstract purposes into domain-specific goals; and the acquisition of competence to achieve those goals. The framework supports formal definitions of alignment across multiple cases and proofs of necessary and sufficient conditions under which alignment holds. Illustrative hypothetical scenarios showcase the applicability of the framework for guiding the development of purpose-aligned autonomous robots.
関連論文
- ロボットのオープンエンド学習課題に向けた動機付けアーキテクチャオープンエンド学習
- ユーザーの目的に焦点を当てたロボットのオープンエンド強化学習オープンエンド学習
- 非定常な相互依存タスクの自律的オープンエンド学習オープンエンド学習
- REAL-X:真にエンドツーエンドな感覚運動自律学習を実現するロボットのオープンエンド学習アーキテクチャオープンエンド学習
- 相互依存タスクの自律的オープンエンド学習オープンエンド学習
