人間の専門知識を連続空間に統合する:選好期待改善を用いた対話型ベイズ最適化フレームワーク
Integrating Human Expertise in Continuous Spaces: A Novel Interactive Bayesian Optimization Framework with Preference Expected Improvement
連続状態・行動空間で人間の選好を確率的にモデル化し、新たな獲得関数PEIでロボットの学習を効率化する対話型ベイズ最適化を提案し、Franka Pandaロボットで実証した。
著者: Nikolaus Feith, Elmar Rueckert
分類: cs.RO, cs.AI, cs.HC, cs.LG
原文アブストラクト
Interactive Machine Learning (IML) seeks to integrate human expertise into machine learning processes. However, most existing algorithms cannot be applied to Realworld Scenarios because their state spaces and/or action spaces are limited to discrete values. Furthermore, the interaction of all existing methods is restricted to deciding between multiple proposals. We therefore propose a novel framework based on Bayesian Optimization (BO). Interactive Bayesian Optimization (IBO) enables collaboration between machine learning algorithms and humans. This framework captures user preferences and provides an interface for users to shape the strategy by hand. Additionally, we've incorporated a new acquisition function, Preference Expected Improvement (PEI), to refine the system's efficiency using a probabilistic model of the user preferences. Our approach is geared towards ensuring that machines can benefit from human expertise, aiming for a more aligned and effective learning process. In the course of this work, we applied our method to simulations and in a real world task using a Franka Panda robot to show human-robot collaboration.
関連論文
- 地球非依存の異常トリアージに向けた証拠駆動型ヒューマン・エージェント・ロボット協調ヒューマン・ロボット協調
