曖昧な目標から協調を築く:実世界の人間-ロボット協調のための進化的価値学習
Forming Real-World Human-Robot Cooperation for Tasks With General Goal
人間が最初は漠然とした目標しか持たない協調作業で、目標が具体化していく過程をベイズ推論でモデル化し、深層強化学習でロボットが能動的に目標特定を促す協調方策を学習した。
著者: Lingfeng Tao, Michael Bowman, Jiucai Zhang, Xiaoli Zhang
分類: cs.RO, cs.AI
原文アブストラクト
In human-robot cooperation, the robot cooperates with humans to accomplish the task together. Existing approaches assume the human has a specific goal during the cooperation, and the robot infers and acts toward it. However, in real-world environments, a human usually only has a general goal (e.g., general direction or area in motion planning) at the beginning of the cooperation, which needs to be clarified to a specific goal (i.e., an exact position) during cooperation. The specification process is interactive and dynamic, which depends on the environment and the partner's behavior. The robot that does not consider the goal specification process may cause frustration to the human partner, elongate the time to come to an agreement, and compromise team performance. This work presents the Evolutionary Value Learning approach to model the dynamics of the goal specification process with State-based Multivariate Bayesian Inference and goal specificity-related features. This model enables the robot to enhance the process of the human's goal specification actively and find a cooperative policy in a Deep Reinforcement Learning manner. Our method outperforms existing methods with faster goal specification processes and better team performance in a dynamic ball balancing task with real human subjects.
