マルチリレーショナル連鎖を用いた逆強化学習によるロボット中心のスマートホーム
Inverse Reinforcement Learning with Multi-Relational Chains for Robot-Centered Smart Home
家庭内の物体状態変化をマルチリレーショナル連鎖で記述し、逆強化学習で操作者の行動を報酬関数として学習することで、動的環境下でもロボットが適切に行動選択できる手法を実機で検証した。
著者: Kun Li, Max Q. -H. Meng
分類: cs.RO, cs.LG
原文アブストラクト
In a robot-centered smart home, the robot observes the home states with its own sensors, and then it can change certain object states according to an operator's commands for remote operations, or imitate the operator's behaviors in the house for autonomous operations. To model the robot's imitation of the operator's behaviors in a dynamic indoor environment, we use multi-relational chains to describe the changes of environment states, and apply inverse reinforcement learning to encoding the operator's behaviors with a learned reward function. We implement this approach with a mobile robot, and do five experiments to include increasing training days, object numbers, and action types. Besides, a baseline method by directly recording the operator's behaviors is also implemented, and comparison is made on the accuracy of home state evaluation and the accuracy of robot action selection. The results show that the proposed approach handles dynamic environment well, and guides the robot's actions in the house more accurately.
