説明可能なロボットシステム:強化学習シナリオにおける目標駆動型行動の理解
Explainable robotic systems: Understanding goal-driven actions in a reinforcement learning scenario
強化学習でタスクを行うロボットの意思決定過程に着目し、記憶ベース・学習ベース・内省ベースの3手法で成功確率を算出して行動を説明する。決定論的ナビゲーション、確率的ナビゲーション、連続視覚ベース物体選別の3設定で実験した。
著者: Francisco Cruz, Richard Dazeley, Peter Vamplew, Ithan Moreira
分類: cs.AI, cs.RO
原文アブストラクト
Robotic systems are more present in our society everyday. In human-robot environments, it is crucial that end-users may correctly understand their robotic team-partners, in order to collaboratively complete a task. To increase action understanding, users demand more explainability about the decisions by the robot in particular situations. Recently, explainable robotic systems have emerged as an alternative focused not only on completing a task satisfactorily, but also on justifying, in a human-like manner, the reasons that lead to making a decision. In reinforcement learning scenarios, a great effort has been focused on providing explanations using data-driven approaches, particularly from the visual input modality in deep learning-based systems. In this work, we focus rather on the decision-making process of reinforcement learning agents performing a task in a robotic scenario. Experimental results are obtained using 3 different set-ups, namely, a deterministic navigation task, a stochastic navigation task, and a continuous visual-based sorting object task. As a way to explain the goal-driven robot's actions, we use the probability of success computed by three different proposed approaches: memory-based, learning-based, and introspection-based. The difference between these approaches is the amount of memory required to compute or estimate the probability of success as well as the kind of reinforcement learning representation where they could be used. In this regard, we use the memory-based approach as a baseline since it is obtained directly from the agent's observations. When comparing the learning-based and the introspection-based approaches to this baseline, both are found to be suitable alternatives to compute the probability of success, obtaining high levels of similarity when compared using both the Pearson's correlation and the mean squared error.
