細かい時間スケールでのベータ評判を用いた人間-ロボット協調における信頼推定の改善
Improving Trust Estimation in Human-Robot Collaboration Using Beta Reputation at Fine-grained Timescales
人間-ロボット協調において、連続的な報酬値を用いてベータ評判を各タイムステップで更新し、最大エントロピー最適化で報酬関数を自動構築することで、人手をかけずに細かい時間スケールで人間の信頼を高精度に推定するフレームワークを提案した。
著者: Resul Dagdanov, Milan Andrejevic, Dikai Liu, Chin-Teng Lin
分類: cs.RO, cs.AI, cs.HC, cs.LG
原文アブストラクト
When interacting with each other, humans adjust their behavior based on perceived trust. To achieve similar adaptability, robots must accurately estimate human trust at sufficiently granular timescales while collaborating with humans. Beta reputation is a popular way to formalize a mathematical estimation of human trust. However, it relies on binary performance, which updates trust estimations only after each task concludes. Additionally, manually crafting a reward function is the usual method of building a performance indicator, which is labor-intensive and time-consuming. These limitations prevent efficient capture of continuous trust changes at more granular timescales throughout the collaboration task. Therefore, this paper presents a new framework for the estimation of human trust using beta reputation at fine-grained timescales. To achieve granularity in beta reputation, we utilize continuous reward values to update trust estimates at each timestep of a task. We construct a continuous reward function using maximum entropy optimization to eliminate the need for the laborious specification of a performance indicator. The proposed framework improves trust estimations by increasing accuracy, eliminating the need to manually craft a reward function, and advancing toward the development of more intelligent robots.
