ToP-ToM: 心の理論に基づく信頼考慮型ロボット政策
ToP-ToM: Trust-aware Robot Policy with Theory of Mind
人間とロボットが協力して別の人間と対戦するマルチエージェント環境で、ロボットが心の理論を用いて人間の信頼信念を推定し、信頼崩壊を避けつつ協調する政策学習手法を提案した。
著者: Chuang Yu, Baris Serhan, Angelo Cangelosi
分類: cs.RO, cs.AI
原文アブストラクト
Theory of Mind (ToM) is a fundamental cognitive architecture that endows humans with the ability to attribute mental states to others. Humans infer the desires, beliefs, and intentions of others by observing their behavior and, in turn, adjust their actions to facilitate better interpersonal communication and team collaboration. In this paper, we investigated trust-aware robot policy with the theory of mind in a multiagent setting where a human collaborates with a robot against another human opponent. We show that by only focusing on team performance, the robot may resort to the reverse psychology trick, which poses a significant threat to trust maintenance. The human's trust in the robot will collapse when they discover deceptive behavior by the robot. To mitigate this problem, we adopt the robot theory of mind model to infer the human's trust beliefs, including true belief and false belief (an essential element of ToM). We designed a dynamic trust-aware reward function based on different trust beliefs to guide the robot policy learning, which aims to balance between avoiding human trust collapse due to robot reverse psychology. The experimental results demonstrate the importance of the ToM-based robot policy for human-robot trust and the effectiveness of our robot ToM-based robot policy in multiagent interaction settings.
関連論文
- 観察・共有・予測:身体性マルチエージェント協調におけるパートナー情報の disentangleマルチエージェント協調
- 残差デノイジングによるサンプル効率の良いオンデマンド多エージェント協調マルチエージェント協調
- SyncPlan: 明示的同期と適応的修正による長期的LLM協調マルチエージェント協調
- MECoBench: 具現化環境におけるマルチモーダルエージェント協調の体系的研究マルチエージェント協調
- LLawCo: 協調の法則を学習して具現化マルチエージェント行動をモデル化するマルチエージェント協調
- CoEnv: 構成環境による身体化マルチエージェント協調の推進マルチエージェント協調
