プロンプタブル・ビヘイビア:人間の選好に基づく多目的報酬のパーソナライズ
Promptable Behaviors: Personalizing Multi-Objective Rewards from Human Preferences
多目的強化学習で単一の方策を訓練し、実演・軌道比較への選好フィードバック・言語指示の3手法で人間の選好を推定してロボットの行動をパーソナライズするフレームワークを提案。
著者: Minyoung Hwang, Luca Weihs, Chanwoo Park, Kimin Lee, Aniruddha Kembhavi, Kiana Ehsani
分類: cs.CV, cs.AI, cs.RO
原文アブストラクト
Customizing robotic behaviors to be aligned with diverse human preferences is an underexplored challenge in the field of embodied AI. In this paper, we present Promptable Behaviors, a novel framework that facilitates efficient personalization of robotic agents to diverse human preferences in complex environments. We use multi-objective reinforcement learning to train a single policy adaptable to a broad spectrum of preferences. We introduce three distinct methods to infer human preferences by leveraging different types of interactions: (1) human demonstrations, (2) preference feedback on trajectory comparisons, and (3) language instructions. We evaluate the proposed method in personalized object-goal navigation and flee navigation tasks in ProcTHOR and RoboTHOR, demonstrating the ability to prompt agent behaviors to satisfy human preferences in various scenarios. Project page: https://promptable-behaviors.github.io
