GIFT: 意図の一般化による柔軟なテスト時報酬
GIFT: Generalizing Intent for Flexible Test-Time Rewards
ロボットがデモから学習した報酬関数の汎化を、見た目や意味の類似性ではなく人間の意図に基づいて行うフレームワークGIFTを提案。言語モデルで意図を推定し、テスト時の状態を意図条件付き類似度で対応付けることで、再学習なしに分布シフトへ対応する。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Fin Amin, Nathaniel Dennler, Andreea Bobu
分類: cs.RO
原文アブストラクト
Robots learn reward functions from user demonstrations, but these rewards often fail to generalize to new environments. This failure occurs because learned rewards latch onto spurious correlations in training data rather than the underlying human intent that demonstrations represent. Existing methods leverage visual or semantic similarity to improve robustness, yet these surface-level cues often diverge from what humans actually care about. We present Generalizing Intent for Flexible Test-Time Rewards (GIFT), a framework that grounds reward generalization in human intent rather than surface cues. GIFT leverages language models to infer high-level intent from user demonstrations by contrasting preferred with non-preferred behaviors. At deployment, GIFT maps novel test states to behaviorally equivalent training states via intent-conditioned similarity, enabling learned rewards to generalize across distribution shifts without retraining. We evaluate GIFT on tabletop manipulation tasks with new objects and layouts. Across four simulated tasks with over 50 unseen objects, GIFT consistently outperforms visual and semantic similarity baselines in test-time pairwise win rate and state-alignment F1 score. Real-world experiments on a 7-DoF Franka Panda robot demonstrate that GIFT reliably transfers to physical settings. Further discussion can be found at https://mit-clear-lab.github.io/GIFT/
関連論文
- グラフベース能動報酬学習による汎化可能な空間目標表現の発見模倣学習/報酬学習
