不確実性ガイドによるLLM支援を活用した棄権対応の個人化物体再配置
Abstention-Aware Personalized Object Rearrangement via Uncertainty-Guided LLM Assistance
家庭環境での物体再配置において、置くべき場所の予測だけでなく、置くべきでない場合の判断も重要です。本研究では、軽量な個人化埋め込みモデルと選択的な大規模言語モデル支援を組み合わせたハイブリッドフレームワークAPOLLOを提案し、不確実性推定に基づいて曖昧な決定のみLLMを呼び出すことで、効率性・プライバシー・推論能力のバランスを実現しました。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Sam Collin, Ali Ayub
分類: cs.RO
原文アブストラクト
Robotic assistance in household environments requires not only predicting where objects should be placed, but also reasoning about when objects should not be placed at all. Existing approaches to personalized object rearrangement primarily focus on placement decisions under the assumption of clean observations and complete actionability, limiting their applicability in realistic, cluttered, and partially erroneous settings. In this paper, we introduce APOLLO, a hybrid framework for abstention-aware personalized object rearrangement that combines a lightweight, personalized embedding model (PEM) with selective large language model (LLM) assistance. PEM is trained for each user-environment pair using a small number of demonstrations, operates entirely on CPU, and produces uncertainty estimates, which are used to selectively invoke LLM-based reasoning only for ambiguous decisions, balancing efficiency, privacy, and reasoning capability. To evaluate this formulation beyond existing benchmarks, we introduce APOR, a synthetic, LLM-generated dataset that captures room-level, multi-furniture environments, diverse organizational profiles, explicit abstention behavior, and noisy partial scene context. Extensive experiments on both PARSEC and APOR provide initial evidence that APOLLO improves over prior LLM-based baselines in controlled benchmark settings while substantially reducing LLM usage. Code is available at https://github.com/PaInt-Lab/APOLLO.
