PDDLStreamを用いたタスク・動作計画における大規模言語モデルの系統的評価
A Systematic Study of Large Language Models for Task and Motion Planning With PDDLStream
LLMをタスク・動作計画(TAMP)の各構成要素に組み込む16種のアルゴリズムを実装し、13750回の評価で性能を比較した。LLMベースの計画は従来手法より成功率が低く時間もかかり、幾何情報の追加はタスク計画エラーを増やすことが分かった。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
分類: cs.RO, cs.AI
原文アブストラクト
While we know that large language models (LLMs) can solve some planning problems, we do not understand the extent of these capabilities for robotics. One promising direction is to integrate the semantic knowledge of LLMs with the formal reasoning of task and motion planning (TAMP). However, designing such systems is complicated by the myriad of choices for how to integrate LLMs within TAMP. We develop 16 algorithms that use LLMs to substitute key TAMP components. Our zero-shot experiments across 13750 evaluations and three domains reveal that LLM-based planners exhibit lower success rates and higher planning times than engineered systems. Providing geometric details increases the number of task-planning errors compared to pure PDDL descriptions, and (faster) direct LLM variants outperform (slower) reasoning variants in most cases. Code and results are available at https://github.com/jorge-a-mendez/llm-pddlstream.
