意図駆動型LLMアンサンブル計画による柔軟なマルチロボット分解:EVバッテリーでの実証
Intent-Driven LLM Ensemble Planning for Flexible Multi-Robot Disassembly: Demonstration on EV Batteries
人間の言語指示と視覚情報をもとに、複数のLLMを組み合わせてロボットアームの分解動作手順を計画するパイプラインを提案し、EVバッテリーの分解タスクで評価した。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Cansu Erdogan, Cesar Alan Contreras, Alireza Rastegarpanah, Manolis Chiou, Rustam Stolkin
分類: cs.RO, cs.AI, cs.HC, cs.MA
原文アブストラクト
This paper addresses the problem of planning complex manipulation tasks, in which multiple robots with different end-effectors and capabilities, informed by computer vision, must plan and execute concatenated sequences of actions on a variety of objects that can appear in arbitrary positions and configurations in unstructured scenes. We propose an intent-driven planning pipeline which can robustly construct such action sequences with varying degrees of supervisory input from a human using simple language instructions. The pipeline integrates: (i) perception-to-text scene encoding, (ii) an ensemble of large language models (LLMs) that generate candidate removal sequences based on the operator's intent, (iii) an LLM-based verifier that enforces formatting and precedence constraints, and (iv) a deterministic consistency filter that rejects hallucinated objects. The pipeline is evaluated on an example task in which two robot arms work collaboratively to dismantle an Electric Vehicle battery for recycling applications. A variety of components must be grasped and removed in specific sequences, determined by human instructions and/or by task-order feasibility decisions made by the autonomous system. On 200 real scenes with 600 operator prompts across five component classes, we used metrics of full-sequence correctness and next-task correctness to evaluate and compare five LLM-based planners (including ablation analyses of pipeline components). We also evaluated the LLM-based human interface in terms of time to execution and NASA TLX with human participant experiments. Results indicate that our ensemble-with-verification approach reliably maps operator intent to safe, executable multi-robot plans while maintaining low user effort.
関連論文
- 神経記号的役割分担によるマルチロボットタスク計画マルチロボット計画
- 晩秋:LLMエージェントが汎用マルチロボットプランナを単一倉庫向けに特化マルチロボット計画
- GPS非依存環境における協調測位のための不確実性制約付きマルチロボット計画マルチロボット計画
- 確率的スキルを考慮したマルチロボット・マルチゴール動作計画マルチロボット計画
- 拡散モデルによるマルチロボット動作計画のための軌道レベルモード誘導マルチロボット計画
- MR. POP: ほぼ確実に漸近最適なマルチロボット並列最適化プランナマルチロボット計画
