視覚入力の価値を評価する:ロボット経路計画のためのマルチモーダル大規模言語モデルのベンチマーク
Assessing the Value of Visual Input: A Benchmark of Multimodal Large Language Models for Robotic Path Planning
15のマルチモーダルLLMを2Dグリッド上の経路計画タスクで評価し、テキストのみと視覚追加の入力を比較した結果、小規模グリッドでは視覚入力が有効な場合もあるが、大規模グリッドでは性能が大幅に低下し、スケーラビリティと空間推論に課題があることを示した。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Jacinto Colan, Ana Davila, Yasuhisa Hasegawa
分類: cs.RO
原文アブストラクト
Large Language Models (LLMs) show potential for enhancing robotic path planning. This paper assesses visual input's utility for multimodal LLMs in such tasks via a comprehensive benchmark. We evaluated 15 multimodal LLMs on generating valid and optimal paths in 2D grid environments, simulating simplified robotic planning, comparing text-only versus text-plus-visual inputs across varying model sizes and grid complexities. Our results indicate moderate success rates on simpler small grids, where visual input or few-shot text prompting offered some benefits. However, performance significantly degraded on larger grids, highlighting a scalability challenge. While larger models generally achieved higher average success, the visual modality was not universally dominant over well-structured text for these multimodal systems, and successful paths on simpler grids were generally of high quality. These results indicate current limitations in robust spatial reasoning, constraint adherence, and scalable multimodal integration, identifying areas for future LLM development in robotic path planning.
