屋内環境向けモジュール型視覚言語行動ロボティクスフレームワーク
A Modular Vision-Language-Action Robotics Framework for Indoor Environments
自然言語指示に基づき自律エージェントが複雑なタスクを実行するための、環境マッピング・質問処理・ナビゲーションを統合したモジュール型フレームワークを提案した論文。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Anindya Jana, Snehasis Banerjee, Arup Sadhu, Ranjan Dasgupta
分類: cs.RO, cs.AI
原文アブストラクト
This paper presents an integrated system for the CMU Vision-Language-Action (VLA) Challenge, designed to enable an autonomous agent to perform complex tasks based on natural language instructions. Our framework employs a modular architecture that orchestrates environment mapping, question processing, and navigation. The system operates in two parallel streams: a perception pipeline that constructs a semantic voxel map from real-time camera feeds using OwlViT embeddings, and a language pipeline that classifies user commands with a Vision-Language Model. The mapping is time-constrained; the system proceeds with a partial map if a 500-second exploration limit is reached. The classified query is then grounded in the geometric and semantic context of the map to generate a detailed prompt for the VLM. This yields an actionable output, demonstrating a capable solution for bridging the gap between human language and robotic action.
