RoboFactory:構成制約を用いた身体性マルチエージェント協調の探求
RoboFactory: Exploring Embodied Agent Collaboration with Compositional Constraints
身体性マルチエージェント系のための構成制約の概念を提案し、自動データ収集フレームワークとマルチエージェント操作の初のベンチマークRoboFactoryを構築した。模倣学習の適用と性能分析も行う。
著者: Yiran Qin, Li Kang, Xiufeng Song, Zhenfei Yin, Xiaohong Liu, Xihui Liu, Ruimao Zhang, Lei Bai
分類: cs.RO, cs.AI, cs.CV, cs.LG
原文アブストラクト
Designing effective embodied multi-agent systems is critical for solving complex real-world tasks across domains. Due to the complexity of multi-agent embodied systems, existing methods fail to automatically generate safe and efficient training data for such systems. To this end, we propose the concept of compositional constraints for embodied multi-agent systems, addressing the challenges arising from collaboration among embodied agents. We design various interfaces tailored to different types of constraints, enabling seamless interaction with the physical world. Leveraging compositional constraints and specifically designed interfaces, we develop an automated data collection framework for embodied multi-agent systems and introduce the first benchmark for embodied multi-agent manipulation, RoboFactory. Based on RoboFactory benchmark, we adapt and evaluate the method of imitation learning and analyzed its performance in different difficulty agent tasks. Furthermore, we explore the architectures and training strategies for multi-agent imitation learning, aiming to build safe and efficient embodied multi-agent systems.
関連論文
- 観察・共有・予測:身体性マルチエージェント協調におけるパートナー情報の disentangleマルチエージェント協調
- 残差デノイジングによるサンプル効率の良いオンデマンド多エージェント協調マルチエージェント協調
- SyncPlan: 明示的同期と適応的修正による長期的LLM協調マルチエージェント協調
- MECoBench: 具現化環境におけるマルチモーダルエージェント協調の体系的研究マルチエージェント協調
- LLawCo: 協調の法則を学習して具現化マルチエージェント行動をモデル化するマルチエージェント協調
- CoEnv: 構成環境による身体化マルチエージェント協調の推進マルチエージェント協調
