長期・短期の振り返りと最適化による進化可能な身体化エージェントによるロボット操作
Evolvable Embodied Agent for Robotic Manipulation via Long Short-Term Reflection and Optimization
大規模視覚言語モデルを用いて環境解釈と方策計画を行い、長期・短期の振り返り機構でプロンプトを動的に改善することで、ロボットが自己進化し複雑な操作タスクの成功率を高めるフレームワークを提案した。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Jianzong Wang, Botao Zhao, Yayun He, Junqing Peng, Xulong Zhang
分類: cs.RO, cs.CV
原文アブストラクト
Achieving general-purpose robotics requires empowering robots to adapt and evolve based on their environment and feedback. Traditional methods face limitations such as extensive training requirements, difficulties in cross-task generalization, and lack of interpretability. Prompt learning offers new opportunities for self-evolving robots without extensive training, but simply reflecting on past experiences. However, extracting meaningful insights from task successes and failures remains a challenge. To this end, we propose the evolvable embodied agent (EEAgent) framework, which leverages large vision-language models (VLMs) for better environmental interpretation and policy planning. To enhance reflection on past experiences, we propose a long short-term reflective optimization (LSTRO) mechanism that dynamically refines prompts based on both past experiences and newly learned lessons, facilitating continuous self-evolution, thereby enhancing overall task success rates. Evaluations on six VIMA-Bench tasks reveal that our approach sets a new state-of-the-art, notably outperforming baselines in complex scenarios.
