RECALL: 視覚言語行動モデルにおける能動的生涯学習のための回復経験収集
RECALL: Recovery Experience Collection for Active Lifelong Learning in Vision-Language-Action Models
この論文は、視覚言語行動モデルを能動的かつ継続的に学習させる手法を提案し、不確実性に基づくデータ収集が受動的な模倣学習よりも効率的であることを示す一方、回復データのみでの微調整が破滅的忘却を引き起こすことを明らかにし、継続学習技術の評価を行っています。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Ulas Berk Karli, Tesca Fitzgerald
分類: cs.RO, cs.AI, cs.LG
原文アブストラクト
Vision-Language-Action (VLA) models are commonly fine-tuned through passive imitation learning, where additional demonstrations are collected for tasks where the policy performs poorly. This approach incurs several downsides: it requires the robot to fail before data collection is triggered, provides little guidance about which states require supervision, and wastes demonstrator effort on redundant parts of the task where the policy already performs well. In this paper, we propose an active, continual learning paradigm for VLAs. We demonstrate that active, uncertainty-guided data collection leads to more efficient fine-tuning than when using passively-collected demonstrations. However, we also find that fine-tuning only on actively-collected recovery data leads to catastrophic forgetting. We evaluate techniques for continual learning, including replay-based data mixing and elastic weight consolidation, and identify tradeoffs between plasticity to uncertainty-guided recovery data and retention of previously learned behaviors. Overall, our work contributes an empirical study of active continual learning for autoregressive VLAs, establishing that uncertainty-guided recovery demonstrations can improve adaptation efficiency while also revealing open challenges when targeted new data is incorporated into large robot policies.
