アクションフローマッチングによる継続的ロボット学習
Action Flow Matching for Continual Robot Learning
フローマッチングを用いてロボットの動力学モデルをオンラインで適応させ、計画した行動をモデルに合わせて修正することで、効率的に学習を進める手法を提案。地上車両とクアッドロータで検証し、タスク成功率が34.2%向上した。
著者: Alejandro Murillo-Gonzalez, Lantao Liu
分類: cs.RO, cs.AI
原文アブストラクト
Continual learning in robotics seeks systems that can constantly adapt to changing environments and tasks, mirroring human adaptability. A key challenge is refining dynamics models, essential for planning and control, while addressing issues such as safe adaptation, catastrophic forgetting, outlier management, data efficiency, and balancing exploration with exploitation -- all within task and onboard resource constraints. Towards this goal, we introduce a generative framework leveraging flow matching for online robot dynamics model alignment. Rather than executing actions based on a misaligned model, our approach refines planned actions to better match with those the robot would take if its model was well aligned. We find that by transforming the actions themselves rather than exploring with a misaligned model -- as is traditionally done -- the robot collects informative data more efficiently, thereby accelerating learning. Moreover, we validate that the method can handle an evolving and possibly imperfect model while reducing, if desired, the dependency on replay buffers or legacy model snapshots. We validate our approach using two platforms: an unmanned ground vehicle and a quadrotor. The results highlight the method's adaptability and efficiency, with a record 34.2\% higher task success rate, demonstrating its potential towards enabling continual robot learning. Code: https://github.com/AlejandroMllo/action_flow_matching.
