適応学習:表現ベース強化学習によるマルチタスクスキル転移
Learning to Adapt: Representation-Based Reinforcement Learning for Multi-Task Skill Transfer
スペクトルMDP分解を用いてタスク非依存のコアとタスク固有の調整に価値関数を構造化し、マルチタスク強化学習の効率的な知識共有と新タスクへの転移を実現するフレームワークRepMT-SACを提案した。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Aryan Naveen, Haitong Ma, Haldun Balim, Na Li
分類: cs.RO
原文アブストラクト
Reinforcement learning has achieved remarkable success in learning complex control policies, yet its applicability remains limited due to sample inefficiency and poor generalization across tasks. In this work, we propose RepMT-SAC, a framework for multi-task RL that enables efficient knowledge sharing and robust transfer to new tasks. RepMT-SAC uses spectral MDP decomposition to capture transferable dynamics, structuring the value function into a task-agnostic core with a minimal task-specific adjustment. This design allows for strong zero-shot performance on in-distribution tasks and rapid few-shot adaptation to out-of-distribution tasks. We evaluate RepMT-SAC on quadcopter trajectory-following tasks across in-distribution and out-of-distribution contexts, demonstrating that it outperforms baselines by up to 30%.
