動作スタイル転移:深層動作予測のためのモジュラー低ランク適応
Motion Style Transfer: Modular Low-Rank Adaptation for Deep Motion Forecasting
事前学習済み動作予測モデルを新しいエージェント種別やシーンに効率的に適応させるため、低ランクのスタイルアダプタとモジュラー戦略を提案し、予測精度を向上させた。
著者: Parth Kothari, Danya Li, Yuejiang Liu, Alexandre Alahi
分類: cs.CV, cs.RO
原文アブストラクト
Deep motion forecasting models have achieved great success when trained on a massive amount of data. Yet, they often perform poorly when training data is limited. To address this challenge, we propose a transfer learning approach for efficiently adapting pre-trained forecasting models to new domains, such as unseen agent types and scene contexts. Unlike the conventional fine-tuning approach that updates the whole encoder, our main idea is to reduce the amount of tunable parameters that can precisely account for the target domain-specific motion style. To this end, we introduce two components that exploit our prior knowledge of motion style shifts: (i) a low-rank motion style adapter that projects and adjusts the style features at a low-dimensional bottleneck; and (ii) a modular adapter strategy that disentangles the features of scene context and motion history to facilitate a fine-grained choice of adaptation layers. Through extensive experimentation, we show that our proposed adapter design, coined MoSA, outperforms prior methods on several forecasting benchmarks.
