身体性ナビゲーション軌道学習器ENTL
ENTL: Embodied Navigation Trajectory Learner
世界モデリング・自己位置推定・模倣学習を単一の系列予測タスクに統合し、報酬信号なしで事前学習することで複数のナビゲーションタスクに汎化する手法を提案。
著者: Klemen Kotar, Aaron Walsman, Roozbeh Mottaghi
分類: cs.CV, cs.RO
原文アブストラクト
We propose Embodied Navigation Trajectory Learner (ENTL), a method for extracting long sequence representations for embodied navigation. Our approach unifies world modeling, localization and imitation learning into a single sequence prediction task. We train our model using vector-quantized predictions of future states conditioned on current states and actions. ENTL's generic architecture enables sharing of the spatio-temporal sequence encoder for multiple challenging embodied tasks. We achieve competitive performance on navigation tasks using significantly less data than strong baselines while performing auxiliary tasks such as localization and future frame prediction (a proxy for world modeling). A key property of our approach is that the model is pre-trained without any explicit reward signal, which makes the resulting model generalizable to multiple tasks and environments.
