カラー化タスクによる深層補助学習を用いた視覚的自己位置推定
Deep auxiliary learning for visual localization using colorization task
画像のカラー化という自己教師ありタスクの特徴表現を位置推定ネットワークに組み込み、追加アノテーションなしで6-DoFカメラ姿勢回帰の精度を向上させた研究。
著者: Mi Tian, Qiong Nie, Hao Shen, Xiahua Xia
分類: cs.CV, cs.RO
原文アブストラクト
Visual localization is one of the most important components for robotics and autonomous driving. Recently, inspiring results have been shown with CNN-based methods which provide a direct formulation to end-to-end regress 6-DoF absolute pose. Additional information like geometric or semantic constraints is generally introduced to improve performance. Especially, the latter can aggregate high-level semantic information into localization task, but it usually requires enormous manual annotations. To this end, we propose a novel auxiliary learning strategy for camera localization by introducing scene-specific high-level semantics from self-supervised representation learning task. Viewed as a powerful proxy task, image colorization task is chosen as complementary task that outputs pixel-wise color version of grayscale photograph without extra annotations. In our work, feature representations from colorization network are embedded into localization network by design to produce discriminative features for pose regression. Meanwhile an attention mechanism is introduced for the benefit of localization performance. Extensive experiments show that our model significantly improve localization accuracy over state-of-the-arts on both indoor and outdoor datasets.
