幾何学的整合性を利用した自己教師あり端到端ビジュアルオドメトリ
Geometric Consistency for Self-Supervised End-to-End Visual Odometry
ノイズを含む教師信号と軌道の幾何学的整合性を強制する損失項を用い、正解ラベルなしで深層ビジュアルオドメトリを学習する自己教師あり手法を提案した。
著者: Ganesh Iyer, J. Krishna Murthy, Gunshi Gupta, K. Madhava Krishna, Liam Paull
分類: cs.RO, cs.CV
原文アブストラクト
With the success of deep learning based approaches in tackling challenging problems in computer vision, a wide range of deep architectures have recently been proposed for the task of visual odometry (VO) estimation. Most of these proposed solutions rely on supervision, which requires the acquisition of precise ground-truth camera pose information, collected using expensive motion capture systems or high-precision IMU/GPS sensor rigs. In this work, we propose an unsupervised paradigm for deep visual odometry learning. We show that using a noisy teacher, which could be a standard VO pipeline, and by designing a loss term that enforces geometric consistency of the trajectory, we can train accurate deep models for VO that do not require ground-truth labels. We leverage geometry as a self-supervisory signal and propose "Composite Transformation Constraints (CTCs)", that automatically generate supervisory signals for training and enforce geometric consistency in the VO estimate. We also present a method of characterizing the uncertainty in VO estimates thus obtained. To evaluate our VO pipeline, we present exhaustive ablation studies that demonstrate the efficacy of end-to-end, self-supervised methodologies to train deep models for monocular VO. We show that leveraging concepts from geometry and incorporating them into the training of a recurrent neural network results in performance competitive to supervised deep VO methods.
関連論文
- 球面バンドル調整ガイド付き教師なし深度学習によるスケール整合単眼魚眼ビジュアルオドメトリビジュアルオドメトリ
- ROEVO: RGB-Dカメラを用いたロバストな組織化エッジ特徴に基づくビジュアルオドメトリビジュアルオドメトリ
- スパース点群出力を備えた深層イベントビジュアルオドメトリの拡張ビジュアルオドメトリ
- HyVGGT-VO: フィードフォワードモデルと密結合したハイブリッド高密度ビジュアルオドメトリビジュアルオドメトリ
- RGB-Dカメラを用いた高速軽量な非反復型ビジュアルオドメトリビジュアルオドメトリ
- 屋内環境向け連続3Dガウスマップを用いた直接スパースオドメトリビジュアルオドメトリ
