ロボットにおける視覚的自己運動学習に向けて
Towards Visual Ego-motion Learning in Robots
オプティカルフローから自己運動を推定するMixture Density NetworkベースのC-VAEモデルを提案し、GPS/INSと車輪オドメトリの融合による自己教師あり学習の有用性を示した。
著者: Sudeep Pillai, John J. Leonard
分類: cs.RO, cs.AI, cs.CV
原文アブストラクト
Many model-based Visual Odometry (VO) algorithms have been proposed in the past decade, often restricted to the type of camera optics, or the underlying motion manifold observed. We envision robots to be able to learn and perform these tasks, in a minimally supervised setting, as they gain more experience. To this end, we propose a fully trainable solution to visual ego-motion estimation for varied camera optics. We propose a visual ego-motion learning architecture that maps observed optical flow vectors to an ego-motion density estimate via a Mixture Density Network (MDN). By modeling the architecture as a Conditional Variational Autoencoder (C-VAE), our model is able to provide introspective reasoning and prediction for ego-motion induced scene-flow. Additionally, our proposed model is especially amenable to bootstrapped ego-motion learning in robots where the supervision in ego-motion estimation for a particular camera sensor can be obtained from standard navigation-based sensor fusion strategies (GPS/INS and wheel-odometry fusion). Through experiments, we show the utility of our proposed approach in enabling the concept of self-supervised learning for visual ego-motion estimation in autonomous robots.
