悪天候下でも通用する視覚ベース車両制御のための教師なしドメイン適応
Towards Generalizing Sensorimotor Control Across Weather Conditions
1つの天候条件のステアリング角度ラベルのみを用い、画像変換ネットワークと教師-生徒学習で複数の異なる天候条件へ制御を転移させるフレームワークを提案した。
著者: Qadeer Khan, Patrick Wenzel, Daniel Cremers, Laura Leal-Taixé
分類: cs.LG, cs.CV, cs.RO, stat.ML
原文アブストラクト
The ability of deep learning models to generalize well across different scenarios depends primarily on the quality and quantity of annotated data. Labeling large amounts of data for all possible scenarios that a model may encounter would not be feasible; if even possible. We propose a framework to deal with limited labeled training data and demonstrate it on the application of vision-based vehicle control. We show how limited steering angle data available for only one condition can be transferred to multiple different weather scenarios. This is done by leveraging unlabeled images in a teacher-student learning paradigm complemented with an image-to-image translation network. The translation network transfers the images to a new domain, whereas the teacher provides soft supervised targets to train the student on this domain. Furthermore, we demonstrate how utilization of auxiliary networks can reduce the size of a model at inference time, without affecting the accuracy. The experiments show that our approach generalizes well across multiple different weather conditions using only ground truth labels from one domain.
