教師なし画像変換でシミュレーションと現実のギャップを埋める
Closing the Reality Gap with Unsupervised Sim-to-Real Image Translation
実世界画像のスタイルをシミュレーション画像に適用する教師なし画像変換で学習データを拡張し、自律サッカーロボットの認識性能を向上させた研究。
著者: Jan Blumenkamp, Andreas Baude, Tim Laue
分類: cs.LG, cs.CV, cs.RO
原文アブストラクト
Deep learning approaches have become the standard solution to many problems in computer vision and robotics, but obtaining sufficient training data in high enough quality is challenging, as human labor is error prone, time consuming, and expensive. Solutions based on simulation have become more popular in recent years, but the gap between simulation and reality is still a major issue. In this paper, we introduce a novel method for augmenting synthetic image data through unsupervised image-to-image translation by applying the style of real world images to simulated images with open source frameworks. The generated dataset is combined with conventional augmentation methods and is then applied to a neural network model running in real-time on autonomous soccer robots. Our evaluation shows a significant improvement compared to models trained on images generated entirely in simulation.
