悪天候下でも頑健なセマンティックセグメンテーションのためのセンサデータ融合
Robust Semantic Segmentation in Adverse Weather Conditions by means of Sensor Data Fusion
カメラとLiDARの2種類のセンサ融合アーキテクチャを比較し、未知のノイズに強い学習法(RLM)を適用することで悪天候時のセグメンテーション精度とロバスト性が大幅に向上することを示した。
著者: Andreas Pfeuffer, Klaus Dietmayer
分類: cs.CV, cs.LG, cs.RO
原文アブストラクト
A robust and reliable semantic segmentation in adverse weather conditions is very important for autonomous cars, but most state-of-the-art approaches only achieve high accuracy rates in optimal weather conditions. The reason is that they are only optimized for good weather conditions and given noise models. However, most of them fail, if data with unknown disturbances occur, and their performance decrease enormously. One possibility to still obtain reliable results is to observe the environment with different sensor types, such as camera and lidar, and to fuse the sensor data by means of neural networks, since different sensors behave differently in diverse weather conditions. Hence, the sensors can complement each other by means of an appropriate sensor data fusion. Nevertheless, the fusion-based approaches are still susceptible to disturbances and fail to classify disturbed image areas correctly. This problem can be solved by means of a special training method, the so called Robust Learning Method (RLM), a method by which the neural network learns to handle unknown noise. In this work, two different sensor fusion architectures for semantic segmentation are compared and evaluated on several datasets. Furthermore, it is shown that the RLM increases the robustness in adverse weather conditions enormously, and achieve good results although no disturbance model has been learned by the neural network.
