FisheyeMultiNet:自動駐車向けリアルタイム多タスク学習アーキテクチャ
FisheyeMultiNet: Real-time Multi-task Learning Architecture for Surround-view Automated Parking System
車両周囲360度を魚眼カメラで撮影し、物体検出・セマンティックセグメンテーション・汚れ検出を同時に行う低消費電力向けリアルタイム深層学習ネットワークを提案した論文。
著者: Pullarao Maddu, Wayne Doherty, Ganesh Sistu, Isabelle Leang, Michal Uricar, Sumanth Chennupati, Hazem Rashed, Jonathan Horgan, Ciaran Hughes, Senthil Yogamani
分類: cs.CV, cs.RO
原文アブストラクト
Automated Parking is a low speed manoeuvring scenario which is quite unstructured and complex, requiring full 360{\deg} near-field sensing around the vehicle. In this paper, we discuss the design and implementation of an automated parking system from the perspective of camera based deep learning algorithms. We provide a holistic overview of an industrial system covering the embedded system, use cases and the deep learning architecture. We demonstrate a real-time multi-task deep learning network called FisheyeMultiNet, which detects all the necessary objects for parking on a low-power embedded system. FisheyeMultiNet runs at 15 fps for 4 cameras and it has three tasks namely object detection, semantic segmentation and soiling detection. To encourage further research, we release a partial dataset of 5,000 images containing semantic segmentation and bounding box detection ground truth via WoodScape project \cite{yogamani2019woodscape}.
