深層学習とマルチモーダルセンシングによる小型クアッドコプターの追跡と状態推定
Deep Learning based Multi-Modal Sensing for Tracking and State Extraction of Small Quadcopters
単眼RGB・熱画像・2D LiDARを組み合わせ、深層学習で小型ドローンの検出・追跡・位置推定を行うパイプラインを構築した研究。
著者: Zhibo Zhang, Chen Zeng, Maulikkumar Dhameliya, Souma Chowdhury, Rahul Rai
分類: cs.CV, cs.AI, cs.RO
原文アブストラクト
This paper proposes a multi-sensor based approach to detect, track, and localize a quadcopter unmanned aerial vehicle (UAV). Specifically, a pipeline is developed to process monocular RGB and thermal video (captured from a fixed platform) to detect and track the UAV in our FoV. Subsequently, a 2D planar lidar is used to allow conversion of pixel data to actual distance measurements, and thereby enable localization of the UAV in global coordinates. The monocular data is processed through a deep learning-based object detection method that computes an initial bounding box for the UAV. The thermal data is processed through a thresholding and Kalman filter approach to detect and track the bounding box. Training and testing data are prepared by combining a set of original experiments conducted in a motion capture environment and publicly available UAV image data. The new pipeline compares favorably to existing methods and demonstrates promising tracking and localization capacity of sample experiments.
関連論文
- 路側マルチモーダルセンシングにおける高解像度と低解像度のトレードオフマルチモーダルセンシング
- 小売環境向け電源投入即稼働ロボットのためのマルチモーダルデータ融合マルチモーダルセンシング
