PCA-RECT: イベントカメラ向け省エネ物体検出法
PCA-RECT: An Energy-efficient Object Detection Approach for Event Cameras
イベントカメラの局所活動を蓄積しPCAで特徴抽出、k-d木で高速マッチングする純イベント型の省電力物体検出・分類システムを提案し、FPGA実装で有効性を示した。
著者: Bharath Ramesh, Andres Ussa, Luca Della Vedova, Hong Yang, Garrick Orchard
分類: cs.CV, cs.RO
原文アブストラクト
We present the first purely event-based, energy-efficient approach for object detection and categorization using an event camera. Compared to traditional frame-based cameras, choosing event cameras results in high temporal resolution (order of microseconds), low power consumption (few hundred mW) and wide dynamic range (120 dB) as attractive properties. However, event-based object recognition systems are far behind their frame-based counterparts in terms of accuracy. To this end, this paper presents an event-based feature extraction method devised by accumulating local activity across the image frame and then applying principal component analysis (PCA) to the normalized neighborhood region. Subsequently, we propose a backtracking-free k-d tree mechanism for efficient feature matching by taking advantage of the low-dimensionality of the feature representation. Additionally, the proposed k-d tree mechanism allows for feature selection to obtain a lower-dimensional dictionary representation when hardware resources are limited to implement dimensionality reduction. Consequently, the proposed system can be realized on a field-programmable gate array (FPGA) device leading to high performance over resource ratio. The proposed system is tested on real-world event-based datasets for object categorization, showing superior classification performance and relevance to state-of-the-art algorithms. Additionally, we verified the object detection method and real-time FPGA performance in lab settings under non-controlled illumination conditions with limited training data and ground truth annotations.
関連論文
- 効率的なイベントカメラボリュームシステムイベントカメラ
- 動きを考慮したイベントカメラのイベント抑制イベントカメラ
- イベントカメラでドメインギャップを埋めるイベントカメラ
- スパイキングパッチ:イベントカメラのための非同期・スパース・効率的トークン化イベントカメラ
- 高速特徴場(F³): イベントデータの予測的表現イベントカメラ
- VibES: 持続的なイベントベースセンシングのための誘起振動イベントカメラ
