EV-Catcher: 低遅延イベントベースニューラルネットワークによる高速物体キャッチング
EV-Catcher: High-Speed Object Catching Using Low-latency Event-based Neural Networks
イベントカメラと軽量なイベント表現BEHIを用いて、最大13m/sで飛来するピンポン球の着弾位置をリアルタイム推定し、組み込み向け計算機上で81%の成功率で捕球するシステムを実現した。
著者: Ziyun Wang, Fernando Cladera Ojeda, Anthony Bisulco, Daewon Lee, Camillo J. Taylor, Kostas Daniilidis, M. Ani Hsieh, Daniel D. Lee, Volkan Isler
分類: cs.RO, cs.CV
原文アブストラクト
Event-based sensors have recently drawn increasing interest in robotic perception due to their lower latency, higher dynamic range, and lower bandwidth requirements compared to standard CMOS-based imagers. These properties make them ideal tools for real-time perception tasks in highly dynamic environments. In this work, we demonstrate an application where event cameras excel: accurately estimating the impact location of fast-moving objects. We introduce a lightweight event representation called Binary Event History Image (BEHI) to encode event data at low latency, as well as a learning-based approach that allows real-time inference of a confidence-enabled control signal to the robot. To validate our approach, we present an experimental catching system in which we catch fast-flying ping-pong balls. We show that the system is capable of achieving a success rate of 81% in catching balls targeted at different locations, with a velocity of up to 13 m/s even on compute-constrained embedded platforms such as the Nvidia Jetson NX.
