TinyML搭載ナノドローンにおけるマルチセンサ入力と状態情報の融合
Fusing Multi-sensor Input with State Information on TinyML Brains for Autonomous Nano-drones
直径約10cmのナノドローン上で、低解像度画像と8x8深度マップ、機体状態を融合する深層学習パイプラインを構築し、人間姿勢推定の精度を向上させた。
著者: Luca Crupi, Elia Cereda, Daniele Palossi
分類: cs.RO
原文アブストラクト
Autonomous nano-drones (~10 cm in diameter), thanks to their ultra-low power TinyML-based brains, are capable of coping with real-world environments. However, due to their simplified sensors and compute units, they are still far from the sense-and-act capabilities shown in their bigger counterparts. This system paper presents a novel deep learning-based pipeline that fuses multi-sensorial input (i.e., low-resolution images and 8x8 depth map) with the robot's state information to tackle a human pose estimation task. Thanks to our design, the proposed system -- trained in simulation and tested on a real-world dataset -- improves a state-unaware State-of-the-Art baseline by increasing the R^2 regression metric up to 0.10 on the distance's prediction.
