深層学習アンサンブルによる無人航空機向けマルチオブジェクト追跡
Multi-Object Tracking with Deep Learning Ensemble for Unmanned Aerial System Applications
移動カメラやズーム変化に強いDeepEKFとSiamese CNN外観スコアをMHTで統合し、UAS映像の物体追跡精度を向上させた研究。
著者: Wanlin Xie, Jaime Ide, Daniel Izadi, Sean Banger, Thayne Walker, Ryan Ceresani, Dylan Spagnuolo, Christopher Guagliano, Henry Diaz, Jason Twedt
分類: cs.CV, cs.LG, cs.RO
原文アブストラクト
Multi-object tracking (MOT) is a crucial component of situational awareness in military defense applications. With the growing use of unmanned aerial systems (UASs), MOT methods for aerial surveillance is in high demand. Application of MOT in UAS presents specific challenges such as moving sensor, changing zoom levels, dynamic background, illumination changes, obscurations and small objects. In this work, we present a robust object tracking architecture aimed to accommodate for the noise in real-time situations. We propose a kinematic prediction model, called Deep Extended Kalman Filter (DeepEKF), in which a sequence-to-sequence architecture is used to predict entity trajectories in latent space. DeepEKF utilizes a learned image embedding along with an attention mechanism trained to weight the importance of areas in an image to predict future states. For the visual scoring, we experiment with different similarity measures to calculate distance based on entity appearances, including a convolutional neural network (CNN) encoder, pre-trained using Siamese networks. In initial evaluation experiments, we show that our method, combining scoring structure of the kinematic and visual models within a MHT framework, has improved performance especially in edge cases where entity motion is unpredictable, or the data presents frames with significant gaps.
関連論文
- PS-MOT: 点シードからインスタンス認識を育成するマルチオブジェクト追跡マルチオブジェクト追跡
- S3KF: パノラマ3Dマルチオブジェクト追跡のための球面状態空間カルマンフィルタリングマルチオブジェクト追跡
- OmniTrack++: 大視野軌道フィードバック学習による全方向マルチオブジェクト追跡マルチオブジェクト追跡
- DepTR-MOT: 深度情報を活用した軌道精緻化によるマルチオブジェクト追跡マルチオブジェクト追跡
- センサネットワーク上でのマルチオブジェクト追跡のための分散期待値伝播マルチオブジェクト追跡
- 全方位マルチオブジェクト追跡マルチオブジェクト追跡
