時間制約下の推論に向けた近似LSTM:自動運転車の高速反応を実現
Approximate LSTMs for Time-Constrained Inference: Enabling Fast Reaction in Self-Driving Cars
モデル枝刈りと計算再構成を組み合わせた段階的推論により、限られたレイテンシ予算内でLSTMの近似推論を可能にし、自動運転の安全性を保ちつつ最大415倍高速化した。
著者: Alexandros Kouris, Stylianos I. Venieris, Michail Rizakis, Christos-Savvas Bouganis
分類: eess.SP, cs.LG, cs.RO
原文アブストラクト
The need to recognise long-term dependencies in sequential data such as video streams has made Long Short-Term Memory (LSTM) networks a prominent Artificial Intelligence model for many emerging applications. However, the high computational and memory demands of LSTMs introduce challenges in their deployment on latency-critical systems such as self-driving cars which are equipped with limited computational resources on-board. In this paper, we introduce a progressive inference computing scheme that combines model pruning and computation restructuring leading to the best possible approximation of the result given the available latency budget of the target application. The proposed methodology enables mission-critical systems to make informed decisions even in early stages of the computation, based on approximate LSTM inference, meeting their specifications on safety and robustness. Our experiments on a state-of-the-art driving model for autonomous vehicle navigation demonstrate that the proposed approach can yield outputs with similar quality of result compared to a faithful LSTM baseline, up to 415x faster (198x on average, 76x geo. mean).
