自動運転向け道路利用者軌道予測モデルのロバスト性ベンチマーク
Robustness Benchmark of Road User Trajectory Prediction Models for Automated Driving
自動運転の軌道予測モデル4種について、道路情報欠如・検出遅延・ノイズなどの摂動に対するロバスト性を評価し、学習時の摂動付加による緩和効果と限界を示した。
著者: Manuel Muñoz Sánchez, Emilia Silvas, Jos Elfring, René van de Molengraft
分類: cs.AI, cs.RO
原文アブストラクト
Accurate and robust trajectory predictions of road users are needed to enable safe automated driving. To do this, machine learning models are often used, which can show erratic behavior when presented with previously unseen inputs. In this work, two environment-aware models (MotionCNN and MultiPath++) and two common baselines (Constant Velocity and an LSTM) are benchmarked for robustness against various perturbations that simulate functional insufficiencies observed during model deployment in a vehicle: unavailability of road information, late detections, and noise. Results show significant performance degradation under the presence of these perturbations, with errors increasing up to +1444.8\% in commonly used trajectory prediction evaluation metrics. Training the models with similar perturbations effectively reduces performance degradation, with error increases of up to +87.5\%. We argue that despite being an effective mitigation strategy, data augmentation through perturbations during training does not guarantee robustness towards unforeseen perturbations, since identification of all possible on-road complications is unfeasible. Furthermore, degrading the inputs sometimes leads to more accurate predictions, suggesting that the models are unable to learn the true relationships between the different elements in the data.
