軌道予測評価の再考:タスク認識型指標の提案
Rethinking Trajectory Forecasting Evaluation
軌道予測の評価指標がタスク非依存である問題を指摘し、下流の計画・意思決定を考慮したタスク認識型評価指標を提案した論文。
著者: Boris Ivanovic, Marco Pavone
分類: cs.RO, cs.CV, cs.LG, cs.SY, eess.SY
原文アブストラクト
Forecasting the behavior of other agents is an integral part of the modern robotic autonomy stack, especially in safety-critical scenarios with human-robot interaction, such as autonomous driving. In turn, there has been a significant amount of interest and research in trajectory forecasting, resulting in a wide variety of approaches. Common to all works, however, is the use of the same few accuracy-based evaluation metrics, e.g., displacement error and log-likelihood. While these metrics are informative, they are task-agnostic and predictions that are evaluated as equal can lead to vastly different outcomes, e.g., in downstream planning and decision making. In this work, we take a step back and critically evaluate current trajectory forecasting metrics, proposing task-aware metrics as a better measure of performance in systems where prediction is being deployed. We additionally present one example of such a metric, incorporating planning-awareness within existing trajectory forecasting metrics.
