シーングラフ上の自己教師あり学習による説明可能な行動予測
Explainable Action Prediction through Self-Supervision on Scene Graphs
自動運転における将来の運転行動予測のため、シーングラフを高レベル表現として用い、自己教師あり学習で埋め込みを獲得する手法を提案。注意機構により時空間ヒートマップを生成し、説明可能性を実現した。
著者: Pawit Kochakarn, Daniele De Martini, Daniel Omeiza, Lars Kunze
分類: cs.CV, cs.RO
原文アブストラクト
This work explores scene graphs as a distilled representation of high-level information for autonomous driving, applied to future driver-action prediction. Given the scarcity and strong imbalance of data samples, we propose a self-supervision pipeline to infer representative and well-separated embeddings. Key aspects are interpretability and explainability; as such, we embed in our architecture attention mechanisms that can create spatial and temporal heatmaps on the scene graphs. We evaluate our system on the ROAD dataset against a fully-supervised approach, showing the superiority of our training regime.
