SignRAG: スケーラブルなゼロショット道路標識認識のための検索拡張システム
SignRAG: A Retrieval-Augmented System for Scalable Zero-Shot Road Sign Recognition
視覚言語モデルで標識を記述し、ベクトルDBから候補を検索、LLMで推論するRAGベースのゼロショット道路標識認識フレームワークを提案。303種の標識で95.58%(理想画像)、82.45%(実世界)の精度を達成。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Minghao Zhu, Zhihao Zhang, Anmol Sidhu, Keith Redmill
分類: cs.CV, cs.AI, cs.CL, cs.IR, cs.RO
原文アブストラクト
Automated road sign recognition is a critical task for intelligent transportation systems, but traditional deep learning methods struggle with the sheer number of sign classes and the impracticality of creating exhaustive labeled datasets. This paper introduces a novel zero-shot recognition framework that adapts the Retrieval-Augmented Generation (RAG) paradigm to address this challenge. Our method first uses a Vision Language Model (VLM) to generate a textual description of a sign from an input image. This description is used to retrieve a small set of the most relevant sign candidates from a vector database of reference designs. Subsequently, a Large Language Model (LLM) reasons over the retrieved candidates to make a final, fine-grained recognition. We validate this approach on a comprehensive set of 303 regulatory signs from the Ohio MUTCD. Experimental results demonstrate the framework's effectiveness, achieving 95.58% accuracy on ideal reference images and 82.45% on challenging real-world road data. This work demonstrates the viability of RAG-based architectures for creating scalable and accurate systems for road sign recognition without task-specific training.
