運用設計領域内での動作:視覚言語モデルによるゼロショット認識
Operating Within the Operational Design Domain: Zero-Shot Perception with Vision-Language Models
自動運転システムの安全規制に重要なODD要素の認識を、視覚言語モデル(VLM)を用いてゼロショットで行う手法を提案・評価した論文。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Berkehan Ünal, Hauke Dierend, Dren Fazlija, Christopher Plachetka
分類: cs.CV, cs.AI, cs.RO
原文アブストラクト
Over the last few years, research on autonomous systems has matured to such a degree that the field is increasingly well-positioned to translate research into practical, stakeholder-driven use cases across well-defined domains. However, for a wide-scale practical adoption of autonomous systems, adherence to safety regulations is crucial. Many regulations are influenced by the Operational Design Domain (ODD), which defines the specific conditions in which an autonomous agent can function. This is especially relevant for Automated Driving Systems (ADS), as a dependable perception of ODD elements is essential for safe implementation and auditing. Vision-language models (VLMs) integrate visual recognition and language reasoning, functioning without task-specific training data, which makes them suitable for adaptable ODD perception. To assess whether VLMs can function as zero-shot "ODD sensors" that adapt to evolving definitions, we contribute (i) an empirical study of zero-shot ODD classification and detection using four VLMs on a custom dataset and Mapillary Vistas, along with failure analyses; (ii) an ablation of zero-shot optimization strategies with a cost-performance overview; and (iii) a suite of reusable prompting templates with guidance for adaptation. Our findings indicate that definition-anchored chain-of-thought prompting with persona decomposition performs best, while other methods may result in reduced recall. Overall, our results pave the way for transparent and effective ODD-based perception in safety-critical applications.
関連論文
- MM-BEV: 重要度に応じた計算で即時性を向上自動運転/認識
- 自動運転システムにおけるAIベース環境認識の実行時検証手法自動運転/認識
- スパースな車載レーダ入力による道路境界推定自動運転/認識
