ZeroSCD: ゼロショット街路シーン変化検出
ZeroSCD: Zero-Shot Street Scene Change Detection
学習不要で、既存の場所認識モデルとセマンティックセグメンテーションモデルを組み合わせ、街路シーンの変化を検出するフレームワークを提案。
著者: Shyam Sundar Kannan, Byung-Cheol Min
分類: cs.RO, cs.CV
原文アブストラクト
Scene Change Detection is a challenging task in computer vision and robotics that aims to identify differences between two images of the same scene captured at different times. Traditional change detection methods rely on training models that take these image pairs as input and estimate the changes, which requires large amounts of annotated data, a costly and time-consuming process. To overcome this, we propose ZeroSCD, a zero-shot scene change detection framework that eliminates the need for training. ZeroSCD leverages pre-existing models for place recognition and semantic segmentation, utilizing their features and outputs to perform change detection. In this framework, features extracted from the place recognition model are used to estimate correspondences and detect changes between the two images. These are then combined with segmentation results from the semantic segmentation model to precisely delineate the boundaries of the detected changes. Extensive experiments on benchmark datasets demonstrate that ZeroSCD outperforms several state-of-the-art methods in change detection accuracy, despite not being trained on any of the benchmark datasets, proving its effectiveness and adaptability across different scenarios.
