グラフ上のランダムウォークを用いた動画物体検出の自己教師あり学習システム
A Self-supervised Learning System for Object Detection in Videos Using Random Walks on Graphs
未ラベル動画から深度で物体を切り出して追跡し、物体系列間の類似度グラフを作ってランダムウォークで三つ組を生成、シームレスネットワークを学習して未知物体を新カテゴリにクラスタリングする手法を提案した論文。
著者: Juntao Tan, Changkyu Song, Abdeslam Boularias
分類: cs.CV, cs.RO
原文アブストラクト
This paper presents a new self-supervised system for learning to detect novel and previously unseen categories of objects in images. The proposed system receives as input several unlabeled videos of scenes containing various objects. The frames of the videos are segmented into objects using depth information, and the segments are tracked along each video. The system then constructs a weighted graph that connects sequences based on the similarities between the objects that they contain. The similarity between two sequences of objects is measured by using generic visual features, after automatically re-arranging the frames in the two sequences to align the viewpoints of the objects. The graph is used to sample triplets of similar and dissimilar examples by performing random walks. The triplet examples are finally used to train a siamese neural network that projects the generic visual features into a low-dimensional manifold. Experiments on three public datasets, YCB-Video, CORe50 and RGBD-Object, show that the projected low-dimensional features improve the accuracy of clustering unknown objects into novel categories, and outperform several recent unsupervised clustering techniques.
関連論文
- Vernata: LiDAR点群表現の自己教師あり学習自己教師あり学習
- マルチモダリティを教師とする自己教師あり学習:テスト環境への特化自己教師あり学習
- HilDA: 拡散モデルを用いた階層的蒸留による自己教師ありLiDAR事前学習の推進自己教師あり学習
- OctoSense: マルチモーダルロボット知覚のための自己教師あり学習自己教師あり学習
- 構造的不変性からの自己教師あり学習自己教師あり学習
- 海底画像に対する位置情報正則化自己教師あり特徴学習の検討自己教師あり学習
