日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

自己教師あり学習arXiv:2011.05459

グラフ上のランダムウォークを用いた動画物体検出の自己教師あり学習システム

A Self-supervised Learning System for Object Detection in Videos Using Random Walks on Graphs

シェア:XThreadsFacebookLINEはてブBluesky

未ラベル動画から深度で物体を切り出して追跡し、物体系列間の類似度グラフを作ってランダムウォークで三つ組を生成、シームレスネットワークを学習して未知物体を新カテゴリにクラスタリングする手法を提案した論文。

著者: Juntao Tan, Changkyu Song, Abdeslam Boularias

分類: cs.CV, cs.RO

原文アブストラクト

This paper presents a new self-supervised system for learning to detect novel and previously unseen categories of objects in images. The proposed system receives as input several unlabeled videos of scenes containing various objects. The frames of the videos are segmented into objects using depth information, and the segments are tracked along each video. The system then constructs a weighted graph that connects sequences based on the similarities between the objects that they contain. The similarity between two sequences of objects is measured by using generic visual features, after automatically re-arranging the frames in the two sequences to align the viewpoints of the objects. The graph is used to sample triplets of similar and dissimilar examples by performing random walks. The triplet examples are finally used to train a siamese neural network that projects the generic visual features into a low-dimensional manifold. Experiments on three public datasets, YCB-Video, CORe50 and RGBD-Object, show that the projected low-dimensional features improve the accuracy of clustering unknown objects into novel categories, and outperform several recent unsupervised clustering techniques.

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  3. 3GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5UC BerkeleyとNVIDIAの研究者、AIエージェントでロボット制御コードを仮想環境で改善研究・技術

PR・アフィリエイト広告

MINISFORUM(ミニPC)

MINISFORUM(ミニPC)の公式広告バナーMINISFORUM公式ストアを見る ↗
PR本紙発行元 EmplifAI