ViT-VS: 事前学習済みVision Transformer特徴量を用いた汎化可能なビジュアルサーボ
ViT-VS: On the Applicability of Pretrained Vision Transformer Features for Generalizable Visual Servoing
事前学習済みViTの意味的特徴量をビジュアルサーボに活用し、タスク固有の学習なしで古典手法を上回る頑健なエンドエフェクタ位置決めを実現した研究。
著者: Alessandro Scherl, Stefan Thalhammer, Bernhard Neuberger, Wilfried Wöber, José García-Rodríguez
分類: cs.RO, cs.CV
原文アブストラクト
Visual servoing enables robots to precisely position their end-effector relative to a target object. While classical methods rely on hand-crafted features and thus are universally applicable without task-specific training, they often struggle with occlusions and environmental variations, whereas learning-based approaches improve robustness but typically require extensive training. We present a visual servoing approach that leverages pretrained vision transformers for semantic feature extraction, combining the advantages of both paradigms while also being able to generalize beyond the provided sample. Our approach achieves full convergence in unperturbed scenarios and surpasses classical image-based visual servoing by up to 31.2\% relative improvement in perturbed scenarios. Even the convergence rates of learning-based methods are matched despite requiring no task- or object-specific training. Real-world evaluations confirm robust performance in end-effector positioning, industrial box manipulation, and grasping of unseen objects using only a reference from the same category. Our code and simulation environment are available at: https://alessandroscherl.github.io/ViT-VS/
