日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

模倣学習arXiv:2102.01295

視線に基づく二重解像度の深層模倣学習による高精度な器用ロボット操作

Gaze-based dual resolution deep imitation learning for high-precision dexterous robot manipulation

シェア:XThreadsFacebookLINEはてブBluesky

人間の周辺視と中心視の二重解像度制御に着想を得て、注視点周辺の高解像度画像と周辺の低解像度画像を組み合わせた深層模倣学習により、汎用マニピュレータで針通しなどの高精度操作を実現し計算効率も改善した。

著者: Heecheol Kim, Yoshiyuki Ohmura, Yasuo Kuniyoshi

分類: cs.RO, cs.AI

原文アブストラクト

A high-precision manipulation task, such as needle threading, is challenging. Physiological studies have proposed connecting low-resolution peripheral vision and fast movement to transport the hand into the vicinity of an object, and using high-resolution foveated vision to achieve the accurate homing of the hand to the object. The results of this study demonstrate that a deep imitation learning based method, inspired by the gaze-based dual resolution visuomotor control system in humans, can solve the needle threading task. First, we recorded the gaze movements of a human operator who was teleoperating a robot. Then, we used only a high-resolution image around the gaze to precisely control the thread position when it was close to the target. We used a low-resolution peripheral image to reach the vicinity of the target. The experimental results obtained in this study demonstrate that the proposed method enables precise manipulation tasks using a general-purpose robot manipulator and improves computational efficiency. Data from this and related works are available at: https://sites.google.com/view/multi-task-fine.

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  3. 3GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5UC BerkeleyとNVIDIAの研究者、AIエージェントでロボット制御コードを仮想環境で改善研究・技術

PR・アフィリエイト広告

OZ GAMING(GPU搭載BTOゲーミングPC)

OZ GAMING(GPU搭載BTOゲーミングPC)の公式広告バナーOZ GAMINGで完成品PCを見る ↗
PR本紙発行元 EmplifAI