日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

模倣学習arXiv:2202.04877

記憶に基づく注視予測を用いたロボットマニピュレーションの深層模倣学習

Memory-based gaze prediction in deep imitation learning for robot manipulation

シェア:XThreadsFacebookLINEはてブBluesky

複雑な環境で過去の経験を活かすタスク向けに、連続視覚入力からTransformerで注視点を予測し記憶を実現する深層模倣学習手法を提案し、実機の物体操作タスクで評価した。

著者: Heecheol Kim, Yoshiyuki Ohmura, Yasuo Kuniyoshi

分類: cs.RO, cs.AI, cs.CV

原文アブストラクト

Deep imitation learning is a promising approach that does not require hard-coded control rules in autonomous robot manipulation. The current applications of deep imitation learning to robot manipulation have been limited to reactive control based on the states at the current time step. However, future robots will also be required to solve tasks utilizing their memory obtained by experience in complicated environments (e.g., when the robot is asked to find a previously used object on a shelf). In such a situation, simple deep imitation learning may fail because of distractions caused by complicated environments. We propose that gaze prediction from sequential visual input enables the robot to perform a manipulation task that requires memory. The proposed algorithm uses a Transformer-based self-attention architecture for the gaze estimation based on sequential data to implement memory. The proposed method was evaluated with a real robot multi-object manipulation task that requires memory of the previous states.

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  3. 3GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5UC BerkeleyとNVIDIAの研究者、AIエージェントでロボット制御コードを仮想環境で改善研究・技術

PR・アフィリエイト広告

FRONTIER(GPU搭載BTOパソコン)

FRONTIER(GPU搭載BTOパソコン)の公式広告バナーFRONTIERでGPU搭載PCを見る ↗
PR本紙発行元 EmplifAI