日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

変形物体マニピュレーションarXiv:2302.10446

局所GNNに基づく深層強化学習による目標条件付き変形物体の再配置

Deep Reinforcement Learning Based on Local GNN for Goal-conditioned Deformable Object Rearranging

シェア:XThreadsFacebookLINEはてブBluesky

画像から検出したキーポイントを2つのグラフで表現し、自己注意と相互注意を用いて変形物体を目標形状に再配置する学習手法を提案。シミュレーションでロープや布のタスクに有効で、実機への転移も容易であることを示した。

著者: Yuhong Deng, Chongkun Xia, Xueqian Wang, Lipeng Chen

分類: cs.RO, cs.AI, cs.LG

原文アブストラクト

Object rearranging is one of the most common deformable manipulation tasks, where the robot needs to rearrange a deformable object into a goal configuration. Previous studies focus on designing an expert system for each specific task by model-based or data-driven approaches and the application scenarios are therefore limited. Some research has been attempting to design a general framework to obtain more advanced manipulation capabilities for deformable rearranging tasks, with lots of progress achieved in simulation. However, transferring from simulation to reality is difficult due to the limitation of the end-to-end CNN architecture. To address these challenges, we design a local GNN (Graph Neural Network) based learning method, which utilizes two representation graphs to encode keypoints detected from images. Self-attention is applied for graph updating and cross-attention is applied for generating manipulation actions. Extensive experiments have been conducted to demonstrate that our framework is effective in multiple 1-D (rope, rope ring) and 2-D (cloth) rearranging tasks in simulation and can be easily transferred to a real robot by fine-tuning a keypoint detector.

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  3. 3GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5UC BerkeleyとNVIDIAの研究者、AIエージェントでロボット制御コードを仮想環境で改善研究・技術

PR・アフィリエイト広告

OZ GAMING(GPU搭載BTOゲーミングPC)

OZ GAMING(GPU搭載BTOゲーミングPC)の公式広告バナーOZ GAMINGで完成品PCを見る ↗
PR本紙発行元 EmplifAI