日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

模倣学習/報酬学習arXiv:2211.15339

グラフベース能動報酬学習による汎化可能な空間目標表現の発見

Discovering Generalizable Spatial Goal Representations via Graph-based Active Reward Learning

シェア:XThreadsFacebookLINEはてブBluesky

物体再配置タスクのワンショット模倣学習において、物体間の空間関係をグラフと等価写像で表現し、逆強化学習と能動報酬学習を組み合わせることで、未知環境でも汎化する目標仕様を推定する手法GEMを提案した。

著者: Aviv Netanyahu, Tianmin Shu, Joshua Tenenbaum, Pulkit Agrawal

分類: cs.LG, cs.AI, cs.RO

原文アブストラクト

In this work, we consider one-shot imitation learning for object rearrangement tasks, where an AI agent needs to watch a single expert demonstration and learn to perform the same task in different environments. To achieve a strong generalization, the AI agent must infer the spatial goal specification for the task. However, there can be multiple goal specifications that fit the given demonstration. To address this, we propose a reward learning approach, Graph-based Equivalence Mappings (GEM), that can discover spatial goal representations that are aligned with the intended goal specification, enabling successful generalization in unseen environments. Specifically, GEM represents a spatial goal specification by a reward function conditioned on i) a graph indicating important spatial relationships between objects and ii) state equivalence mappings for each edge in the graph indicating invariant properties of the corresponding relationship. GEM combines inverse reinforcement learning and active reward learning to efficiently improve the reward function by utilizing the graph structure and domain randomization enabled by the equivalence mappings. We conducted experiments with simulated oracles and with human subjects. The results show that GEM can drastically improve the generalizability of the learned goal representations over strong baselines.

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  3. 3newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5UC BerkeleyとNVIDIAの研究者、AIエージェントでロボット制御コードを仮想環境で改善研究・技術

PR・アフィリエイト広告

MINISFORUM(ミニPC)

MINISFORUM(ミニPC)の公式広告バナーMINISFORUM公式ストアを見る ↗
PR本紙発行元 EmplifAI