日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

模倣学習arXiv:2203.15390

強化学習を組み合わせた介入型模倣学習フレームワークReIL

ReIL: A Framework for Reinforced Intervention-based Imitation Learning

シェア:XThreadsFacebookLINEはてブBluesky

介入型模倣学習と強化学習を統合し、非専門家でも実環境で少ない監督でエージェントを訓練できるフレームワークを提案。移動ロボットのナビゲーション実験で、疎な修正から高速に学習し性能劣化なく任意の報酬関数を利用できることを示した。

著者: Rom Parnichkun, Matthew N. Dailey, Atsushi Yamashita

分類: cs.RO, cs.AI, cs.LG, cs.SY, eess.SY

原文アブストラクト

Compared to traditional imitation learning methods such as DAgger and DART, intervention-based imitation offers a more convenient and sample efficient data collection process to users. In this paper, we introduce Reinforced Intervention-based Learning (ReIL), a framework consisting of a general intervention-based learning algorithm and a multi-task imitation learning model aimed at enabling non-expert users to train agents in real environments with little supervision or fine tuning. ReIL achieves this with an algorithm that combines the advantages of imitation learning and reinforcement learning and a model capable of concurrently processing demonstrations, past experience, and current observations. Experimental results from real world mobile robot navigation challenges indicate that ReIL learns rapidly from sparse supervisor corrections without suffering deterioration in performance that is characteristic of supervised learning-based methods such as HG-Dagger and IWR. The results also demonstrate that in contrast to other intervention-based methods such as IARL and EGPO, ReIL can utilize an arbitrary reward function for training without any additional heuristics.

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  3. 3Google DeepMind、ロボット向けAIを発表新製品・発表
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開

PR・アフィリエイト広告

FRONTIER(GPU搭載BTOパソコン)

FRONTIER(GPU搭載BTOパソコン)の公式広告バナーFRONTIERでGPU搭載PCを見る ↗
PR本紙発行元 EmplifAI