日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

模倣学習arXiv:2104.01390

相互作用不要のNeural ODEによるロバストなモデルベース模倣学習

No Need for Interactions: Robust Model-Based Imitation Learning using Neural ODE

シェア:XThreadsFacebookLINEはてブBluesky

環境や専門家との相互作用なしに、Neural ODEで多段階ダイナミクスを学習し、非線形ダイナミクス反転によるロバストな追従制御器と条件付きVAEの軌道生成器を組み合わせて専門家の行動を模倣するフレームワークを提案した。

著者: HaoChih Lin, Baopu Li, Xin Zhou, Jiankun Wang, Max Q. -H. Meng

分類: cs.RO, cs.LG, cs.SY, eess.SY

原文アブストラクト

Interactions with either environments or expert policies during training are needed for most of the current imitation learning (IL) algorithms. For IL problems with no interactions, a typical approach is Behavior Cloning (BC). However, BC-like methods tend to be affected by distribution shift. To mitigate this problem, we come up with a Robust Model-Based Imitation Learning (RMBIL) framework that casts imitation learning as an end-to-end differentiable nonlinear closed-loop tracking problem. RMBIL applies Neural ODE to learn a precise multi-step dynamics and a robust tracking controller via Nonlinear Dynamics Inversion (NDI) algorithm. Then, the learned NDI controller will be combined with a trajectory generator, a conditional VAE, to imitate an expert's behavior. Theoretical derivation shows that the controller network can approximate an NDI when minimizing the training loss of Neural ODE. Experiments on Mujoco tasks also demonstrate that RMBIL is competitive to the state-of-the-art generative adversarial method (GAIL) and achieves at least 30% performance gain over BC in uneven surfaces.

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  3. 3newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5UC BerkeleyとNVIDIAの研究者、AIエージェントでロボット制御コードを仮想環境で改善研究・技術

PR・アフィリエイト広告

FRONTIER(GPU搭載BTOパソコン)

FRONTIER(GPU搭載BTOパソコン)の公式広告バナーFRONTIERでGPU搭載PCを見る ↗
PR本紙発行元 EmplifAI