日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

模倣学習arXiv:2102.07730

信号時相論理で示範の品質を評価する模倣学習

Learning from Demonstrations using Signal Temporal Logic

シェア:XThreadsFacebookLINEはてブBluesky

信号時相論理を用いて示範の品質を評価・順位付けし、非マルコフ報酬を生成することで、不完全な示範に頑健な模倣学習手法を提案した論文。

著者: Aniruddh G. Puranic, Jyotirmoy V. Deshmukh, Stefanos Nikolaidis

分類: cs.RO, cs.AI, cs.LG

原文アブストラクト

Learning-from-demonstrations is an emerging paradigm to obtain effective robot control policies for complex tasks via reinforcement learning without the need to explicitly design reward functions. However, it is susceptible to imperfections in demonstrations and also raises concerns of safety and interpretability in the learned control policies. To address these issues, we use Signal Temporal Logic to evaluate and rank the quality of demonstrations. Temporal logic-based specifications allow us to create non-Markovian rewards, and also define interesting causal dependencies between tasks such as sequential task specifications. We validate our approach through experiments on discrete-world and OpenAI Gym environments, and show that our approach outperforms the state-of-the-art Maximum Causal Entropy Inverse Reinforcement Learning.

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  3. 3NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  4. 4GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  5. 5Google DeepMind、ロボット向けAIを発表新製品・発表

PR・アフィリエイト広告

OZ GAMING(GPU搭載BTOゲーミングPC)

OZ GAMING(GPU搭載BTOゲーミングPC)の公式広告バナーOZ GAMINGで完成品PCを見る ↗
PR本紙発行元 EmplifAI