日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

模倣学習arXiv:2311.05084

時相論理仕様に基づく見まね学習の改善

Signal Temporal Logic-Guided Apprenticeship Learning

シェア:XThreadsFacebookLINEはてブBluesky

時相論理で記述されたタスク目標をグラフに符号化し、実演者と学習エージェントの振る舞いを評価する指標を導入することで、必要な実演数を大幅に削減しつつ制御方策を学習する手法を提案した。

著者: Aniruddh G. Puranic, Jyotirmoy V. Deshmukh, Stefanos Nikolaidis

分類: cs.RO, cs.AI, cs.LG

原文アブストラクト

Apprenticeship learning crucially depends on effectively learning rewards, and hence control policies from user demonstrations. Of particular difficulty is the setting where the desired task consists of a number of sub-goals with temporal dependencies. The quality of inferred rewards and hence policies are typically limited by the quality of demonstrations, and poor inference of these can lead to undesirable outcomes. In this letter, we show how temporal logic specifications that describe high level task objectives, are encoded in a graph to define a temporal-based metric that reasons about behaviors of demonstrators and the learner agent to improve the quality of inferred rewards and policies. Through experiments on a diverse set of robot manipulator simulations, we show how our framework overcomes the drawbacks of prior literature by drastically improving the number of demonstrations required to learn a control policy.

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  3. 3NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  4. 4GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  5. 5Google DeepMind、ロボット向けAIを発表新製品・発表

PR・アフィリエイト広告

FRONTIER(GPU搭載BTOパソコン)

FRONTIER(GPU搭載BTOパソコン)の公式広告バナーFRONTIERでGPU搭載PCを見る ↗
PR本紙発行元 EmplifAI