日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

強化学習arXiv:2207.09845

ロボットタスクにおける対話型強化学習のフィードバック頻度の効果の定量化

Quantifying the Effect of Feedback Frequency in Interactive Reinforcement Learning for Robotic Tasks

シェア:XThreadsFacebookLINEはてブBluesky

連続状態・行動空間のロボットマニピュレータの逆運動学学習において、対話型フィードバックの頻度が学習効率に与える影響を定量化し、最適な頻度はタスク習熟度に応じて変化することを示した。

著者: Daniel Harnack, Julie Pivin-Bachler, Nicolás Navarro-Guerrero

分類: cs.RO, cs.AI, cs.HC, cs.LG

原文アブストラクト

Reinforcement learning (RL) has become widely adopted in robot control. Despite many successes, one major persisting problem can be very low data efficiency. One solution is interactive feedback, which has been shown to speed up RL considerably. As a result, there is an abundance of different strategies, which are, however, primarily tested on discrete grid-world and small scale optimal control scenarios. In the literature, there is no consensus about which feedback frequency is optimal or at which time the feedback is most beneficial. To resolve these discrepancies we isolate and quantify the effect of feedback frequency in robotic tasks with continuous state and action spaces. The experiments encompass inverse kinematics learning for robotic manipulator arms of different complexity. We show that seemingly contradictory reported phenomena occur at different complexity levels. Furthermore, our results suggest that no single ideal feedback frequency exists. Rather that feedback frequency should be changed as the agent's proficiency in the task increases.

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  3. 3newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5UC BerkeleyとNVIDIAの研究者、AIエージェントでロボット制御コードを仮想環境で改善研究・技術

PR・アフィリエイト広告

FRONTIER(GPU搭載BTOパソコン)

FRONTIER(GPU搭載BTOパソコン)の公式広告バナーFRONTIERでGPU搭載PCを見る ↗
PR本紙発行元 EmplifAI