日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

歩行arXiv:2307.10142

ヒューマノイド歩行学習におけるポテンシャルベース報酬のベンチマーク

Benchmarking Potential Based Rewards for Learning Humanoid Locomotion

シェア:XThreadsFacebookLINEはてブBluesky

ヒューマノイドロボットの強化学習において、ポテンシャルベース報酬整形(PBRS)と従来の報酬整形を比較し、PBRSは収束速度の向上は限定的だが報酬スケーリングに対して頑健で調整が容易であることを示した。

著者: Se Hwan Jeon, Steve Heim, Charles Khazoom, Sangbae Kim

分類: cs.RO, cs.AI, cs.LG

原文アブストラクト

The main challenge in developing effective reinforcement learning (RL) pipelines is often the design and tuning the reward functions. Well-designed shaping reward can lead to significantly faster learning. Naively formulated rewards, however, can conflict with the desired behavior and result in overfitting or even erratic performance if not properly tuned. In theory, the broad class of potential based reward shaping (PBRS) can help guide the learning process without affecting the optimal policy. Although several studies have explored the use of potential based reward shaping to accelerate learning convergence, most have been limited to grid-worlds and low-dimensional systems, and RL in robotics has predominantly relied on standard forms of reward shaping. In this paper, we benchmark standard forms of shaping with PBRS for a humanoid robot. We find that in this high-dimensional system, PBRS has only marginal benefits in convergence speed. However, the PBRS reward terms are significantly more robust to scaling than typical reward shaping approaches, and thus easier to tune.

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  3. 3GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5UC BerkeleyとNVIDIAの研究者、AIエージェントでロボット制御コードを仮想環境で改善研究・技術

PR・アフィリエイト広告

FRONTIER(GPU搭載BTOパソコン)

FRONTIER(GPU搭載BTOパソコン)の公式広告バナーFRONTIERでGPU搭載PCを見る ↗
PR本紙発行元 EmplifAI