日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

強化学習arXiv:2212.10765

反復深化探索に着想を得たゲインスケジューリングによる報酬ボーナス

Reward Bonuses with Gain Scheduling Inspired by Iterative Deepening Search

シェア:XThreadsFacebookLINEはてブBluesky

強化学習の探索を効率化するため、深さ優先・幅優先探索に対応する2種類の内的報酬ボーナスを設計し、反復深化探索にヒントを得たゲインスケジューリングで組み合わせる手法を提案。複数の移動タスクと疎な報酬のタスクで性能向上を実証した。

著者: Taisuke Kobayashi

分類: cs.LG, cs.AI

原文アブストラクト

This paper introduces a novel method of adding intrinsic bonuses to task-oriented reward function in order to efficiently facilitate reinforcement learning search. While various bonuses have been designed to date, they are analogous to the depth-first and breadth-first search algorithms in graph theory. This paper, therefore, first designs two bonuses for each of them. Then, a heuristic gain scheduling is applied to the designed bonuses, inspired by the iterative deepening search, which is known to inherit the advantages of the two search algorithms. The proposed method is expected to allow agent to efficiently reach the best solution in deeper states by gradually exploring unknown states. In three locomotion tasks with dense rewards and three simple tasks with sparse rewards, it is shown that the two types of bonuses contribute to the performance improvement of the different tasks complementarily. In addition, by combining them with the proposed gain scheduling, all tasks can be accomplished with high performance.

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  3. 3GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5UC BerkeleyとNVIDIAの研究者、AIエージェントでロボット制御コードを仮想環境で改善研究・技術

PR・アフィリエイト広告

OZ GAMING(GPU搭載BTOゲーミングPC)

OZ GAMING(GPU搭載BTOゲーミングPC)の公式広告バナーOZ GAMINGで完成品PCを見る ↗
PR本紙発行元 EmplifAI