日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

教師なし強化学習arXiv:2305.14377

球面上での連続スキルの教師なし発見

Unsupervised Discovery of Continuous Skills on a Sphere

シェア:XThreadsFacebookLINEはてブBluesky

スキルを球面上の連続値として表現し、相互情報量最大化により無限に多様なスキルを教師なしで獲得する手法DISCSを提案し、MuJoCo Antで従来法より多様な行動を学習できることを示した。

著者: Takahisa Imagawa, Takuya Hiraoka, Yoshimasa Tsuruoka

分類: cs.LG, cs.AI, cs.RO

原文アブストラクト

Recently, methods for learning diverse skills to generate various behaviors without external rewards have been actively studied as a form of unsupervised reinforcement learning. However, most of the existing methods learn a finite number of discrete skills, and thus the variety of behaviors that can be exhibited with the learned skills is limited. In this paper, we propose a novel method for learning potentially an infinite number of different skills, which is named discovery of continuous skills on a sphere (DISCS). In DISCS, skills are learned by maximizing mutual information between skills and states, and each skill corresponds to a continuous value on a sphere. Because the representations of skills in DISCS are continuous, infinitely diverse skills could be learned. We examine existing methods and DISCS in the MuJoCo Ant robot control environments and show that DISCS can learn much more diverse skills than the other methods.

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  3. 3newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5UC BerkeleyとNVIDIAの研究者、AIエージェントでロボット制御コードを仮想環境で改善研究・技術

PR・アフィリエイト広告

FRONTIER(GPU搭載BTOパソコン)

FRONTIER(GPU搭載BTOパソコン)の公式広告バナーFRONTIERでGPU搭載PCを見る ↗
PR本紙発行元 EmplifAI