日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

階層強化学習arXiv:2002.05954

計画と制御を機能分解した階層強化学習による長期的連続制御タスクの学習

Learning Functionally Decomposed Hierarchies for Continuous Control Tasks with Path Planning

シェア:XThreadsFacebookLINEはてブBluesky

計画層と制御層で状態・行動空間を明示的に分離した階層強化学習HiDeを提案し、スパース報酬のナビゲーションやロボット操作タスクで未見環境への汎化と3倍の長期ホライズンへのスケールを実現した。

著者: Sammy Christen, Lukas Jendele, Emre Aksan, Otmar Hilliges

分類: cs.LG, cs.AI, cs.RO, stat.ML

原文アブストラクト

We present HiDe, a novel hierarchical reinforcement learning architecture that successfully solves long horizon control tasks and generalizes to unseen test scenarios. Functional decomposition between planning and low-level control is achieved by explicitly separating the state-action spaces across the hierarchy, which allows the integration of task-relevant knowledge per layer. We propose an RL-based planner to efficiently leverage the information in the planning layer of the hierarchy, while the control layer learns a goal-conditioned control policy. The hierarchy is trained jointly but allows for the modular transfer of policy layers across hierarchies of different agents. We experimentally show that our method generalizes across unseen test environments and can scale to 3x horizon length compared to both learning and non-learning based methods. We evaluate on complex continuous control tasks with sparse rewards, including navigation and robot manipulation.

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  3. 3GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5UC BerkeleyとNVIDIAの研究者、AIエージェントでロボット制御コードを仮想環境で改善研究・技術

PR・アフィリエイト広告

MINISFORUM(ミニPC)

MINISFORUM(ミニPC)の公式広告バナーMINISFORUM公式ストアを見る ↗
PR本紙発行元 EmplifAI