日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

歩行arXiv:2210.08003

四足エージェントのための階層型分散深層強化学習アーキテクチャ

Hierarchical Decentralized Deep Reinforcement Learning Architecture for a Simulated Four-Legged Agent

シェア:XThreadsFacebookLINEはてブBluesky

生物の階層的・分散的な運動制御に着想を得て、四足歩行エージェントを制御する新しい分散階層型強化学習アーキテクチャを提案し、集中型・分散型・階層型など5つの構成を比較して、分散化が学習効率・省エネ性・未知環境への頑健性を高めることを示した。

著者: W. Zai El Amri, L. Hermes, M. Schilling

分類: cs.AI, cs.LG, cs.RO

原文アブストラクト

Legged locomotion is widespread in nature and has inspired the design of current robots. The controller of these legged robots is often realized as one centralized instance. However, in nature, control of movement happens in a hierarchical and decentralized fashion. Introducing these biological design principles into robotic control systems has motivated this work. We tackle the question whether decentralized and hierarchical control is beneficial for legged robots and present a novel decentral, hierarchical architecture to control a simulated legged agent. Three different tasks varying in complexity are designed to benchmark five architectures (centralized, decentralized, hierarchical and two different combinations of hierarchical decentralized architectures). The results demonstrate that decentralizing the different levels of the hierarchical architectures facilitates learning of the agent, ensures more energy efficient movements as well as robustness towards new unseen environments. Furthermore, this comparison sheds light on the importance of modularity in hierarchical architectures to solve complex goal-directed tasks. We provide an open-source code implementation of our architecture (https://github.com/wzaielamri/hddrl).

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  3. 3Google DeepMind、ロボット向けAIを発表新製品・発表
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開

PR・アフィリエイト広告

FRONTIER(GPU搭載BTOパソコン)

FRONTIER(GPU搭載BTOパソコン)の公式広告バナーFRONTIERでGPU搭載PCを見る ↗
PR本紙発行元 EmplifAI