日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

ハードウェア協調設計arXiv:2008.04460

ハードウェアをポリシーとして:深層強化学習による機械・計算の協調最適化

Hardware as Policy: Mechanical and Computational Co-Optimization using Deep Reinforcement Learning

シェア:XThreadsFacebookLINEはてブBluesky

ロボットの身体を「ハードウェアポリシー」として微分可能な計算グラフでモデル化し、制御ポリシーと同時に強化学習で最適化する手法を提案。おもちゃの質量-ばね問題と実機の劣駆動ハンド設計で有効性を示した。

著者: Tianjian Chen, Zhanpeng He, Matei Ciocarlie

分類: cs.RO

原文アブストラクト

Deep Reinforcement Learning (RL) has shown great success in learning complex control policies for a variety of applications in robotics. However, in most such cases, the hardware of the robot has been considered immutable, modeled as part of the environment. In this study, we explore the problem of learning hardware and control parameters together in a unified RL framework. To achieve this, we propose to model the robot body as a "hardware policy", analogous to and optimized jointly with its computational counterpart. We show that, by modeling such hardware policies as auto-differentiable computational graphs, the ensuing optimization problem can be solved efficiently by gradient-based algorithms from the Policy Optimization family. We present two such design examples: a toy mass-spring problem, and a real-world problem of designing an underactuated hand. We compare our method against traditional co-optimization approaches, and also demonstrate its effectiveness by building a physical prototype based on the learned hardware parameters. Videos and more details are available at https://roamlab.github.io/hwasp/ .

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  3. 3GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5UC BerkeleyとNVIDIAの研究者、AIエージェントでロボット制御コードを仮想環境で改善研究・技術

PR・アフィリエイト広告

FRONTIER(GPU搭載BTOパソコン)

FRONTIER(GPU搭載BTOパソコン)の公式広告バナーFRONTIERでGPU搭載PCを見る ↗
PR本紙発行元 EmplifAI