MORPH: 微分可能なハードウェアモデルプロキシによる強化学習を用いた設計共最適化
MORPH: Design Co-optimization with Reinforcement Learning via a Differentiable Hardware Model Proxy
微分可能なプロキシハードウェアモデルを導入し、強化学習によってハードウェア設計パラメータと制御方策を同時に最適化する手法を提案。2Dリーチングと3D多指マニピュレーションで有効性を示した。
著者: Zhanpeng He, Matei Ciocarlie
分類: cs.RO, cs.AI, cs.LG
原文アブストラクト
We introduce MORPH, a method for co-optimization of hardware design parameters and control policies in simulation using reinforcement learning. Like most co-optimization methods, MORPH relies on a model of the hardware being optimized, usually simulated based on the laws of physics. However, such a model is often difficult to integrate into an effective optimization routine. To address this, we introduce a proxy hardware model, which is always differentiable and enables efficient co-optimization alongside a long-horizon control policy using RL. MORPH is designed to ensure that the optimized hardware proxy remains as close as possible to its realistic counterpart, while still enabling task completion. We demonstrate our approach on simulated 2D reaching and 3D multi-fingered manipulation tasks.
