AnyBipe:大規模言語モデルが導く二足歩行ロボットの学習・展開エンドツーエンドフレームワーク
AnyBipe: An End-to-End Framework for Training and Deploying Bipedal Robots Guided by Large Language Models
LLMを活用して報酬関数設計からsim-to-real展開までを自動化し、二足歩行ロボットの制御方策を人間の介入を最小限に学習・展開するフレームワークを提案。
著者: Yifei Yao, Wentao He, Chenyu Gu, Jiaheng Du, Fuwei Tan, Zhen Zhu, Junguo Lu
分類: cs.RO, cs.AI, cs.LG
原文アブストラクト
Training and deploying reinforcement learning (RL) policies for robots, especially in accomplishing specific tasks, presents substantial challenges. Recent advancements have explored diverse reward function designs, training techniques, simulation-to-reality (sim-to-real) transfers, and performance analysis methodologies, yet these still require significant human intervention. This paper introduces an end-to-end framework for training and deploying RL policies, guided by Large Language Models (LLMs), and evaluates its effectiveness on bipedal robots. The framework consists of three interconnected modules: an LLM-guided reward function design module, an RL training module leveraging prior work, and a sim-to-real homomorphic evaluation module. This design significantly reduces the need for human input by utilizing only essential simulation and deployment platforms, with the option to incorporate human-engineered strategies and historical data. We detail the construction of these modules, their advantages over traditional approaches, and demonstrate the framework's capability to autonomously develop and refine controlling strategies for bipedal robot locomotion, showcasing its potential to operate independently of human intervention.
