日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

sim2realarXiv:2012.07461

シミュレーションから実機への強化学習による車両のエンドツーエンド制御

Sim-to-real reinforcement learning applied to end-to-end vehicle control

シェア:XThreadsFacebookLINEはてブBluesky

単眼カメラ画像のみから連続的な車両操作を出力する畳み込みネットワークを、シミュレーション内でPPOとドメインランダム化を用いて学習し、実機の二車線道路で車線追従と衝突回避を実現した。

著者: András Kalapos, Csaba Gór, Róbert Moni, István Harmati

分類: cs.LG, cs.RO

原文アブストラクト

In this work, we study vision-based end-to-end reinforcement learning on vehicle control problems, such as lane following and collision avoidance. Our controller policy is able to control a small-scale robot to follow the right-hand lane of a real two-lane road, while its training was solely carried out in a simulation. Our model, realized by a simple, convolutional network, only relies on images of a forward-facing monocular camera and generates continuous actions that directly control the vehicle. To train this policy we used Proximal Policy Optimization, and to achieve the generalization capability required for real performance we used domain randomization. We carried out thorough analysis of the trained policy, by measuring multiple performance metrics and comparing these to baselines that rely on other methods. To assess the quality of the simulation-to-reality transfer learning process and the performance of the controller in the real world, we measured simple metrics on a real track and compared these with results from a matching simulation. Further analysis was carried out by visualizing salient object maps.

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  3. 3Google DeepMind、ロボット向けAIを発表新製品・発表
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開

PR・アフィリエイト広告

MINISFORUM(ミニPC)

MINISFORUM(ミニPC)の公式広告バナーMINISFORUM公式ストアを見る ↗
PR本紙発行元 EmplifAI