日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

自動運転/逆強化学習arXiv:1905.00229

スタイルを学ぶ運転:自動運転の汎用プランニングにおける逆強化学習

Driving with Style: Inverse Reinforcement Learning in General-Purpose Planning for Automated Driving

シェア:XThreadsFacebookLINEはてブBluesky

人間の運転デモンストレーションから最大エントロピー逆強化学習を用いて報酬関数を自動調整し、汎用プランナーの運転スタイルを最適化する手法を提案した論文。専門家の手動調整を上回る報酬関数を学習できることを示した。

著者: Sascha Rosbach, Vinit James, Simon Großjohann, Silviu Homoceanu, Stefan Roth

分類: cs.RO, cs.AI, cs.LG

原文アブストラクト

Behavior and motion planning play an important role in automated driving. Traditionally, behavior planners instruct local motion planners with predefined behaviors. Due to the high scene complexity in urban environments, unpredictable situations may occur in which behavior planners fail to match predefined behavior templates. Recently, general-purpose planners have been introduced, combining behavior and local motion planning. These general-purpose planners allow behavior-aware motion planning given a single reward function. However, two challenges arise: First, this function has to map a complex feature space into rewards. Second, the reward function has to be manually tuned by an expert. Manually tuning this reward function becomes a tedious task. In this paper, we propose an approach that relies on human driving demonstrations to automatically tune reward functions. This study offers important insights into the driving style optimization of general-purpose planners with maximum entropy inverse reinforcement learning. We evaluate our approach based on the expected value difference between learned and demonstrated policies. Furthermore, we compare the similarity of human driven trajectories with optimal policies of our planner under learned and expert-tuned reward functions. Our experiments show that we are able to learn reward functions exceeding the level of manual expert tuning without prior domain knowledge.

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  3. 3newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5UC BerkeleyとNVIDIAの研究者、AIエージェントでロボット制御コードを仮想環境で改善研究・技術

PR・アフィリエイト広告

FRONTIER(GPU搭載BTOパソコン)

FRONTIER(GPU搭載BTOパソコン)の公式広告バナーFRONTIERでGPU搭載PCを見る ↗
PR本紙発行元 EmplifAI