機械学習による自動交差点管理のための拡張グラフ表現
An Enhanced Graph Representation for Machine Learning Based Automatic Intersection Management
交差点管理を強化学習で解くため、車両のノード特徴に加えてエッジ特徴を用いるグラフ表現とGNNを改良し、遅延削減と未学習レイアウトへの汎化を評価した。
著者: Marvin Klimke, Jasper Gerigk, Benjamin Völz, Michael Buchholz
分類: cs.RO, cs.LG
原文アブストラクト
The improvement of traffic efficiency at urban intersections receives strong research interest in the field of automated intersection management. So far, mostly non-learning algorithms like reservation or optimization-based ones were proposed to solve the underlying multi-agent planning problem. At the same time, automated driving functions for a single ego vehicle are increasingly implemented using machine learning methods. In this work, we build upon a previously presented graph-based scene representation and graph neural network to approach the problem using reinforcement learning. The scene representation is improved in key aspects by using edge features in addition to the existing node features for the vehicles. This leads to an increased representation quality that is leveraged by an updated network architecture. The paper provides an in-depth evaluation of the proposed method against baselines that are commonly used in automatic intersection management. Compared to a traditional signalized intersection and an enhanced first-in-first-out scheme, a significant reduction of induced delay is observed at varying traffic densities. Finally, the generalization capability of the graph-based representation is evaluated by testing the policy on intersection layouts not seen during training. The model generalizes virtually without restrictions to smaller intersection layouts and within certain limits to larger ones.
関連論文
- 強化学習による混合交通の効率最適化:トポロジー非依存アプローチとベンチマーク交通制御/強化学習
- ChatGPTはITSを実現できるか?強化学習による混合交通制御の事例交通制御/強化学習
- 強化学習による自動運転車と歩行者の相互作用改善のための適応的道路構成交通制御/強化学習
- 強化学習による無信号交差点での自動運転車の譲り合い行動交通制御/強化学習
- 強化学習による信号なし交差点での自動運転車の集中協調制御交通制御/強化学習
- 自動運転車の動的経路制御を深層強化学習で学習し交通渋滞を間接的に緩和交通制御/強化学習
