悪意ある挙動車両に対応する自動運転車の無信号交差点意思決定フレームワーク
Autonomous Vehicle Decision-Making Framework for Considering Malicious Behavior at Unsignalized Intersections
無信号交差点で悪意ある挙動をする車両に対処するため、Q学習に一次心の理論推論を組み込み、安全性を強調する可変重み付け報酬で自動運転車の意思決定を改善する手法を提案し、Prescan/Simulink連成シミュレーションで検証した。
著者: Qing Li, Jinxing Hua, Qiuxia Sun
分類: cs.RO, cs.LG
原文アブストラクト
In this paper, we propose a Q-learning based decision-making framework to improve the safety and efficiency of Autonomous Vehicles when they encounter other maliciously behaving vehicles while passing through unsignalized intersections. In Autonomous Vehicles, conventional reward signals are set as regular rewards regarding feedback factors such as safety and efficiency. In this paper, safety gains are modulated by variable weighting parameters to ensure that safety can be emphasized more in emergency situations. The framework proposed in this paper introduces first-order theory of mind inferences on top of conventional rewards, using first-order beliefs as additional reward signals. The decision framework enables Autonomous Vehicles to make informed decisions when encountering vehicles with potentially malicious behaviors at unsignalized intersections, thereby improving the overall safety and efficiency of Autonomous Vehicle transportation systems. In order to verify the performance of the decision framework, this paper uses Prescan/Simulink co-simulations for simulation, and the results show that the performance of the decision framework can meet the set requirements.
