自動運転車の相互依存要件テストのための強化学習:実証研究
Reinforcement Learning for Testing Interdependent Requirements in Autonomous Vehicles: An Empirical Study
自動運転車の相互依存する要件を同時にテストするシナリオ生成において、単一目的強化学習と多目的強化学習を比較し、多目的の方が多様な違反シナリオを生成し、単一目的の方が深刻な違反を生むことを示した。
著者: Jiahui Wu, Chengjie Lu, Aitor Arrieta, Shaukat Ali
分類: cs.SE, cs.LG, cs.RO
原文アブストラクト
Autonomous vehicles (AVs) make driving decisions without humans, making dependability assurance critical. Scenario-based testing is widely used to evaluate AVs under diverse conditions, with reinforcement learning (RL) generating test scenarios that identify violations of functional and safety requirements. Many requirements are interdependent and involve trade-offs, making it unclear whether single-objective RL (SORL), which combines objectives into a single reward, can reliably reveal violations or whether multi-objective RL (MORL), which explicitly considers multiple objectives, is necessary. We present an empirical evaluation comparing SORL and MORL for generating critical scenarios that simultaneously test interdependent requirements using an end-to-end AV controller and high-fidelity simulator. Results suggest that MORL and SORL differ mainly in how violations occur, while showing comparable effectiveness in many cases. MORL tends to generate more requirement-violation scenarios, whereas SORL produces higher-severity violations. Their relative performance also depends on specific objective combinations and, to a lesser extent, road conditions. Regarding diversity, MORL consistently covers a broader range of scenarios. Thus, MORL is preferable when scenario diversity and coverage are prioritized, whereas SORL may better expose severe violations. Our empirical evaluation addresses a gap by systematically comparing SORL and MORL, highlighting the importance of requirement dependencies in RL-based AV testing.
