到達可能性検証に基づく深層強化学習制御ロボティクス・自律システムの信頼性評価
Reachability Verification Based Reliability Assessment for Deep Reinforcement Learning Controlled Robotics and Autonomous Systems
深層強化学習で制御されるロボット・自律システムの安全性を、ニューラルネットワークの形式的検証と到達可能性解析を組み合わせて定量的に評価する枠組みを提案し、実機実験で有効性を示した。
著者: Yi Dong, Xingyu Zhao, Sen Wang, Xiaowei Huang
分類: cs.RO, cs.AI
原文アブストラクト
Deep Reinforcement Learning (DRL) has achieved impressive performance in robotics and autonomous systems (RAS). A key challenge to its deployment in real-life operations is the presence of spuriously unsafe DRL policies. Unexplored states may lead the agent to make wrong decisions that could result in hazards, especially in applications where DRL-trained end-to-end controllers govern the behaviour of RAS. This paper proposes a novel quantitative reliability assessment framework for DRL-controlled RAS, leveraging verification evidence generated from formal reliability analysis of neural networks. A two-level verification framework is introduced to check the safety property with respect to inaccurate observations that are due to, e.g., environmental noise and state changes. Reachability verification tools are leveraged locally to generate safety evidence of trajectories. In contrast, at the global level, we quantify the overall reliability as an aggregated metric of local safety evidence, corresponding to a set of distinct tasks and their occurrence probabilities. The effectiveness of the proposed verification framework is demonstrated and validated via experiments on real RAS.
