日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

安全性検証arXiv:2010.10740

モデルベース強化学習コントローラの安全性検証フレームワーク

Safety Verification of Model Based Reinforcement Learning Controllers

シェア:XThreadsFacebookLINEはてブBluesky

到達可能集合解析を用いて、ニューラルネットで表現されたモデルベース強化学習コントローラの安全性を効率的に検証し、安全に実行可能な初期状態の部分集合を特定する手法を提案した。

著者: Akshita Gupta, Inseok Hwang

分類: cs.LG, cs.RO, cs.SY, eess.SY

原文アブストラクト

Model-based reinforcement learning (RL) has emerged as a promising tool for developing controllers for real world systems (e.g., robotics, autonomous driving, etc.). However, real systems often have constraints imposed on their state space which must be satisfied to ensure the safety of the system and its environment. Developing a verification tool for RL algorithms is challenging because the non-linear structure of neural networks impedes analytical verification of such models or controllers. To this end, we present a novel safety verification framework for model-based RL controllers using reachable set analysis. The proposed frame-work can efficiently handle models and controllers which are represented using neural networks. Additionally, if a controller fails to satisfy the safety constraints in general, the proposed framework can also be used to identify the subset of initial states from which the controller can be safely executed.

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  3. 3newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5UC BerkeleyとNVIDIAの研究者、AIエージェントでロボット制御コードを仮想環境で改善研究・技術

PR・アフィリエイト広告

MINISFORUM(ミニPC)

MINISFORUM(ミニPC)の公式広告バナーMINISFORUM公式ストアを見る ↗
PR本紙発行元 EmplifAI