Fanoos:学習システムのためのマルチ解像度・マルチ強度の対話型説明
Fanoos: Multi-Resolution, Multi-Strength, Interactive Explanations for Learned Systems
形式検証・ヒューリスティック探索・ユーザー対話を組み合わせ、学習済みシステムの説明をユーザーが望む粒度と忠実度で探索できるフレームワークを提案し、倒立二重振子の制御器とCPU使用率モデルで実証した。
著者: David Bayani, Stefan Mitsch
分類: cs.AI, cs.HC, cs.LG, cs.NE, cs.RO
原文アブストラクト
Machine learning is becoming increasingly important to control the behavior of safety and financially critical components in sophisticated environments, where the inability to understand learned components in general, and neural nets in particular, poses serious obstacles to their adoption. Explainability and interpretability methods for learned systems have gained considerable academic attention, but the focus of current approaches on only one aspect of explanation, at a fixed level of abstraction, and limited if any formal guarantees, prevents those explanations from being digestible by the relevant stakeholders (e.g., end users, certification authorities, engineers) with their diverse backgrounds and situation-specific needs. We introduce Fanoos, a framework for combining formal verification techniques, heuristic search, and user interaction to explore explanations at the desired level of granularity and fidelity. We demonstrate the ability of Fanoos to produce and adjust the abstractness of explanations in response to user requests on a learned controller for an inverted double pendulum and on a learned CPU usage model.
