VisualPredicator:ロボット計画のための神経記号的述語を用いた抽象世界モデルの学習
VisualPredicator: Learning Abstract World Models with Neuro-Symbolic Predicates for Robot Planning
記号と神経の知識表現を組み合わせた一階述語言語を提案し、述語をオンラインで発明しながら抽象世界モデルを学習する手法を開発。五つのロボットシミュレーション領域で階層強化学習や視覚言語モデル計画より優れたサンプル効率と分布外汎化、解釈性を示した。
著者: Yichao Liang, Nishanth Kumar, Hao Tang, Adrian Weller, Joshua B. Tenenbaum, Tom Silver, João F. Henriques, Kevin Ellis
分類: cs.AI, cs.CV, cs.LG, cs.RO
原文アブストラクト
Broadly intelligent agents should form task-specific abstractions that selectively expose the essential elements of a task, while abstracting away the complexity of the raw sensorimotor space. In this work, we present Neuro-Symbolic Predicates, a first-order abstraction language that combines the strengths of symbolic and neural knowledge representations. We outline an online algorithm for inventing such predicates and learning abstract world models. We compare our approach to hierarchical reinforcement learning, vision-language model planning, and symbolic predicate invention approaches, on both in- and out-of-distribution tasks across five simulated robotic domains. Results show that our approach offers better sample complexity, stronger out-of-distribution generalization, and improved interpretability.
