予測問題の分解:neoRLエージェントによる自律ナビゲーション
Decomposing the Prediction Problem; Autonomous Navigation by neoRL Agents
脳の分散的な空間表現に着想を得たNRES表現を用い、強化学習の状態表現を分割して次元の呪いを緩和するneoRLエージェントを提案し、実験で有効性を示した論文。
著者: Per R. Leikanger
分類: cs.RO, cs.AI
原文アブストラクト
Navigating the world is a fundamental ability for any living entity. Accomplishing the same degree of freedom in technology has proven to be difficult. The brain is the only known mechanism capable of voluntary navigation, making neuroscience our best source of inspiration toward autonomy. Assuming that state representation is key, we explore the difference in how the brain and the machine represent the navigational state. Where Reinforcement Learning (RL) requires a monolithic state representation in accordance with the Markov property, Neural Representation of Euclidean Space (NRES) reflects navigational state via distributed activation patterns. We show how NRES-Oriented RL (neoRL) agents are possible before verifying our theoretical findings by experiments. Ultimately, neoRL agents are capable of behavior synthesis across state spaces -- allowing for decomposition of the problem into smaller spaces, alleviating the curse of dimensionality.
