データ適合から発見へ:強化学習による運動制御の神経ダイナミクスの解釈
From Data-Fitting to Discovery: Interpreting the Neural Dynamics of Motor Control through Reinforcement Learning
強化学習で歩行を学習した仮想ロボットのリカレントニューラルネットワークを解析し、霊長類の歩行・サイクリング実験で見られる神経活動の構造(軌道の絡まり回避や速度軸)を再現していることを示した。
著者: Eugene R. Rush, Kaushik Jayaram, J. Sean Humbert
分類: q-bio.NC, cs.AI, cs.LG, cs.NE, cs.RO
原文アブストラクト
In motor neuroscience, artificial recurrent neural networks models often complement animal studies. However, most modeling efforts are limited to data-fitting, and the few that examine virtual embodied agents in a reinforcement learning context, do not draw direct comparisons to their biological counterparts. Our study addressing this gap, by uncovering structured neural activity of a virtual robot performing legged locomotion that directly support experimental findings of primate walking and cycling. We find that embodied agents trained to walk exhibit smooth dynamics that avoid tangling -- or opposing neural trajectories in neighboring neural space -- a core principle in computational neuroscience. Specifically, across a wide suite of gaits, the agent displays neural trajectories in the recurrent layers are less tangled than those in the input-driven actuation layers. To better interpret the neural separation of these elliptical-shaped trajectories, we identify speed axes that maximizes variance of mean activity across different forward, lateral, and rotational speed conditions.
