堅牢な脚式ロボットにおける神経ダイナミクスの集団レベル解析
A Population-Level Analysis of Neural Dynamics in Robust Legged Robots
強化学習で訓練した脚式ロボットの制御器について、集団レベルの神経活動を計算神経科学の手法で解析し、歩行時のリカレント状態が低次元で構造化されていることや、脆弱な制御器が感覚入力に強く依存することを明らかにした。
著者: Eugene R. Rush, Christoffer Heckman, Kaushik Jayaram, J. Sean Humbert
分類: cs.RO, cs.AI, cs.LG, cs.NE, q-bio.NC
原文アブストラクト
Recurrent neural network-based reinforcement learning systems are capable of complex motor control tasks such as locomotion and manipulation, however, much of their underlying mechanisms still remain difficult to interpret. Our aim is to leverage computational neuroscience methodologies to understanding the population-level activity of robust robot locomotion controllers. Our investigation begins by analyzing topological structure, discovering that fragile controllers have a higher number of fixed points with unstable directions, resulting in poorer balance when instructed to stand in place. Next, we analyze the forced response of the system by applying targeted neural perturbations along directions of dominant population-level activity. We find evidence that recurrent state dynamics are structured and low-dimensional during walking, which aligns with primate studies. Additionally, when recurrent states are perturbed to zero, fragile agents continue to walk, which is indicative of a stronger reliance on sensory input and weaker recurrence.
