強化学習による歩行訓練のための個別化インピーダンス景観の形成
Shaping Individualized Impedance Landscapes for Gait Training via Reinforcement Learning
歩行訓練向けに、被験者の運動能力と課題要求に応じて力場を位相依存的に自律的に再形成する適応型アシスト・アズ・ニーデッド制御器を提案し、健常者によるトレッドミル訓練で有効性を検証した。
著者: Yufeng Zhang, Shuai Li, Karen J. Nolan, Damiano Zanotto
分類: cs.RO
原文アブストラクト
Assist-as-needed (AAN) control aims at promoting therapeutic outcomes in robot-assisted rehabilitation by encouraging patients' active participation. Impedance control is used by most AAN controllers to create a compliant force field around a target motion to ensure tracking accuracy while allowing moderate kinematic errors. However, since the parameters governing the shape of the force field are often tuned manually or adapted online based on simplistic assumptions about subjects' learning abilities, the effectiveness of conventional AAN controllers may be limited. In this work, we propose a novel adaptive AAN controller that is capable of autonomously reshaping the force field in a phase-dependent manner according to each individual's motor abilities and task requirements. The proposed controller consists of a modified Policy Improvement with Path Integral algorithm, a model-free, sampling-based reinforcement learning method that learns a subject-specific impedance landscape in real-time, and a hierarchical policy parameter evaluation structure that embeds the AAN paradigm by specifying performance-driven learning goals. The adaptability of the proposed control strategy to subjects' motor responses and its ability to promote short-term motor adaptations are experimentally validated through treadmill training sessions with able-bodied subjects who learned altered gait patterns with the assistance of a powered ankle-foot orthosis.
