ヒステリシスを考慮したニューラルネットワークモデリングと全身強化学習によるソフトロボット制御
Hysteresis-Aware Neural Network Modeling and Whole-Body Reinforcement Learning Control of Soft Robots
軟質材料のヒステリシスを考慮した全身NNモデルを構築し、強化学習で全身制御方策を学習。ファントム実験で高精度な軌道追従を実現した。
著者: Zongyuan Chen, Yan Xia, Jiayuan Liu, Jijia Liu, Wenhao Tang, Jiayu Chen, Feng Gao, Longfei Ma, Hongen Liao, Yu Wang, Chao Yu, Boyu Zhang, Fei Xing
分類: cs.RO, cs.LG
原文アブストラクト
Soft robots exhibit inherent compliance and safety, which makes them particularly suitable for applications requiring direct physical interaction with humans, such as surgical procedures. However, their nonlinear and hysteretic behavior, resulting from the properties of soft materials, presents substantial challenges for accurate modeling and control. In this study, we present a soft robotic system designed for surgical applications and propose a hysteresis-aware whole-body neural network model that accurately captures and predicts the soft robot's whole-body motion, including its hysteretic behavior. Building upon the high-precision dynamic model, we construct a highly parallel simulation environment for soft robot control and apply an on-policy reinforcement learning algorithm to efficiently train whole-body motion control strategies. Based on the trained control policy, we developed a soft robotic system for surgical applications and validated it through phantom-based laser ablation experiments in a physical environment. The results demonstrate that the hysteresis-aware modeling reduces the Mean Squared Error (MSE) by 84.95 percent compared to traditional modeling methods. The deployed control algorithm achieved a trajectory tracking error ranging from 0.126 to 0.250 mm on the real soft robot, highlighting its precision in real-world conditions. The proposed method showed strong performance in phantom-based surgical experiments and demonstrates its potential for complex scenarios, including future real-world clinical applications.
関連論文
- ソフトロボティクスのための高速化強化学習:数年が数時間にソフトロボティクス/強化学習
- 腱駆動型ロボットクラゲ:拘束型ソフトアクチュエーションと強化学習による深度制御ソフトロボティクス/強化学習
- ソフトロボットにおける全身インタラクションによる推論と操作の学習ソフトロボティクス/強化学習
- 線形埋め込み空間での強化学習によるソフトロボット構成横断的な汎用制御ソフトロボティクス/強化学習
- ソフトロボットアームの集中型・分散型強化学習制御の定量的比較ソフトロボティクス/強化学習
- 這い方を学ぶ:ソフトロボットの適応移動のための潜在モデルベース強化学習ソフトロボティクス/強化学習
