深層強化学習による血流中磁気人工マイクロスイマーの最適ナビゲーション
Optimal navigation of magnetic artificial microswimmers in blood capillaries with deep reinforcement learning
網膜毛細血管内を流れる血液の詳細シミュレーションと低次元モデルを組み合わせ、強化学習で磁気人工細菌鞭毛を目標地点へ導く制御方策を学習した。
著者: Lucas Amoudruz, Sergey Litvinov, Petros Koumoutsakos
分類: physics.bio-ph, cs.LG, cs.RO
原文アブストラクト
Biomedical applications such as targeted drug delivery, microsurgery, and sensing rely on reaching precise areas within the body in a minimally invasive way. Artificial bacterial flagella (ABFs) have emerged as potential tools for this task by navigating through the circulatory system with the help of external magnetic fields. While their swimming characteristics are well understood in simple settings, their controlled navigation through realistic capillary networks remains a significant challenge due to the complexity of blood flow and the high computational cost of detailed simulations. We address this challenge by conducting numerical simulations of ABFs in retinal capillaries, propelled by an external magnetic field. The simulations are based on a validated blood model that predicts the dynamics of individual red blood cells and their hydrodynamic interactions with ABFs. The magnetic field follows a control policy that brings the ABF to a prescribed target. The control policy is learned with an actor-critic, off-policy reinforcement learning algorithm coupled with a reduced-order model of the system. We show that the same policy robustly guides the ABF to a prescribed target in both the reduced-order model and the fine-grained blood simulations. This approach is suitable for designing robust control policies for personalized medicine at moderate computational cost.
