実験における能動的流体制御のための強化学習
Reinforcement Learning for Active Flow Control in Experiments
円柱後流の乱流制御を対象に、強化学習で2つの小型円柱の回転速度を最適化し、抗力低減や効率最大化を実験的に実現した。
著者: Dixia Fan, Liu Yang, Michael S Triantafyllou, George Em Karniadakis
分類: physics.flu-dyn, cs.RO
原文アブストラクト
We demonstrate experimentally the feasibility of applying reinforcement learning (RL) in flow control problems by automatically discovering active control strategies without any prior knowledge of the flow physics. We consider the turbulent flow past a circular cylinder with the aim of reducing the cylinder drag force or maximizing the power gain efficiency by properly selecting the rotational speed of two small diameter cylinders, parallel to and located downstream of the larger cylinder. Given properly designed rewards and noise reduction techniques, after tens of towing experiments, the RL agent could discover the optimal control strategy, comparable to the optimal static control. While RL has been found to be effective in recent computer flow simulation studies, this is the first time that its effectiveness is demonstrated experimentally, paving the way for exploring new optimal active flow control strategies in complex fluid mechanics applications.
