階層型強化学習による産業用HVACシステムの最適化
Optimizing Industrial HVAC Systems with Hierarchical Reinforcement Learning
動作時間スケールの異なる複数のエージェントを用いた階層型強化学習により、機械制約を守りつつ産業用冷却システムの省エネを実現する手法を提案した。
著者: William Wong, Praneet Dutta, Octavian Voicu, Yuri Chervonyi, Cosmin Paduraru, Jerry Luo
分類: cs.LG, cs.AI, cs.MA, cs.RO, cs.SY, eess.SY
原文アブストラクト
Reinforcement learning (RL) techniques have been developed to optimize industrial cooling systems, offering substantial energy savings compared to traditional heuristic policies. A major challenge in industrial control involves learning behaviors that are feasible in the real world due to machinery constraints. For example, certain actions can only be executed every few hours while other actions can be taken more frequently. Without extensive reward engineering and experimentation, an RL agent may not learn realistic operation of machinery. To address this, we use hierarchical reinforcement learning with multiple agents that control subsets of actions according to their operation time scales. Our hierarchical approach achieves energy savings over existing baselines while maintaining constraints such as operating chillers within safe bounds in a simulated HVAC control environment.
