対話型強化学習における広域的・持続的アドバイスの活用
Broad-persistent Advice for Interactive Reinforcement Learning Scenarios
対話型強化学習において、与えられた助言を一度きりで捨てずに保持・再利用し、現在の状態だけでなく広く適用できるようにする手法を提案し、エージェントの性能向上と訓練者の介入回数削減を実現した。
著者: Francisco Cruz, Adam Bignold, Hung Son Nguyen, Richard Dazeley, Peter Vamplew
分類: cs.AI, cs.LG, cs.RO
原文アブストラクト
The use of interactive advice in reinforcement learning scenarios allows for speeding up the learning process for autonomous agents. Current interactive reinforcement learning research has been limited to real-time interactions that offer relevant user advice to the current state only. Moreover, the information provided by each interaction is not retained and instead discarded by the agent after a single use. In this paper, we present a method for retaining and reusing provided knowledge, allowing trainers to give general advice relevant to more than just the current state. Results obtained show that the use of broad-persistent advice substantially improves the performance of the agent while reducing the number of interactions required for the trainer.
