追加の教師なしで特徴点を学習し画像からの強化学習を改善
Learning of feature points without additional supervision improves reinforcement learning from images
微分可能な特徴点抽出器を強化学習エージェントに直接組み込み、事前学習や追加損失なしで画像からの制御性能を向上させた研究。
著者: Rinu Boney, Alexander Ilin, Juho Kannala
分類: cs.LG, cs.CV, cs.RO
原文アブストラクト
In many control problems that include vision, optimal controls can be inferred from the location of the objects in the scene. This information can be represented using feature points, which is a list of spatial locations in learned feature maps of an input image. Previous works show that feature points learned using unsupervised pre-training or human supervision can provide good features for control tasks. In this paper, we show that it is possible to learn efficient feature point representations end-to-end, without the need for unsupervised pre-training, decoders, or additional losses. Our proposed architecture consists of a differentiable feature point extractor that feeds the coordinates of the estimated feature points directly to a soft actor-critic agent. The proposed algorithm yields performance competitive to the state-of-the art on DeepMind Control Suite tasks.
