報酬整形が物体目標ナビゲーションに果たす役割
Role of reward shaping in object-goal navigation
深層強化学習による物体目標ナビゲーションにおいて、目標までの距離に応じて報酬を段階的に調整する報酬整形手法を提案し、AI2-THOR環境での実験で有効性を示した論文。
著者: Srirangan Madhavan, Anwesan Pal, Henrik I. Christensen
分類: cs.RO
原文アブストラクト
Deep reinforcement learning approaches have been a popular method for visual navigation tasks in the computer vision and robotics community of late. In most cases, the reward function has a binary structure, i.e., a large positive reward is provided when the agent reaches goal state, and a negative step penalty is assigned for every other state in the environment. A sparse signal like this makes the learning process challenging, specially in big environments, where a large number of sequential actions need to be taken to reach the target. We introduce a reward shaping mechanism which gradually adjusts the reward signal based on distance to the goal. Detailed experiments conducted using the AI2-THOR simulation environment demonstrate the efficacy of the proposed approach for object-goal navigation tasks.
