深層強化学習を用いたヒューマノイドサッカーロボットのリアルタイム能動視覚
Real-time Active Vision for a Humanoid Soccer Robot Using Deep Reinforcement Learning
ヒューマノイドサッカーロボットの頭部視点をDeep Q-learningで最適化し、自己位置推定に有用なランドマークとボールを同時に捉える能動視覚手法を提案した論文。
著者: Soheil Khatibi, Meisam Teimouri, Mahdi Rezaei
分類: cs.RO, cs.AI, cs.CV, cs.LG, eess.IV
原文アブストラクト
In this paper, we present an active vision method using a deep reinforcement learning approach for a humanoid soccer-playing robot. The proposed method adaptively optimises the viewpoint of the robot to acquire the most useful landmarks for self-localisation while keeping the ball into its viewpoint. Active vision is critical for humanoid decision-maker robots with a limited field of view. To deal with an active vision problem, several probabilistic entropy-based approaches have previously been proposed which are highly dependent on the accuracy of the self-localisation model. However, in this research, we formulate the problem as an episodic reinforcement learning problem and employ a Deep Q-learning method to solve it. The proposed network only requires the raw images of the camera to move the robot's head toward the best viewpoint. The model shows a very competitive rate of 80% success rate in achieving the best viewpoint. We implemented the proposed method on a humanoid robot simulated in Webots simulator. Our evaluations and experimental results show that the proposed method outperforms the entropy-based methods in the RoboCup context, in cases with high self-localisation errors.
関連論文
- 限られた視覚観測下での能動視覚強化学習能動視覚/強化学習
