強化学習による人とロボットの協調組立における作業順序の習得
Mastering the working sequence in human-robot collaborative assembly based on reinforcement learning
協調組立の作業プロセスをチェス盤に見立て、自己対戦型強化学習でロボットが最適な作業順序を自己学習し、作業効率を高める手法を提案した。
著者: Tian Yu, Jing Huang, Qing Chang
分類: cs.RO, cs.SY, eess.SY
原文アブストラクト
A long-standing goal of the Human-Robot Collaboration (HRC) in manufacturing systems is to increase the collaborative working efficiency. In line with the trend of Industry 4.0 to build up the smart manufacturing system, the Co-robot in the HRC system deserves better designing to be more self-organized and to find the superhuman proficiency by self-learning. Inspired by the impressive machine learning algorithms developed by Google Deep Mind like Alphago Zero, in this paper, the human-robot collaborative assembly working process is formatted into a chessboard and the selection of moves in the chessboard is used to analogize the decision making by both human and robot in the HRC assembly working process. To obtain the optimal policy of working sequence to maximize the working efficiency, the robot is trained with a self-play algorithm based on reinforcement learning, without guidance or domain knowledge beyond game rules. A neural network is also trained to predict the distribution of the priority of move selections and whether a working sequence is the one resulting in the maximum of the HRC efficiency. An adjustable desk assembly is used to demonstrate the proposed HRC assembly algorithm and its efficiency.
