手装着型デモインターフェースを用いた実行可能性を考慮した観察からの模倣学習
Feasibility-aware Imitation Learning from Observations through a Hand-mounted Demonstration Interface
人間のデモがロボットにとって実行可能かを事前学習済みの順・逆動力学モデルで評価し、視覚フィードバックで提示するとともに学習時の重み付けに用いることで、模倣学習のデータ効率と頑健性を高める手法を提案した。
著者: Kei Takahashi, Hikaru Sasaki, Takamitsu Matsubara
分類: cs.RO, cs.LG
原文アブストラクト
Imitation learning through a demonstration interface is expected to learn policies for robot automation from intuitive human demonstrations. However, due to the differences in human and robot movement characteristics, a human expert might unintentionally demonstrate an action that the robot cannot execute. We propose feasibility-aware behavior cloning from observation (FABCO). In the FABCO framework, the feasibility of each demonstration is assessed using the robot's pre-trained forward and inverse dynamics models. This feasibility information is provided as visual feedback to the demonstrators, encouraging them to refine their demonstrations. During policy learning, estimated feasibility serves as a weight for the demonstration data, improving both the data efficiency and the robustness of the learned policy. We experimentally validated FABCO's effectiveness by applying it to a pipette insertion task involving a pipette and a vial. Four participants assessed the impact of the feasibility feedback and the weighted policy learning in FABCO. Additionally, we used the NASA Task Load Index (NASA-TLX) to evaluate the workload induced by demonstrations with visual feedback.
