VRヒューマンデモで点群把持ポリシーの持続的失敗を修正
Correcting Persistent Failures in Point-Cloud Grasping Policies using Human Demonstrations in Virtual Reality
RLで学習した点群把持ポリシーが繰り返し失敗する状況を自動抽出し、VRで人間が把持点を示して訓練に戻すことで難事例の成功率を改善した研究。
著者: Achyuthan Unni Krishnan, Karthik Rengarajan, Bharath Narasimhan, Chris von Csefalvay
分類: cs.RO
原文アブストラクト
Robots in homes, warehouses and farms must pick up objects they have never seen, usually without a 3D model or a category label. A grasping policy that works directly on the point cloud from a depth sensor needs only the geometry the robot observes, so it applies to any new object. Offline grasp generators such as Contact-GraspNet work this way, but they rank grasps by learned plausibility rather than by whether the grasp actually lifts the object. Reinforcement learning (RL) can optimize for that directly and make a point-cloud grasping policy much better on average, yet it leaves specific grasps persistently unsolved. We present a human-in-the-loop failure loop that targets those grasps: situations an RL policy keeps failing are mined automatically, sent to a virtual-reality application where a person picks the object up with their own hands, and returned to training as two grasp points. The person contributes only where to grasp; the robot chooses its own approach. In simulation, RL raises success on unseen objects from 55% with Contact-GraspNet to 83%. Adding 58 human demonstrations nearly doubles success on the hard cases RL kept failing, from 24% to 45%, and recovers performance that RL alone loses on similar cases that were never demonstrated, without reducing success on unseen objects.
関連論文
- 環境に寄りかかって遠くの物体に手を伸ばすヒューマノイド制御マニピュレーション
- 目的関数をポリシーとして:接触を伴うマニピュレーションのための視覚言語モデルによるコストプログラムマニピュレーション
- 見えない開始遅延が自己対戦ハンドオーバーを未知のパートナーに頑健にするマニピュレーション
- 非線形マニピュレータの単一線形化軌道計画における最適動作点選択マニピュレーション
- 低出力二重振り子の自然な振り上げ制御マニピュレーション
- 経験時代における実世界コード・アズ・ポリシー:ACE-CaP-0マニピュレーション
