視覚デモンストレーションから関節運動を学習する
Learning Articulated Motions From Visual Demonstration
人間が物体を動かす深度映像から、マーカーレス特徴追跡と運動分割を用いて剛体・直動・回転関節を含む運動学モデルを獲得する手法を提案した。
著者: Sudeep Pillai, Matthew R. Walter, Seth Teller
分類: cs.RO, cs.CV
原文アブストラクト
Many functional elements of human homes and workplaces consist of rigid components which are connected through one or more sliding or rotating linkages. Examples include doors and drawers of cabinets and appliances; laptops; and swivel office chairs. A robotic mobile manipulator would benefit from the ability to acquire kinematic models of such objects from observation. This paper describes a method by which a robot can acquire an object model by capturing depth imagery of the object as a human moves it through its range of motion. We envision that in future, a machine newly introduced to an environment could be shown by its human user the articulated objects particular to that environment, inferring from these "visual demonstrations" enough information to actuate each object independently of the user. Our method employs sparse (markerless) feature tracking, motion segmentation, component pose estimation, and articulation learning; it does not require prior object models. Using the method, a robot can observe an object being exercised, infer a kinematic model incorporating rigid, prismatic and revolute joints, then use the model to predict the object's motion from a novel vantage point. We evaluate the method's performance, and compare it to that of a previously published technique, for a variety of household objects.
関連論文
- Kinematify: オープンボキャブラリによる高自由度関節物体の合成関節物体モデリング
- SM³: 多視点2D画像を用いた自己教師あり多タスク関節物体モデリング関節物体モデリング
