アフォーダンス等価性の学習による身体を超えたアフォーダンス転移
Cross-Embodied Affordance Transfer through Learning Affordance Equivalences
物体・行動・効果を共通の潜在空間に統合し、異なるロボット間でアフォーダンスを転移できる深層学習モデルを提案した。
著者: Hakan Aktas, Yukie Nagai, Minoru Asada, Matteo Saveriano, Erhan Oztop, Emre Ugur
分類: cs.RO, cs.AI, cs.LG
原文アブストラクト
Affordances represent the inherent effect and action possibilities that objects offer to the agents within a given context. From a theoretical viewpoint, affordances bridge the gap between effect and action, providing a functional understanding of the connections between the actions of an agent and its environment in terms of the effects it can cause. In this study, we propose a deep neural network model that unifies objects, actions, and effects into a single latent vector in a common latent space that we call the affordance space. Using the affordance space, our system can generate effect trajectories when action and object are given and can generate action trajectories when effect trajectories and objects are given. Our model does not learn the behavior of individual objects acted upon by a single agent. Still, rather, it forms a `shared affordance representation' spanning multiple agents and objects, which we call Affordance Equivalence. Affordance Equivalence facilitates not only action generalization over objects but also Cross Embodiment transfer linking actions of different robots. In addition to the simulation experiments that demonstrate the proposed model's range of capabilities, we also showcase that our model can be used for direct imitation in real-world settings.
関連論文
- 意味的アンカー付き関数写像による物体間のアフォーダンス転移アフォーダンス転移
- 3Dビジョンデータによる道具のアフォーダンスと操作手がかりの転移アフォーダンス転移
