他人の靴で拡散する：拡散モデルによるロボットの視点取得
Diffusing in Someone Else's Shoes: Robotic Perspective Taking with Diffusion
三人称視点の実演から一人称視点の画像を生成する拡散モデルを提案し、ヒューマノイドロボットが直接三人称のデモンストレーションから模倣学習できるようにした。
著者: Josua Spisak, Matthias Kerzel, Stefan Wermter
分類: cs.RO, cs.AI
原文アブストラクト
Humanoid robots can benefit from their similarity to the human shape by learning from humans. When humans teach other humans how to perform actions, they often demonstrate the actions, and the learning human imitates the demonstration to get an idea of how to perform the action. Being able to mentally transfer from a demonstration seen from a third-person perspective to how it should look from a first-person perspective is fundamental for this ability in humans. As this is a challenging task, it is often simplified for robots by creating demonstrations from the first-person perspective. Creating these demonstrations allows for an easier imitation but requires more effort. Therefore, we introduce a novel diffusion model that enables the robot to learn from the third-person demonstrations directly by learning to generate the first-person perspective from the third-person perspective. The model translates the size and rotations of objects and the environment between the two perspectives. This allows us to utilise the benefits of easy-to-produce third-person demonstrations and easy-to-imitate first-person demonstrations.
