日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

アフォーダンスarXiv:1902.09705

自己を超えて:接地されたアフォーダンスを用いた他者行動の解釈と記述

Beyond the Self: Using Grounded Affordances to Interpret and Describe Others' Actions

シェア:XThreadsFacebookLINEはてブBluesky

ロボットが物体操作を通じて言葉とアフォーダンスの対応を学び、その経験を人間の行動解釈や記述に再利用する発達的アプローチを提案した論文。

著者: Giovanni Saponaro, Lorenzo Jamone, Alexandre Bernardino, Giampiero Salvi

分類: cs.RO, cs.AI, cs.CL, cs.CV, cs.LG

原文アブストラクト

We propose a developmental approach that allows a robot to interpret and describe the actions of human agents by reusing previous experience. The robot first learns the association between words and object affordances by manipulating the objects in its environment. It then uses this information to learn a mapping between its own actions and those performed by a human in a shared environment. It finally fuses the information from these two models to interpret and describe human actions in light of its own experience. In our experiments, we show that the model can be used flexibly to do inference on different aspects of the scene. We can predict the effects of an action on the basis of object properties. We can revise the belief that a certain action occurred, given the observed effects of the human action. In an early action recognition fashion, we can anticipate the effects when the action has only been partially observed. By estimating the probability of words given the evidence and feeding them into a pre-defined grammar, we can generate relevant descriptions of the scene. We believe that this is a step towards providing robots with the fundamental skills to engage in social collaboration with humans.

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  3. 3GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5UC BerkeleyとNVIDIAの研究者、AIエージェントでロボット制御コードを仮想環境で改善研究・技術

PR・アフィリエイト広告

FRONTIER(GPU搭載BTOパソコン)

FRONTIER(GPU搭載BTOパソコン)の公式広告バナーFRONTIERでGPU搭載PCを見る ↗
PR本紙発行元 EmplifAI