日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

触覚arXiv:2004.14487

カメラに触覚を:画像から表面の触覚的物理特性を推定する

Teaching Cameras to Feel: Estimating Tactile Physical Properties of Surfaces From Images

シェア:XThreadsFacebookLINEはてブBluesky

多視点画像から摩擦・柔軟性・粘着・質感・熱伝導などの触覚的物理特性を推定するクロスモーダル手法を提案し、画像と触覚特性を対応付けた初のデータセットを構築した。

著者: Matthew Purri, Kristin Dana

分類: cs.CV, cs.LG, cs.RO, eess.IV

原文アブストラクト

The connection between visual input and tactile sensing is critical for object manipulation tasks such as grasping and pushing. In this work, we introduce the challenging task of estimating a set of tactile physical properties from visual information. We aim to build a model that learns the complex mapping between visual information and tactile physical properties. We construct a first of its kind image-tactile dataset with over 400 multiview image sequences and the corresponding tactile properties. A total of fifteen tactile physical properties across categories including friction, compliance, adhesion, texture, and thermal conductance are measured and then estimated by our models. We develop a cross-modal framework comprised of an adversarial objective and a novel visuo-tactile joint classification loss. Additionally, we develop a neural architecture search framework capable of selecting optimal combinations of viewing angles for estimating a given physical property.

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  3. 3NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  4. 4GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  5. 5Google DeepMind、ロボット向けAIを発表新製品・発表

PR・アフィリエイト広告

OZ GAMING(GPU搭載BTOゲーミングPC)

OZ GAMING(GPU搭載BTOゲーミングPC)の公式広告バナーOZ GAMINGで完成品PCを見る ↗
PR本紙発行元 EmplifAI