日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

3DシーングラフarXiv:2503.07909

FunGraph: 機能を考慮した3Dシーングラフによる言語プロンプトに基づくシーン操作

FunGraph: Functionality Aware 3D Scene Graphs for Language-Prompted Scene Interaction

シェア:XThreadsFacebookLINEはてブBluesky

3Dリソースから2Dデータを生成して学習した検出器で、アフォーダンスに関わる部位を細粒度で検出し、3Dシーングラフ生成パイプラインを拡張することで、言語指示に基づく機能的なシーン操作を可能にした研究。

著者: Dennis Rotondi, Fabio Scaparro, Hermann Blum, Kai O. Arras

分類: cs.CV, cs.AI, cs.RO

原文アブストラクト

The concept of 3D scene graphs is increasingly recognized as a powerful semantic and hierarchical representation of the environment. Current approaches often address this at a coarse, object-level resolution. In contrast, our goal is to develop a representation that enables robots to directly interact with their environment by identifying both the location of functional interactive elements and how these can be used. To achieve this, we focus on detecting and storing objects at a finer resolution, focusing on affordance-relevant parts. The primary challenge lies in the scarcity of data that extends beyond instance-level detection and the inherent difficulty of capturing detailed object features using robotic sensors. We leverage currently available 3D resources to generate 2D data and train a detector, which is then used to augment the standard 3D scene graph generation pipeline. Through our experiments, we demonstrate that our approach achieves functional element segmentation comparable to state-of-the-art 3D models and that our augmentation enables task-driven affordance grounding with higher accuracy than the current solutions. See our project page at https://fungraph.github.io.

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  3. 3GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5UC BerkeleyとNVIDIAの研究者、AIエージェントでロボット制御コードを仮想環境で改善研究・技術

PR・アフィリエイト広告

MINISFORUM(ミニPC)

MINISFORUM(ミニPC)の公式広告バナーMINISFORUM公式ストアを見る ↗
PR本紙発行元 EmplifAI