日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

sim2realarXiv:2412.00259

微分可能シミュレーションとレンダリングによるワンショット実機-to-シミュレーション

One-Shot Real-to-Sim via End-to-End Differentiable Simulation and Rendering

シェア:XThreadsFacebookLINEはてブBluesky

ロボットの1回の動作系列から、微分可能な物理シミュレータとレンダリングを組み合わせて、物体の形状・見た目・物理特性を同時に推定し、シミュレーションとレンダリングに使える世界モデルを学習する手法を提案。

著者: Yifan Zhu, Tianyi Xiang, Aaron Dollar, Zherong Pan

分類: cs.RO, cs.CV, cs.GR

原文アブストラクト

Identifying predictive world models for robots in novel environments from sparse online observations is essential for robot task planning and execution in novel environments. However, existing methods that leverage differentiable programming to identify world models are incapable of jointly optimizing the geometry, appearance, and physical properties of the scene. In this work, we introduce a novel rigid object representation that allows the joint identification of these properties. Our method employs a novel differentiable point-based geometry representation coupled with a grid-based appearance field, which allows differentiable object collision detection and rendering. Combined with a differentiable physical simulator, we achieve end-to-end optimization of world models, given the sparse visual and tactile observations of a physical motion sequence. Through a series of world model identification tasks in simulated and real environments, we show that our method can learn both simulation- and rendering-ready world models from only one robot action sequence. The code and additional videos are available at our project website: https://tianyi20.github.io/rigid-world-model.github.io/

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  3. 3GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5UC BerkeleyとNVIDIAの研究者、AIエージェントでロボット制御コードを仮想環境で改善研究・技術

PR・アフィリエイト広告

FRONTIER(GPU搭載BTOパソコン)

FRONTIER(GPU搭載BTOパソコン)の公式広告バナーFRONTIERでGPU搭載PCを見る ↗
PR本紙発行元 EmplifAI