DiffPhysCam: 逆レンダリングと身体性AIのための微分可能な物理ベースカメラシミュレータ
DiffPhysCam: Differentiable Physics-Based Camera Simulation for Inverse Rendering and Embodied AI
実カメラの画像を模倣する合成画像を生成する微分可能カメラシミュレータを提案し、逆レンダリングによるデジタルツイン構築とロボット知覚・ナビゲーションへの応用を示した。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Bo-Hsun Chen, Nevindu M. Batagoda, Dan Negrut
分類: cs.GR, cs.CV, cs.RO
原文アブストラクト
Generating synthetic images that closely mimic those from real cameras is instrumental in training visual models and enabling end-to-end visuomotor learning. We introduce DiffPhysCam, a differentiable camera simulator designed to support robotics and embodied AI applications by enabling gradient-based optimization in visual perception pipelines. Differentiable rendering also allows inverse reconstruction of real-world scenes as digital twins, facilitating simulation-based robotics training. Existing virtual cameras offer limited control over intrinsic settings, have difficulty capturing optical artifacts, and lack tunable calibration parameters. DiffPhysCam addresses these limitations through a multi-stage pipeline that provides fine-grained control over camera settings, models key optical effects such as defocus blur, and supports calibration with real-world data. It enables both forward rendering for image synthesis and inverse rendering for 3D scene reconstruction, including mesh and material texture optimization. We show that DiffPhysCam enhances robotic perception performance in synthetic image tasks. As an illustrative example, we create a digital twin of a real-world scene using inverse rendering and use it to set up a virtual experiment in a multi-physics simulation, in which we demonstrate navigation of an autonomous ground vehicle using images generated by DiffPhysCam. The code, data, and output results associated with this paper are available online for reproducibility at Chen, Bo-Hsun (2026a,b,c).
