MatterDoor: 生成モデルによるゼロショット時空間意味論的事前分布のサンプリング
MatterDoor: Sampling Zero-shot Spatio-semantic Priors using Generative Models
事前学習済み生成視覚モデルを用いて、ドア越しに隠れた部屋の3D点群仮説を生成し、ロボットのナビゲーションや目標指向行動のための時空間意味論的事前分布をゼロショットで導出する手法を提案。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Subhransu S. Bhattacharjee, Hao Lu, Dylan Campbell, Rahul Shome
分類: cs.RO, cs.AI, cs.CV
原文アブストラクト
Autonomous robots often view rooms only partially, through a doorway, where the walls and scene structure hide the geometry and task-relevant semantics needed for safe navigation and goal-directed action. We ask whether off-the-shelf pretrained generative vision models can derive this missing structure as zero-shot offline priors for robot reasoning. Such priors should support spatio-semantic queries over unobserved structure, estimating the target object likelihood in hidden regions and the probability that those regions are occupied. Given an egocentric RGB observation and target query, our pipeline uses VLM-guided outpainting, monocular depth estimation, and semantic segmentation to sample semantically labeled 3D point cloud hypotheses of the hidden room. We introduce MatterDoor, a Matterport3D-derived benchmark of doorway-occluded indoor scenes, and evaluate the resulting priors with generative metrics and simulated Stretch robot object-reaching tasks. Our results suggest that useful spatio-semantic priors for planning can be derived without problem-specific fine-tuning.
