SILICA: 拡散モデルの事前知識を再利用したガラス領域分割と深度推定の統合
SILICA: Repurposing Diffusion Priors for Joint Glass Segmentation and Depth Estimation
テキストから画像を生成する拡散モデルの事前知識を活用し、ガラスの領域分割と深度推定を同時に行う統一パイプラインを提案。実世界のガラス深度アノテーションを不要とし、ゼロショットで未知環境に一般化できることを示した。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Tarun R, Anuj Verma, Laksh Nanwani, Sourav Garg, K. Madhava Krishna
分類: cs.CV, cs.RO
原文アブストラクト
Standard depth sensors systematically fail on transparent surfaces, creating corrupted 3D maps and severe navigation hazards. While specialized hardware sensors can detect glass, they lack modularity and have extensive hardware dependencies. Consequently, learning-based monocular depth estimation has emerged as a compelling alternative. However, domain-specific glass-aware monocular depth estimators struggle with unfamiliar indoor layouts; restricted by the severe scarcity of real-world glass depth annotations, they fail to generalize zero-shot to new settings. This motivates us to explore whether the extensive priors of text-to-image diffusion models can enable generalizable perception of transparent surfaces. We introduce SILICA, a unified pipeline leveraging these priors to jointly predict glass segmentation and glass-aware depth. This mutual information exchange establishes a robust spatial hierarchy, entirely eliminating the need for paired real-world glass depth annotations. Subsequently, we use the predicted segmentation mask to explicitly filter incorrect glass depth points from standard sensors, recovering accurate metric glass depth for downstream 3D mapping and autonomous collision avoidance. Supported by our novel Mirage 18k dataset, extensive experiments demonstrate that SILICA achieves remarkable zero-shot transfer across diverse, unseen environments, outperforming state-of-the-art models by almost 20% and setting a new benchmark for transparent surface perception.
関連論文
- FreDSNet: 高速フーリエ畳み込みによる単眼深度推定と意味セグメンテーションの同時実行深度推定/セグメンテーション
