SGFormer: 衛星・地上融合による3Dセマンティックシーン補完
SGFormer: Satellite-Ground Fusion for 3D Semantic Scene Completion
視覚的遮蔽に強い3Dセマンティックシーン補完のため、衛星画像と地上画像を並列に符号化して統合する初の衛星・地上協調フレームワークを提案した論文。
著者: Xiyue Guo, Jiarui Hu, Junjie Hu, Hujun Bao, Guofeng Zhang
分類: cs.CV, cs.RO
原文アブストラクト
Recently, camera-based solutions have been extensively explored for scene semantic completion (SSC). Despite their success in visible areas, existing methods struggle to capture complete scene semantics due to frequent visual occlusions. To address this limitation, this paper presents the first satellite-ground cooperative SSC framework, i.e., SGFormer, exploring the potential of satellite-ground image pairs in the SSC task. Specifically, we propose a dual-branch architecture that encodes orthogonal satellite and ground views in parallel, unifying them into a common domain. Additionally, we design a ground-view guidance strategy that corrects satellite image biases during feature encoding, addressing misalignment between satellite and ground views. Moreover, we develop an adaptive weighting strategy that balances contributions from satellite and ground views. Experiments demonstrate that SGFormer outperforms the state of the art on SemanticKITTI and SSCBench-KITTI-360 datasets. Our code is available on https://github.com/gxytcrc/SGFormer.
