- SGAligner (本手法の前身と推測される 3D scene graph alignment 手法)
- 単一モダリティ point cloud ベースの 3D scene graph alignment の代表的先行研究
- cross-modal な scene graph 学習や language-aided な 3D 理解に関する研究
- visual localization、3D reconstruction、embodied navigation における scene graph 活用研究
- 具体的な論文名は要旨で明示されていないため、上記分野の定番手法を参照するのが妥当
Aligning 3D scene graphs is a crucial initial step for several applications in robot navigation and embodied perception. Current methods in 3D scene graph alignment often rely on single-modality point cloud data and struggle with incomplete or noisy input. We introduce SGAligner++, a cross-modal, language-aided framework for 3D scene graph alignment. Our method addresses the challenge of aligning partially overlapping scene observations across heterogeneous modalities by learning a unified joint embedding space, enabling accurate alignment even under low-overlap conditions and sensor noise. By employing lightweight unimodal encoders and attention-based fusion, SGAligner++ enhances scene understanding for tasks such as visual localization, 3D reconstruction, and navigation, while ensuring scalability and minimal computational overhead. Extensive evaluations on real-world datasets demonstrate that SGAligner++ outperforms state-of-the-art methods by up to 40% on noisy real-world reconstructions, while enabling cross-modal generalization.