点群セグメンテーションのための連続条件付き確率場畳み込み
Continuous Conditional Random Field Convolution for Point Cloud Segmentation
点群特徴量を連続的なCRFでモデル化し、その解法をグラフ畳み込みとして実装してネットワークに組み込むことで、特徴表現力と位置精度を高めるセグメンテーション手法を提案した論文。
著者: Fei Yang, Franck Davoine, Huan Wang, Zhong Jin
分類: cs.CV, cs.RO
原文アブストラクト
Point cloud segmentation is the foundation of 3D environmental perception for modern intelligent systems. To solve this problem and image segmentation, conditional random fields (CRFs) are usually formulated as discrete models in label space to encourage label consistency, which is actually a kind of postprocessing. In this paper, we reconsider the CRF in feature space for point cloud segmentation because it can capture the structure of features well to improve the representation ability of features rather than simply smoothing. Therefore, we first model the point cloud features with a continuous quadratic energy model and formulate its solution process as a message-passing graph convolution, by which it can be easily integrated into a deep network. We theoretically demonstrate that the message passing in the graph convolution is equivalent to the mean-field approximation of a continuous CRF model. Furthermore, we build an encoder-decoder network based on the proposed continuous CRF graph convolution (CRFConv), in which the CRFConv embedded in the decoding layers can restore the details of high-level features that were lost in the encoding stage to enhance the location ability of the network, thereby benefiting segmentation. Analogous to the CRFConv, we show that the classical discrete CRF can also work collaboratively with the proposed network via another graph convolution to further improve the segmentation results. Experiments on various point cloud benchmarks demonstrate the effectiveness and robustness of the proposed method. Compared with the state-of-the-art methods, the proposed method can also achieve competitive segmentation performance.
関連論文
- 不確実性推定を特徴量・損失関数として活用する3D LiDAR点群セマンティックセグメンテーション点群セグメンテーション
- 遮蔽された点群知覚における同一性置換:建設ロボットのための壁を見る点群セグメンテーション
- SpaceCache: 点群ストリーム上の効率的なセマンティックセグメンテーションのための中間特徴量再利用点群セグメンテーション
- GUARD: ロボットによるハードディスク分解のための幾何学的不確実性を考慮した点群ノイズ除去とセグメンテーション点群セグメンテーション
- 能動学習によるラベル効率の良い点群セグメンテーション点群セグメンテーション
- LiDARの視点から:陸上点群セグメンテーションのための特徴量拡充と不確実性を考慮したアノテーションパイプライン点群セグメンテーション
