Wigner-D調和関数の直接予測による3D同変ポーズ回帰
3D Equivariant Pose Regression via Direct Wigner-D Harmonics Prediction
球面CNNの周波数領域に合わせてWigner-D係数を直接予測し、3D回転を回帰するSO(3)同変な単一画像ポーズ推定手法を提案。
著者: Jongmin Lee, Minsu Cho
分類: cs.CV, cs.LG, cs.RO, eess.IV
原文アブストラクト
Determining the 3D orientations of an object in an image, known as single-image pose estimation, is a crucial task in 3D vision applications. Existing methods typically learn 3D rotations parametrized in the spatial domain using Euler angles or quaternions, but these representations often introduce discontinuities and singularities. SO(3)-equivariant networks enable the structured capture of pose patterns with data-efficient learning, but the parametrizations in spatial domain are incompatible with their architecture, particularly spherical CNNs, which operate in the frequency domain to enhance computational efficiency. To overcome these issues, we propose a frequency-domain approach that directly predicts Wigner-D coefficients for 3D rotation regression, aligning with the operations of spherical CNNs. Our SO(3)-equivariant pose harmonics predictor overcomes the limitations of spatial parameterizations, ensuring consistent pose estimation under arbitrary rotations. Trained with a frequency-domain regression loss, our method achieves state-of-the-art results on benchmarks such as ModelNet10-SO(3) and PASCAL3D+, with significant improvements in accuracy, robustness, and data efficiency.
