クォータニオンを用いたニューラルネットワークによる人間の動作モデリング
Modeling Human Motion with Quaternion-based Neural Networks
関節回転をクォータニオンで表現し、順運動学に基づく損失で位置誤差を直接最小化するQuaterNetを提案。短期予測と長期生成の両方で高精度かつ安定な3D人間姿勢生成を実現した。
著者: Dario Pavllo, Christoph Feichtenhofer, Michael Auli, David Grangier
分類: cs.CV, cs.AI, cs.RO
原文アブストラクト
Previous work on predicting or generating 3D human pose sequences regresses either joint rotations or joint positions. The former strategy is prone to error accumulation along the kinematic chain, as well as discontinuities when using Euler angles or exponential maps as parameterizations. The latter requires re-projection onto skeleton constraints to avoid bone stretching and invalid configurations. This work addresses both limitations. QuaterNet represents rotations with quaternions and our loss function performs forward kinematics on a skeleton to penalize absolute position errors instead of angle errors. We investigate both recurrent and convolutional architectures and evaluate on short-term prediction and long-term generation. For the latter, our approach is qualitatively judged as realistic as recent neural strategies from the graphics literature. Our experiments compare quaternions to Euler angles as well as exponential maps and show that only a very short context is required to make reliable future predictions. Finally, we show that the standard evaluation protocol for Human3.6M produces high variance results and we propose a simple solution.
