FreiHAND：単一RGB画像から手の姿勢と形状をマーカーレスで取得するためのデータセット
FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Images
単一RGB画像から3D手姿勢を推定する際のデータセット間汎化性能の低さを分析し、多視点で3D手姿勢・形状アノテーション付きの大規模実世界データセットを半自動で構築した。このデータセットで学習すると他データセットでも安定して高精度になることを示した。
著者: Christian Zimmermann, Duygu Ceylan, Jimei Yang, Bryan Russell, Max Argus, Thomas Brox
分類: cs.CV, cs.LG, cs.RO
原文アブストラクト
Estimating 3D hand pose from single RGB images is a highly ambiguous problem that relies on an unbiased training dataset. In this paper, we analyze cross-dataset generalization when training on existing datasets. We find that approaches perform well on the datasets they are trained on, but do not generalize to other datasets or in-the-wild scenarios. As a consequence, we introduce the first large-scale, multi-view hand dataset that is accompanied by both 3D hand pose and shape annotations. For annotating this real-world dataset, we propose an iterative, semi-automated `human-in-the-loop' approach, which includes hand fitting optimization to infer both the 3D pose and shape for each sample. We show that methods trained on our dataset consistently perform well when tested on other datasets. Moreover, the dataset allows us to train a network that predicts the full articulated hand shape from a single RGB image. The evaluation set can serve as a benchmark for articulated hand shape estimation.
