2020
DOI: 10.48550/arxiv.2004.01946
|View full text |Cite
Preprint
|
Sign up to set email alerts
|

Weakly-Supervised Mesh-Convolutional Hand Reconstruction in the Wild

Abstract: Figure 1: We propose an approach for end-to-end neural network training with mesh supervision that is obtained through an automated data collection method. We process a large collection of YouTube videos and analyze them with 2D hand keypoint detector followed by parametric model fitting (right side). The fitting results are used as a supervisory signal ('mesh loss') for a feed-forward network with a mesh convolutional decoder tasked with recovering a 3D hand mesh at its output (left side).

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
1

Citation Types

0
1
0

Year Published

2021
2021
2021
2021

Publication Types

Select...
1

Relationship

0
1

Authors

Journals

citations
Cited by 1 publication
(1 citation statement)
references
References 47 publications
0
1
0
Order By: Relevance
“…Hand gesture recognition approaches can also be separated in techniques that use 3D hand models such as MANO hand model [35] or 2D images. Current approaches in 3D hand gesture recognition attempt to regress the 3D model shape and pose parameters [6,22]. However, 3D methods rely on guidance from 2D keypoint detection to regress the model parameters, therefore in situations such as segmented hand gestures of binary images, 3D models are deemed inappropriate.…”
Section: Hand Gesture Recognitionmentioning
confidence: 99%
“…Hand gesture recognition approaches can also be separated in techniques that use 3D hand models such as MANO hand model [35] or 2D images. Current approaches in 3D hand gesture recognition attempt to regress the 3D model shape and pose parameters [6,22]. However, 3D methods rely on guidance from 2D keypoint detection to regress the model parameters, therefore in situations such as segmented hand gestures of binary images, 3D models are deemed inappropriate.…”
Section: Hand Gesture Recognitionmentioning
confidence: 99%