Automatic 3D Facial Landmark-Based Deformation Transfer on Facial Variants for Blendshape Generation

Ingale, Anupama K.; Leema, A. Anny; kim, HyungSeok; Udayan, J. Divya

doi:10.1007/s13369-022-07403-2

Cited by 3 publications

(1 citation statement)

References 25 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Ingale et al [44] first segment the face by the clustering algorithm, and find the sharp edge vertices as the candidate vertices in the specific cluster. Finally, the candidate points in the specific region are searched for points that satisfy the unique constraints of each landmark as the final result.…”

Section: Goodmentioning

confidence: 99%

Automatic labeling of 3D facial acupoint landmarks

Yin,

Fang,

2024

Metaverse

View full text Add to dashboard Cite

As special marks on a human face, facial landmarks reflect the facial features of various parts of the face, which is crucial in biomedicine and medical imaging. In addition, facial landmarks are also important features in computer vision such as face detection, face recognition, facial pose estimation, and facial animation. In this paper, we construct a 3D facial acupoint annotated dataset by labeling 37 facial acupoints on 846 neutral face triangle mesh on the FaceScape dataset. Based on these annotated data, we use a feature template matching method to realize the automatic annotation of 37 acupoints on triangle meshes. We used 40 meshes as the training set to extract the geometric patterns of 3D acupoints and then measured the performance of the automatic labeling algorithm on 20 meshes and 806 meshes as the test sets. In the training process, we extract the tangent plane for each landmark, project the neighbor vertices of the landmark to the tangent plane, and construct the feature image with R × R resolution through the bounding box of the projected points. In the testing process, we use the pattern images extracted during training to find the average features and use them as a guide to optimize the predicted landmarks. The experimental results show that our automatic acupoint labeling method has achieved good results.

show abstract

Section: Goodmentioning

confidence: 99%