Quantitative anatomical analysis of facial expression using a 3D motion capture system: Application to cosmetic surgery and facial recognition technology

Lee, Jae Gi; Jung, Su Jin; Lee, Hyung‐Jin; Seo, Jung Hyuk; Choi, You–Jin; Bae, Hyun Sook; Park, Jong-Tae; Kim, Hee Jin

doi:10.1002/ca.22542

Cited by 12 publications

(11 citation statements)

References 26 publications

(33 reference statements)

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…The facial landmarks can be recorded digitally from the 3D face scanning using the scanner and can be used for facial recognition, capturing facial emotions, facial cosmetic planning and surgery, maxillofacial rehabilitation, etc. [10][11][12][13][14]. The computer aided design/computer aided manufacturing (CAD/CAM) system, milling systems, rapid prototyping, three-dimensional (3D) scanning, and 3D printing have revolutionized and created new modalities in medicine and dentistry, which improved the speed and accuracy of treatment [15][16][17].…”

Section: Introductionmentioning

confidence: 99%

The Accuracy of Digital Face Scans Obtained from 3D Scanners: An In Vitro Study

Amornvit

Sanohkan

2019

IJERPH

View full text Add to dashboard Cite

Face scanners promise wide applications in medicine and dentistry, including facial recognition, capturing facial emotions, facial cosmetic planning and surgery, and maxillofacial rehabilitation. Higher accuracy improves the quality of the data recorded from the face scanner, which ultimately, will improve the outcome. Although there are various face scanners available on the market, there is no evidence of a suitable face scanner for practical applications. The aim of this in vitro study was to analyze the face scans obtained from four scanners; EinScan Pro (EP), EinScan Pro 2X Plus (EP+) (Shining 3D Tech. Co., Ltd. Hangzhou, China), iPhone X (IPX) (Apple Store, Cupertino, CA, USA), and Planmeca ProMax 3D Mid (PM) (Planmeca USA, Inc. IL, USA), and to compare scans obtained from various scanners with the control (measured from Vernier caliper). This should help to identify the appropriate scanner for face scanning. A master face model was created and printed from polylactic acid using the resolution of 200 microns on x, y, and z axes and designed in Rhinoceros 3D modeling software (Rhino, Robert McNeel and Associates for Windows, Washington DC, USA). The face models were 3D scanned with four scanners, five times, according to the manufacturer’s recommendations; EinScan Pro (Shining 3D Tech. Co., Ltd. Hangzhou, China), EinScan Pro 2X Plus (Shining 3D Tech. Co., Ltd. Hangzhou, China) using Shining Software, iPhone X (Apple Store, Cupertino, CA, USA) using Bellus3D Face Application (Bellus3D, version 1.6.2, Bellus3D, Inc. Campbell, CA, USA), and Planmeca ProMax 3D Mid (PM) (Planmeca USA, Inc. IL, USA). Scan data files were saved as stereolithography (STL) files for the measurements. From the STL files, digital face models are created in the computer using Rhinoceros 3D modeling software (Rhino, Robert McNeel and Associates for Windows, Washington DC, USA). Various measurements were measured five times from the reference points in three axes (x, y, and z) using a digital Vernier caliper (VC) (Mitutoyo 150 mm Digital Caliper, Mitutoyo Co., Kanagawa, Japan), and the mean was calculated, which was used as the control. Measurements were measured on the digital face models of EP, EP+, IPX, and PM using Rhinoceros 3D modeling software (Rhino, Robert McNeel and Associates for Windows, Washington DC, USA). The descriptive statistics were done from SPSS version 20 (IBM Company, Chicago, USA). One-way ANOVA with post hoc using Scheffe was done to analyze the differences between the control and the scans (EP, EP+, IPX, and PM). The significance level was set at p = 0.05. EP+ showed the highest accuracy. EP showed medium accuracy and some lesser accuracy (accurate until 10 mm of length), but IPX and PM showed the least accuracy. EP+ showed accuracy in measuring the 2 mm of depth (diameter 6 mm). All other scanners (EP, IPX, and PM) showed less accuracy in measuring depth. Finally, the accuracy of an optical scan is dependent on the technology used by each scanner. It is recommended to use EP+ for face scanning.

show abstract

Section: Introductionmentioning

confidence: 99%

The Accuracy of Digital Face Scans Obtained from 3D Scanners: An In Vitro Study

Amornvit

Sanohkan

2019

IJERPH

View full text Add to dashboard Cite

show abstract

“…Similar differences were reported in our previous study (Sforza et al, ): the free smile entailed bigger displacements of almost all labial landmarks. Differences were also observed in six facial expressions among health volunteers, males having larger displacements [ranging from 14.31 mm (fear) to 41.15 mm (anger)] than females (Lee et al, ).…”

Section: Discussionmentioning

confidence: 96%

“…Nowadays, 3D motion analyzers allow soft‐tissue facial movements to be quantified noninvasively and without interfering with the subject's performance. Among others, optoelectronic motion analyzers and laser scans offer valuable support for extracting accurate numerical values (Weeden et al, ; Giovanoli et al, ; Ferrario and Sforza, ; Popat et al, ; Sforza et al, ; Sidequersky et al, ; Lee et al, ). A patient's range of facial motion can be compared to reference values obtained from healthy individuals matched for age, gender, and ethnicity (Sforza et al, ; Popat et al, ); longitudinal assessments can also be performed during treatment and rehabilitation (Proff et al, ; Sforza et al, ; Hontanilla and Marre, ; Al‐Hiyali et al, ).…”

Section: Introductionmentioning

confidence: 99%

Three‐dimensional motion analysis of facial movement during verbal and nonverbal expressions in healthy subjects

et al. 2016

View full text Add to dashboard Cite

Functional impairments of facial expressions alter the quality of life and their quantitative analysis is key to describing and grading facial function and dysfunction. The aim of this investigation was to quantify 3D lip movements in a group of healthy young subjects. Lip movements during five repetitions of common and random sequences of vowels and nonverbal expressions were recorded using an optoelectronic 3D motion analyzer. The mean maximum displacement of facial landmarks was used to compute 3D unilateral mobility and the symmetry indices (SI) separately for each sex. Facial mobility was significantly greater during open-mouth than closed-mouth smiles. Facial movement among the subjects was largest during articulation of the vowel /a/ and smallest for /i/. Lips were pursed with a SI very close to 95%, while smiles were slightly more asymmetric. The vowel /a/ was articulated with significantly greater symmetry than /e/, /i/ and /u/. The outcomes suggest that the proposed method characterized normal facial animations satisfactorily, so it could be a useful tool for assessing patients with facial lesions and dentofacial deformities. Patient assessment would profit from this quantitative approach, which would reduce discrepancies among several clinical examinations. Clin. Anat. 29:991-997, 2016. © 2016 Wiley Periodicals, Inc.

show abstract

“…Para isso, foram utilizados 21 pontos antropométricos como marcadores de tecido mole na face. Também, outros movimentos faciais são utilizados para mensuração, como protrusão de lábios (Vimercati et al, 2012) e expressões faciais popularmente ditas como "medo", "prazer", "surpresa", "raiva", "tristeza" e "nojo" (Lee et al, 2015). Para avaliar os movimentos da fala, geralmente emprega-se palavras com sons bilabiais envolvendo articulação dos lábios superior e inferior (Popat et al, 2008a;2008b;; 2012) e sequências de vogais .…”

Section: Análise Tridimensional Do Movimento Facialunclassified

“…Cada prova foi explicada e demonstrada para os sujeitos, bem como solicitado que realizasse o movimento antes do início do exame. Ao total, seis provas foram realizadas a partir do repouso até a realização do movimento máximo e em seguida retornando a posição de repouso, segundo estudos realizados previamente (Sforza et al, 2010Lee et al, 2015):…”

Section: Movimentos Faciais Registradosunclassified

Desempenho da mímica facial e qualidade de vida na fase aguda da paralisia facial periférica

Vilela¹

View full text Add to dashboard Cite

Vilela, M. Facial mimicry performance and quality of life in the acute phase of peripheral facial paralysis [dissertacion]. Ribeirão Preto: University of São Paulo, School of Medicine of Ribeirão Preto; 2019.Introduction: Peripheral facial paralysis (PFP) is the most common cranial neuropathy, which the facial nerve responsible for facial mime loses its function.Therefore, it is understood the importance of investigating the psychological impact that it causes in the patients of this pathology and the damages regarding the muscular function to aid in the diagnosis and prognosis. Objectives:To analyze the performance of facial mimicry in PFP compared to healthy control subjects and their relation with quality of life (QOL) and severity of motor impairment. Methods: This research was a cross-sectional observational study in which patients with unilateral acquired PFP in the acute phase, between 18 and 59 years old (GPFP) and healthy control subjects (CG) at the same age group. A total of 236 subjects with facial paralysis were screened, and of these, 35 subjects with Bell's palsy comprised the GPFP, the mean age was 34.2 years (± 13.6) and 28 subjects with GC with a mean age of 33.9 years (± 13.1). Patients with PFP were classified according to the degree of motor engagement of House and Brackmann. The Facial Disability Index -FDI (physical and social), related to QOL, the Facial Mimicry Mobility Assessment (FMMA) and the Three-Dimensional Analysis (3D) of the Facial Movement were investigated. The non-parametric Mann Whitney test was used in the comparison between the groups for the FDI, FMMA and 3D analysis.Spearman's correlation test analyzed the relationship between the PFP grade and the other variables. Results: Regarding FDI, the GPFP has significantly lower scores than the CG for both subscripts: physical (P <0,0001) and social (P <0,0141). Women with PFP appear to suffer more socially than men (P = 0,046). The overall values of facial mimicry generated by the FMMA were also lower in the GPFP compared to the CG (P <0,0001), as well as in the individual comparison of each muscle (P <0,0001). The 3D analysis showed significantly higher asymmetry indexes in GPFP (P <0,0001). There was a correlation between the degree of PFP and QOL for physical (ρ = -0,40, P <0,01); between the increase in age and worsening of QOL for physical (ρ = -0,45, P <0,005).The FMMA showed correlation with the degree (ρ = -0,65, P <0,0001) and with the QOL for physical (ρ = 0,56, P = 0,0004). Regarding the 3D analysis, all the facial mimicry tests searched correlated with the degree of the PFP, except for the lip protrusion test and the tests of surprise, open smile and closed smile were correlated with the QOL. Conclusions: Patients with PFP have a deficit in muscle function when compared to healthy control group in relation to facial capacity related to QOL, facial mimicry and facial asymmetry differences, with women suffering more in the social context in relation to QOL. The physical capacity related to QOL was influenced by PFP sev...

show abstract

Quantitative anatomical analysis of facial expression using a 3D motion capture system: Application to cosmetic surgery and facial recognition technology

Cited by 12 publications

References 26 publications

The Accuracy of Digital Face Scans Obtained from 3D Scanners: An In Vitro Study

The Accuracy of Digital Face Scans Obtained from 3D Scanners: An In Vitro Study

Three‐dimensional motion analysis of facial movement during verbal and nonverbal expressions in healthy subjects

Desempenho da mímica facial e qualidade de vida na fase aguda da paralisia facial periférica

Contact Info

Product

Resources

About