Makeup Creativity Enhancement with an Augmented Reality Face Makeup System

Treepong, Bantita; Mitake, Hironori; Hasegawa, Shoichi

doi:10.1145/3277452

Cited by 13 publications

(10 citation statements)

References 7 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…These ideas were explored by Bermano et al [48] who proposed a live facial make-up system designed for novel performances. Treepong et al [49] also implemented a tool aiming to improve make-up creativity. In similar lines of work, AR dynamic dresses were proposed by Kleinberger and Panjwani [44] as a "new form of expression through clothing to reflect identity, personality, emotions and inner states of the wearer".…”

Section: Body Accessorizationmentioning

confidence: 99%

See 1 more Smart Citation

Being an Avatar “for Real”: A Survey on Virtual Embodiment in Augmented Reality

Genay¹,

Lécuyer

Hachet³

2022

IEEE Trans. Visual. Comput. Graphics

View full text Add to dashboard Cite

Virtual self-avatars have been increasingly used in Augmented Reality (AR) where one can see virtual content embedded into physical space. However, little is known about the perception of self-avatars in such a context. The possibility that their embodiment could be achieved in a similar way as in Virtual Reality opens the door to numerous applications in education, communication, entertainment, or the medical field. This article aims to review the literature covering the embodiment of virtual self-avatars in AR. Our goal is (i) to guide readers through the different options and challenges linked to the implementation of AR embodiment systems, (ii) to provide a better understanding of AR embodiment perception by classifying the existing knowledge, and (iii) to offer insight on future research topics and trends for AR and avatar research. To do so, we introduce a taxonomy of virtual embodiment experiences by defining a "body avatarization" continuum. The presented knowledge suggests that the sense of embodiment evolves in the same way in AR as in other settings, but this possibility has yet to be fully investigated. We suggest that, whilst it is yet to be well understood, the embodiment of avatars has a promising future in AR and conclude by discussing possible directions for research.

show abstract

Section: Body Accessorizationmentioning

confidence: 99%

“…Most of the user's body consequently remains visible outside of the display during 1PP full-body avatarization. In previous work, such displays were mostly used to implement virtual mirrors [29], [42], [49], [68].…”

Section: Displaying Avatars In Armentioning

confidence: 99%

Being an Avatar “for Real”: A Survey on Virtual Embodiment in Augmented Reality

Genay¹,

Lécuyer

Hachet³

2022

IEEE Trans. Visual. Comput. Graphics

View full text Add to dashboard Cite

show abstract

“…An interactive mobile application was proposed for makeup tutorials [2]. A makeup instruction with AR was proposed to provide special makeup tools [18]. In this work, we aim to provide the real-time guidance to support users for drawing better eyeliner and improving makeup skills.…”

Section: Makeup Guidancementioning

confidence: 99%

ILoveEye: Eyeliner Makeup Guidance System with Eye Shape Features

Wang¹,

Xie²

2022

Preprint

View full text Add to dashboard Cite

Drawing eyeliner is not an easy task for whom lacks experience in eye makeup. Everyone has a unique pair of eyes, so they need to draw eyeliner in a style that suits their eyes. We proposed ILoveEye, an interactive system that supports eye-makeup novices to draw natural and suitable eyeliner. The proposed system analyzes the shape of the user's eyes and classifies the eye types from camera frame. The system can recommend the eyeliner style to the user based on the designed recommendation rules. Then, the system can generate the original patterns corresponding to the eyeliner style, and the user can draw the eyeliner while observing the real-time makeup guidance. The user evaluation experiments are conducted to verify that the proposed ILoveEye system can help some users to draw reasonable eyeliner based on the specific eye shapes and improve their eye makeup skills 1 .

show abstract

“…erefore, complex parametric fitting requires lots of precise data and detailed descriptions. Generative adversarial networks have recently demonstrated excellence in image editing [9][10][11], which shows great potential in producing realistic images [12]; many modified generative adversarial network models are used to generate real face images.…”

Section: Introductionmentioning

confidence: 99%

FRGAN: A Blind Face Restoration with Generative Adversarial Networks

Wei

Li²,

Chen³

et al. 2021

Mathematical Problems in Engineering

View full text Add to dashboard Cite

Recent works based on deep learning and facial priors have performed well in superresolving severely degraded facial images. However, due to the limitation of illumination, pixels of the monitoring probe itself, focusing area, and human motion, the face image is usually blurred or even deformed. To address this problem, we properly propose Face Restoration Generative Adversarial Networks to improve the resolution and restore the details of the blurred face. They include the Head Pose Estimation Network, Postural Transformer Network, and Face Generative Adversarial Networks. In this paper, we employ the following: (i) Swish-B activation function that is used in Face Generative Adversarial Networks to accelerate the convergence speed of the cross-entropy cost function, (ii) a special prejudgment monitor that is added to improve the accuracy of the discriminant, and (iii) the modified Postural Transformer Network that is used with 3D face reconstruction network to correct faces at different expression pose angles. Our method improves the resolution of face image and performs well in image restoration. We demonstrate how our method can produce high-quality faces, and it is superior to the most advanced methods on the reconstruction task of blind faces for in-the-wild images; especially, our 8 × SR SSIM and PSNR are, respectively, 0.078 and 1.16 higher than FSRNet in AFLW.

show abstract

Makeup Creativity Enhancement with an Augmented Reality Face Makeup System

Cited by 13 publications

References 7 publications

Being an Avatar “for Real”: A Survey on Virtual Embodiment in Augmented Reality

Being an Avatar “for Real”: A Survey on Virtual Embodiment in Augmented Reality

ILoveEye: Eyeliner Makeup Guidance System with Eye Shape Features

FRGAN: A Blind Face Restoration with Generative Adversarial Networks

Contact Info

Product

Resources

About