A Modeling Method for the Human Body Model with Facial Morphology

Fang, Naiyu; Qiu, Lemiao; Zhang, Shuyou; Wang, Zili; Yang, Wang; Gu, Ye; Tan, Jianrong

doi:10.1016/j.cad.2021.103106

Cited by 6 publications

(24 citation statements)

References 30 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Face only comparison: For face only customization, the analysis-by-synthesis method from BFM was used as baseline for comparison with the proposed method, and we also compare to other state-of-art methods, including DECA method (Feng et al, 2021) and weak-registration algorithm (Fang et al, 2021).…”

Section: Experiments and Results Discussionmentioning

confidence: 99%

“…Table 1. Quantitative analysis by perceptual similarity BFM (Blanz & Vetter, 1999) DECA (Feng et al, 2021) Weak-rigid registration (Fang et al, 2021) Our method Subset of CelebA (Liu et al, 2015) 0.57±0.01 0.39±0.12 0.59±0.16 0.37±0.10…”

Section: Experiments and Results Discussionmentioning

confidence: 99%

“…Previous research on reconstructing personalized fashion avatars proposed to replace the face part of a full body avatar with a 3DMM face model through cutting and stitching. For example, Fang et al (2021) used the Bezier curve to stitch the BFM face model with the head of fashion avatar. Unfortunately, this will lead to the compression and distortion of the face model along the depth direction due to the degradation of depth ISBN: 978-989-8704-49-8 © 2023 information and inaccurate landmarks.…”

Section: Align and Stitch Head To Fashion Avatarmentioning

confidence: 99%

“…In this regard, some methods were proposed to combine morphable face model with human body model. For example, Fang et al (2021) stitched Basel face model (BFM) (Blanz & Vetter, 1999) to their human avatars to realize personalized shape and texture in virtual try-on application. TF-Flame (Li et al, 2017) transferred the parametric texture model of BFM (Blanz & Vetter, 1999) to the texture uv-map of its full head model.…”

Section: Introductionmentioning

confidence: 99%

“…In addition, these models do not have uniform topology, models reconstructed by PIFu are not animable and thus not suitable for fashion applications. Recently, for improving the personalization of human avatars in virtual try-on system, Fang et al (2021) proposed a weak registration method to align a customized face model to a body model, similar to wearing a `mask'. This method can partly provide customized fashion avatar for virtual try-on system which only possess a generic human avatar.…”

Section: Introductionmentioning

confidence: 99%

See 4 more Smart Citations

Personalized Avatars Creation Based on Realistic 3d Face Reconstruction

2023

Proceedings of the 17 Th International Conference on Interfaces and Human Computer Interaction 2023 (IHCI 2023), the 17th Inter

View full text Add to dashboard Cite

Personalized 3D human avatars hold great potential in the digital era, and this also enables interesting fashion applications such as virtual try-on, virtual fashion shows, and immersive online shopping experiences. Nevertheless, personalized avatars are seldom used in the fashion industry due to the requirements of specialized equipment and the tedious and computationally demanding nature of traditional personalized face modeling processes. In this paper, a novel method is presented for creating personalized fashion avatars by reconstructing a realistic 3D face from a single image. The proposed method involves transferring customized 3D facial shape and appearance, reconstructed from a single face image, onto full-body avatars with varying topologies suitable for different fashion applications. Through a comprehensive comparison with state-of-the-art face reconstruction methods, the proposed method has demonstrated high realism and richer facial details. This technology has already been applied in an augmented reality (AR) mobile application, enabling users to engage in virtual try-on experience of fashion.

show abstract

Section: Experiments and Results Discussionmentioning

confidence: 99%

Section: Experiments and Results Discussionmentioning

confidence: 99%

Section: Align and Stitch Head To Fashion Avatarmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

Personalized Avatars Creation Based on Realistic 3d Face Reconstruction

2023

Proceedings of the 17 Th International Conference on Interfaces and Human Computer Interaction 2023 (IHCI 2023), the 17th Inter

View full text Add to dashboard Cite

show abstract

Personalizing human avatars based on realistic 3D facial reconstruction

Ding,

He,

Mok

2024

Multimed Tools Appl

View full text Add to dashboard Cite

Personalized 3D human avatars have aroused a great deal of interest because it is attractive to most people, particularly generation Z, to have the digital twins in their own appearance to live, work, interact, and shop in the metaverse. Nevertheless, personalized avatars are rarely used in practice because of the computational cost and hardware restrictions in the creation process. This has resulted in avatars of diverse topologies being used on different platforms/systems for various applications, which further hinders the utilization of personalized avatars. This paper reports on a new method for personalizing human avatars, which includes the reconstruction of personalized face models from single images and transferring the reconstructed 3D facial shape and appearance to avatars with varying topologies. This newly developed method is compared with state-of-the-art face reconstruction and personalized avatar reconstruction methods. Based upon the results obtained, it was concluded that the new method created more realistic and true-to-life avatars. This method has been applied in an augmented reality (AR) mobile application, enabling users to engage in virtual try-on experience of fashion. The code will be released once the paper is published.

show abstract