Animating Through Warping: An Efficient Method for High-Quality Facial Expression Animation

Structure-Aware Flow Generation for Human Body Reshaping

“…However, feature-level flow-based methods [14,20] can only afford to generate low-resolution person images, thus hardly satisfying the body retouching demands in practice. While pixel-level flow-based models [24,33] can conduct high-resolution face manipulation, their performance on body is far from our expectation, resulting in unsatisfied or inconsistent reshaping results as we observed. We speculate the reason is that the regular physiological structure of the face dramatically reduces the difficulty to learn face editing, but the body is much more complicated due to the flexible articulated structure and multifarious garments.…”

“…Portrait photography retouching is widely used in various fields, such as social media, weddings, and advertisements. While automatic face reshaping is well researched [18,24,28,33] and employed in many applications (e.g., Instagram, Tictok), automatic body reshaping, which generally aims to make figure looks more shapely and attractive, is still far from being settled due to the complicated structure and appearance of human bodies. In fact, body reshaping is a troublesome task even for professional artists.…”

“…Nevertheless, they are still struggling for synthesizing photorealistic person images to avoid visible misalignment artifacts. Recent methods [14,20,24,33] have revealed the effectiveness of flow field in spatial deformation tasks. However, feature-level flow-based methods [14,20] can only afford to generate low-resolution person images, thus hardly satisfying the body retouching demands in practice.…”

“…Our method also has ties to ATW [33] and FAL [24]. ATW proposes a ResWarp module to warp residuals based on the predicted flow motion and adds the warped residuals to generate the final HD results, which enables efficient face animation of high-resolution images.…”

Everything's Talkin': Pareidolia Face Reenactment

“…Pareidolia face reenactment, has large potential usages in filmmaking [47,24], cartoon production [54,57] and mixed reality [48,56], which always requires a massive labor of professional animators. Mostly related, face reen-actment [13,47,25,53] is becoming an emerging topic in recent years.…”