Transporting Deformations of Face Emotions in the Shape Spaces: A Comparison of Different Approaches

Abstract

Studying the changes of shape is a common concern in many scientific fields. We address here two problems: (1) quantifying the deformation between two given shapes and (2) transporting this deformation to morph a third shape. These operations can be done with or without point correspondence, depending on the availability of a surface matching algorithm, and on the type of mathematical procedure adopted. In computer vision, the re-targeting of emotions mapped on faces is a common application. We contrast here four different methods used for transporting the deformation toward a target once it was estimated upon the matching of two shapes. These methods come from very different fields such as computational anatomy, computer vision and biology. We used the large diffeomorphic deformation metric mapping and thin plate spline, in order to estimate deformations in a deformational trajectory of a human face experiencing different emotions. Then we use naive transport (NT), linear shift (LS), direct transport (DT) and fanning scheme (FS) to transport the estimated deformations toward four alien faces constituted by 240 homologous points and identifying a triangulation structure of 416 triangles. We used both local and global criteria for evaluating the performance of the 4 methods, e.g., the maintenance of the original deformation. We found DT, LS and FS very effective in recovering the original deformation while NT fails under several aspects in transporting the shape change. As the best method may differ depending on the application, we recommend carefully testing different methods in order to choose the best one for any specific application.

Thirty years of geometric morphometrics: Achievements, challenges, and the ongoing quest for biological meaningfulness

“…In order to transform a face into another, one needs to find the shortest path along this curved manifold of face shapes (the geodesic or Riemannian distance), but depending on the actual parametrization of face shape and facial deformations, there can be many such possible paths and many possible intermediate shapes. Similarly, applying a shape deformation (e.g., a smile) from one face to another face requires one of multiple possible “transport” operations (e.g., Piras et al, 2021), whereas in geometric morphometrics a vector of shape change can simply be applied to another shape (e.g., in “developmental simulations”; McNulty et al, 2006; Neubauer & Gunz, 2018). This challenges the interpretation of linear shape trajectories and the notion of “morphological intermediacy,” that is, all the affine invariant geometries described in Section 5.…”

Strainger Things: Discrete Differential Geometry for Transporting Right Ventricular Deformation Across Meshes

“…These approaches describe the pointwise displacement of every point of the mesh. More modern approaches use parallel transport to transport displacement fields among two meshes while accounting for the non-linear geometry of the mesh spaces [7,10]. However, this strategy does not consider the physiological basis of cardiac mechanics: it ignores that the resulting pointwise displacement is the aggregation of the local contraction and relaxation of individual myocytes, and thus movement at a certain point is affected by the contraction of many myocytes, which will pull the shape.…”