Real-time image-based control of skin melanin texture

Tsumura, Norimichi; Usuba, Ryoko; Nakaguchi, Toshiya; Shiraishi, Mitsuhiro; Ojima, Nobutoshi; Okiyama, Natsuko; Takase, Koichi; Hori, Kentaro; Okaguchi, Saya; Miyake, Yoichi

doi:10.1145/1187112.1187271

Cited by 5 publications

(2 citation statements)

References 1 publication

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Biophysical skin models Beyond the typical approach in VFX of using a diffuse albedo texture for modeling the skin reflectance, a number of models have been proposed to relate the appearance of human skin with its biophysical structure and composition. [THM99; TOS*03] proposed a simple model accounting for the distribution of melanin and hemoglobin. Later, more advanced models accounting for the multilayer nature of skin, as well as more comprehensive list of chromophores have been proposed [DJ06; CBKM15; IAJG15; KB04; BK10], as well as dynamic models that model the temporal change of the skin coloration from in‐vivo measurements of melanin and hemoglobin concentrations [JSB*10].…”

Section: Related Workmentioning

confidence: 99%

A Hyperspectral Space of Skin Tones for Inverse Rendering of Biophysical Skin Properties

Aliaga

Xia

Xie

et al. 2023

Computer Graphics Forum

View full text Add to dashboard Cite

We present a method for estimating the main properties of human skin, leveraging a hyperspectral dataset of skin tones synthetically generated through a biophysical layered skin model and Monte Carlo light transport simulations. Our approach learns the mapping between the skin parameters and diffuse skin reflectance in such space through an encoder‐decoder network. We assess the performance of RGB and spectral reflectance up to 1 μm, allowing the model to retrieve visible and near‐infrared. Instead of restricting the parameters to values in the ranges reported in medical literature, we allow the model to exceed such ranges to gain expressiveness to recover outliers like beard, eyebrows, rushes and other imperfections. The continuity of our albedo space allows to recover smooth textures of skin properties, enabling reflectance manipulations by meaningful edits of the skin properties. The space is robust under different illumination conditions, and presents high spectral similarity with the current largest datasets of spectral measurements of real human skin while expanding its gamut.

show abstract

Section: Related Workmentioning

confidence: 99%

A Hyperspectral Space of Skin Tones for Inverse Rendering of Biophysical Skin Properties

Aliaga

Xia

Xie

et al. 2023

Computer Graphics Forum

View full text Add to dashboard Cite

show abstract

“…Finally, these layers are combined into one sub-image. Tsumura [6] proposed skin melanin texture control based on the Laplacian pyramid decomposition. In the present study, the wavelet decomposition with the Daubechies filter provides smooth synthesis of several textures on skin.…”

Section: Layer 2 X W2mentioning

confidence: 99%

Synthesis of Facial Images with Foundation Make-Up

Doi

Ohtsuki²,

Hikima³

et al. 2009

Lecture Notes in Computer Science

View full text Add to dashboard Cite

A method is described for synthesizing color images of whole human face with foundation make-up by using bare face image and the surface-spectral reflectance of the bare cheek. The synthesis of made-up facial images is based on the estimation of skin color with foundation make-up and the control of skin texture. First, the made-up skin color is estimated from the spectral reflectance of the bare cheek and the optical properties of the foundation. The spectral reflectance of made-up skin is calculated by the Kubelka-Munk theory. Second, smooth texture control is done by the intensity change of layers in the multi-resolution analysis with the Daubechies wavelet. Luster is enhanced and acnes are attenuated by the texture control. Experimental results show the accurate estimation of made-up skin color and the effective texture control. It is shown that the made-up face images are rendered with sufficient accuracy.

show abstract

Image Analysis and Synthesis of Skin Color Textures by Wavelet Transform

Doi

Tominaga

2006 IEEE Southwest Symposium on Image Analysis and Interpretation

View full text Add to dashboard Cite

Real-time image-based control of skin melanin texture

Cited by 5 publications

References 1 publication

A Hyperspectral Space of Skin Tones for Inverse Rendering of Biophysical Skin Properties

A Hyperspectral Space of Skin Tones for Inverse Rendering of Biophysical Skin Properties

Synthesis of Facial Images with Foundation Make-Up

Image Analysis and Synthesis of Skin Color Textures by Wavelet Transform

Contact Info

Product

Resources

About