Relationship Between Long-Term Variability of Facial Hue Information in Physiological and Psychological ROIs and Health Condition

Oiwa, Kosuke; Urakami, Kentaro; Lamsal, Bikash; Nagumo, Kent; Nozawa, Akio

doi:10.1109/access.2021.3123203

Cited by 2 publications

(1 citation statement)

References 23 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Facial visible images can be considered a short-term indicator of hemodynamics because facial color contains pulse wave components that fluctuate over a short period. These images have been used to evaluate heart rate variability [1], respiration rate [2], blood pressure [3], and subjective feelings related to health [4]. Facial thermal images can be considered long-term indicators of hemodynamics because skin temperature fluctuates over a long period.…”

Section: Introductionmentioning

confidence: 99%

Attempt to extract features and classify subjective poor physical conditions in facial images using deep metric learning

Hattori

Nagumo

Oiwa

et al. 2022

Artif Life Robotics

Self Cite

View full text Add to dashboard Cite

With the spread of COVID-19, the need for remote detection of physical conditions is increasing, for example, there are several situations wherein the body temperature has to be measured remotely to detect febrile individuals. Aiming to remotely detect physical conditions, the study attempted to investigate anomaly detection based on facial color and skin temperature, which are indicators related to hemodynamics. Triplet loss was used to extract features related to subjective health feelings from facial images to evaluate whether there is a relationship between subjective health feelings and facial images. A classification of subjective health feelings related to poor physical conditions based on these features was also attempted. To obtain the data, an experiment was conducted for approximately 1 year to measure facial visual and thermal images, and subjective feelings related to physical conditions. Anomaly levels were defined based on subjective health feelings. Anomaly detection models were constructed by classifying anomaly and normal data based on subjective health feelings. Facial visible and thermal images were applied to the trained model to quantitatively evaluate the accuracy of the classification of anomaly conditions related to subjective health. At higher levels of anomaly, a combination of facial visible and thermal images resulted in the classification of subjective health feelings with moderate accuracy. Further, the results suggest that the eyes and sides of the nose may indicate subjective health feelings.

show abstract