Using imaging photoplethysmography for heart rate estimation in non-human primates

Unakafov, Anton M.; Möller, Sebastian; Kagan, Igor; Gail, Alexander; Treue, Stefan; Wolf, Fred

doi:10.1371/journal.pone.0202581

Cited by 27 publications

(21 citation statements)

References 67 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In any case, reporting this temporal coherence measure is crucial as it indicates that EVM-based HR estimation is sufficiently sensitive to track actual physiological variation of HR in time. These EVM-based HR estimates compare to those reported in a previous study extracting monkey HR from videos using imaging photoplethysmogram 42 . Importantly, and in contrast with this previous study, EVM-based HR estimates can be reliably obtained both from RGB and IR videos.…”

Section: Discussionsupporting

confidence: 63%

“…However, one of the major challenges in this context is the fact that changes in skin reflectance are more difficult to detect in monkeys due to reduced glabrous facial skin surface. In spite of this limitation, Unakafov et al 42 have successfully applied HR tracking in awake macaques in combination with discrete Fourier and wavelet transform based iPPG. While this study is of great interest, it falls short of two objectives that are useful to behavioural and experimental studies in non-human primates.…”

Section: Introductionmentioning

confidence: 99%

“…While this study is of great interest, it falls short of two objectives that are useful to behavioural and experimental studies in non-human primates. First, Unakafov et al 42 do not address IR video-based hear rate estimation, although for example, a lot of neuroscience studies require video recording in light controlled environments. Second, they do not evaluate the sensitivity of their method in the awake behaving monkey and its ability to track subtle changes in heart rate, for example during the processing of emotional stimuli.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Automated video-based heart rate tracking for the anesthetized and behaving monkey

Froesel

Goudard

Hauser³

et al. 2020

Sci Rep

View full text Add to dashboard Cite

Heart rate (HR) is extremely valuable in the study of complex behaviours and their physiological correlates in non-human primates. However, collecting this information is often challenging, involving either invasive implants or tedious behavioural training. In the present study, we implement a Eulerian video magnification (EVM) heart tracking method in the macaque monkey combined with wavelet transform. This is based on a measure of image to image fluctuations in skin reflectance due to changes in blood influx. We show a strong temporal coherence and amplitude match between EVM-based heart tracking and ground truth ECG, from both color (RGB) and infrared (IR) videos, in anesthetized macaques, to a level comparable to what can be achieved in humans. We further show that this method allows to identify consistent HR changes following the presentation of conspecific emotional voices or faces. EVM is used to extract HR in humans but has never been applied to non-human primates. Video photoplethysmography allows to extract awake macaques HR from RGB videos. In contrast, our method allows to extract awake macaques HR from both RGB and IR videos and is particularly resilient to the head motion that can be observed in awake behaving monkeys. Overall, we believe that this method can be generalized as a tool to track HR of the awake behaving monkey, for ethological, behavioural, neuroscience or welfare purposes.

show abstract

Section: Discussionsupporting

confidence: 63%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Automated video-based heart rate tracking for the anesthetized and behaving monkey

Froesel

Goudard

Hauser³

et al. 2020

Sci Rep

View full text Add to dashboard Cite

show abstract

“…Blanik et al [149] used the iPPG technique to extract HR and RR of anesthetized pigs with Acute Respiratory Distress Syndrome (ARDS) using a CCD camera. By means of iPPG, Unakafov et al [150] accurately estimated the HR of rhesus monkeys from facial videos captured by Microsoft Kinect and a monochrome near-infrared (NIR) camera.…”

Section: Animal Researchmentioning

confidence: 99%

Remote Monitoring of Vital Signs in Diverse Non-Clinical and Clinical Scenarios Using Computer Vision Systems: A Review

2019

View full text Add to dashboard Cite

Techniques for noncontact measurement of vital signs using camera imaging technologies have been attracting increasing attention. For noncontact physiological assessments, computer vision-based methods appear to be an advantageous approach that could be robust, hygienic, reliable, safe, cost effective and suitable for long distance and long-term monitoring. In addition, video techniques allow measurements from multiple individuals opportunistically and simultaneously in groups. This paper aims to explore the progress of the technology from controlled clinical scenarios with fixed monitoring installations and controlled lighting, towards uncontrolled environments, crowds and moving sensor platforms. We focus on the diversity of applications and scenarios being studied in this topic. From this review it emerges that automatic multiple regions of interest (ROIs) selection, removal of noise artefacts caused by both illumination variations and motion artefacts, simultaneous multiple person monitoring, long distance detection, multi-camera fusion and accepted publicly available datasets are topics that still require research to enable the technology to mature into many real-world applications.

show abstract

“…Limitations included the need to anesthetize the animals before the experiment and some restrictions concerning the measurement environment (e.g., illumination conditions) [29]. Recently, Unakafov et al [30] proposed a non-contact pulse-monitoring system to extract the iPPG signal from a red, green and blue (RGB) facial video of rhesus monkeys. Although iPPG is a promising technology for non-invasive and non-contact remote estimation of cardiopulmonary signals in non-human primates, application of the technique to animals with hair-covered skin, feathers or thicker epidermal layers would be limited.…”

Section: Introductionmentioning

confidence: 99%

A Pilot Study for Estimating the Cardiopulmonary Signals of Diverse Exotic Animals Using a Digital Camera

Al-Naji

Tao

Smith

et al. 2019

Sensors

View full text Add to dashboard Cite

Monitoring the cardiopulmonary signal of animals is a challenge for veterinarians in conditions when contact with a conscious animal is inconvenient, difficult, damaging, distressing or dangerous to personnel or the animal subject. In this pilot study, we demonstrate a computer vision-based system and use examples of exotic, untamed species to demonstrate this means to extract the cardiopulmonary signal. Subject animals included the following species: Giant panda (Ailuropoda melanoleuca), African lions (Panthera leo), Sumatran tiger (Panthera tigris sumatrae), koala (Phascolarctos cinereus), red kangaroo (Macropus rufus), alpaca (Vicugna pacos), little blue penguin (Eudyptula minor), Sumatran orangutan (Pongo abelii) and Hamadryas baboon (Papio hamadryas). The study was done without need for restriction, fixation, contact or disruption of the daily routine of the subjects. The pilot system extracts the signal from the abdominal-thoracic region, where cardiopulmonary activity is most likely to be visible using image sequences captured by a digital camera. The results show motion on the body surface of the subjects that is characteristic of cardiopulmonary activity and is likely to be useful to estimate physiological parameters (pulse rate and breathing rate) of animals without any physical contact. The results of the study suggest that a fully controlled study against conventional physiological monitoring equipment is ethically warranted, which may lead to a novel approach to non-contact physiological monitoring and remotely sensed health assessment of animals. The method shows promise for applications in veterinary practice, conservation and game management, animal welfare and zoological and behavioral studies.

show abstract

Using imaging photoplethysmography for heart rate estimation in non-human primates

Cited by 27 publications

References 67 publications

Automated video-based heart rate tracking for the anesthetized and behaving monkey

Automated video-based heart rate tracking for the anesthetized and behaving monkey

Remote Monitoring of Vital Signs in Diverse Non-Clinical and Clinical Scenarios Using Computer Vision Systems: A Review

A Pilot Study for Estimating the Cardiopulmonary Signals of Diverse Exotic Animals Using a Digital Camera

Contact Info

Product

Resources

About