Real-time realizable mobile imaging photoplethysmography

Lee, Hooseok; Ko, Hoon; Chung, Ho Young; Nam, Yunyoung; Hong, Sangjin; Lee, Jin-Seok

doi:10.1038/s41598-022-11265-x

Cited by 12 publications

(3 citation statements)

References 55 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Previous research studies have used a variety of different equipment and set-up to capture data from participants to obtain vital signs. Thermal camera [67], [68], [69], [70], Charge-Coupled Device (CCD) camera [71], [72], other affordable web cameras or those built-in laptops [73], [74], [75], [76], [77], [78], [79], [80], [81], MS Kinect V2 [82], [83], [66], Kinect Azure [84], GoPro camera with a drone [85] and smartphone [86], [87], [88], [89], [90], [91], [92], [93], [94] cameras have been previously used to obtain a person’s vital signs. Table V and Table IV show different studies conducted with various equipment and the vital sign under observation.…”

Section: Rppg Processmentioning

confidence: 99%

Remote Photoplethysmography (rPPG): A State-of-the-Art Review

Pirzada,

Wilde,

Doherty

et al. 2023

Preprint

View full text Add to dashboard Cite

Peripheral oxygen saturation (SpO2) and heart rate (HR) are critical physiological measures that clinicians need to observe to decide on an emergency intervention. These measures are typically determined using a contact-based pulse oximeter. This approach may pose difficulties in many cases, such as with young children, patients with burnt or sensitive skin, cognitive impairments, and those undergoing certain medical procedures or severe illnesses. Remote Photoplethysmography (rPPG) allows for unobtrusive sensing of these vital signs in a variety of settings for health monitoring systems. Several research studies have been conducted to use rPPG for this purpose; however, there is still not a commercially available, clinically validated system that overcomes the concerns highlighted in this paper. We present a state-of-the-art review of rPPG-related research conducted including related processes and techniques, such as regions of interest (ROI) selection, extracting the raw signal, pre-processing data, applying noise reduction algorithms, Fast Fourier transforms (FFT), filtering and extracting these vital signs. Further, we present a detailed, critical evaluation of available rPPG systems. Limitations and future directions have also been identified to aid rPPG researchers in further advancing this field.

show abstract

Section: Rppg Processmentioning

confidence: 99%

Remote Photoplethysmography (rPPG): A State-of-the-Art Review

Pirzada,

Wilde,

Doherty

et al. 2023

Preprint

View full text Add to dashboard Cite

show abstract

“…In order to improve potential implementation of rPPG and remove restrictions from subject movement, previous work has focused on deploying rPPG on robotic platforms that may track and follow individuals. These works use a differential-wheel robot mounted with devices such as a 3D camera, laptop, and webcam [6], [7]. We previously used the quadruped Spot robot by Boston dynamics mounted with RGB and IR cameras [3].…”

Section: A Remote Photoplethysmographymentioning

confidence: 99%

Cost-effective Mobile Solution for Autonomous and Continuous Vital Signs Monitoring

Huang¹,

Chen²,

Rupp³

et al. 2023

Preprint

View full text Add to dashboard Cite

The Covid-19 Pandemic has renewed interest in contactless vital signs monitoring using state-of-the-art computer vision, which can efficiently screen for symptoms while reducing the risk of disease transmission. Despite the promising perfor- mance, the use of static camera setups requires subjects to remain static inside a field of view (FoV) for a pre-specified duration. Due to inconsistent ambient environmental conditions, the transit of individuals through the FoV, and the time it may take to triage individuals, the widespread adoption of static camera systems to continuously monitor vital signs has had suboptimal uptake. Robotic systems enable autonomous and continuous monitoring, but these require expensive cameras, computers, and robotic platforms, limiting widespread deployment. In response, we propose a cost-effective and scalable robotic solution consisting of a suite of commercial, off-the-shelf wireless cameras for capturing photoplethysmography (PPG) on ambulatory subjects linked to a single computer that supervises the cameras to compute the vital signs of subjects. Throughout a set of careful investigations of each individual step of the wireless machine vision camera and computer, bottlenecks constraining wireless live-streaming of high-quality PPG information are identified and those are addressed by a hybrid centralized/decentralized wireless machine vision protocol. Our results demonstrate that the proposed cost-effective wireless camera achieves equivalent remote-PPG accuracy to its costly, USB3 counterparts (mean error: 5.0 BMP vs. 4.7 BPM) by means of the hybrid camera protocol which boosts the overall frame rate to 17 FPS. In contrast, using the standard method that captures the PPG with the same spatial resolution can only achieve 1 FPS. In addition, this work also elucidates how varying the distance, image pixel density, frame rate, image compression, image downsampling, and color depth affect the rPPG performance. For each of the effects, we also discuss potential solutions for the cost-effective setup.

show abstract

“…These are then processed through complex computer algorithms and converted into physiological data ( 6 , 7 ). These data can potentially be used to extrapolate parameters such as heart rate (HR), heart rate variability (HRV), respiratory rate (RR), oxygen saturation (SpO 2 ) and blood pressure (BP) ( 8 , 9 ). Since the introduction of rPPG around the mid-2000s ( 10 ), this technology has been validated for use in adults for assessment of vital signs ( 11 , 12 ).…”

Section: Introductionmentioning

confidence: 99%

A two-phased study on the use of remote photoplethysmography (rPPG) in paediatric care

Ahmad Hatib,

Lee,

Chong

et al. 2024

Ann Transl Med

View full text Add to dashboard Cite

Background Advancements in medical technologies have led to the development of contact-free methods of haemodynamic monitoring such as remote photoplethysmography (rPPG). rPPG uses video cameras to interpret variations in skin colour related to blood flow, which are analysed to generate vital signs readings. rPPG potentially ameliorates problems like fretfulness and fragile skin contact associated with conventional probes in children. While rPPG has been validated in adults, no prior validation has been performed in children. Methods A two-phased prospective cross-sectional single-centre study was conducted from January to April 2023 to evaluate the feasibility, acceptability, and accuracy of obtaining heart rate (HR), respiratory rate (RR) and oxygen saturation (SpO 2 ) using rPPG in children, compared to the current standard of care. In Phase 1, we recruited patients ≤16 years from the neonatal and paediatric wards. We excluded preterm neonates with gestational age <35 weeks and newborns <24 hours old. The rPPG webcam was positioned 30 cm from the face. After 1 minute of facial scanning, readings generated were compared with pulse oximetry for HR and SpO 2 , and manual counting for RR. Correlation and Bland-Altman analyses were performed. In Phase 2, we focused on the population in whom there was potential correlation between rPPG and the actual vital signs. Results Ten neonates and 28 children aged 5 to 16 years were recruited for Phase 1 (765 datapoints). All patients were haemodynamically stable and normothermic. Patients and caregivers showed high acceptability to rPPG. rPPG values were clinically discrepant for children <10 years. For those ≥10 years, moderate correlation was observed for HR, with Spearman’s correlation coefficient (Rs) of 0.50 [95% confidence intervals (CI): 0.42, 0.57]. We performed Phase 2 on 23 patients aged 12 to 16 years (559 datapoints). Strong correlation was observed for HR with Rs=0.82 (95% CI: 0.78, 0.85). There was weak correlation for SpO 2 and RR (Rs=−0.25 and −0.02, respectively). Conclusions Our study showed that rPPG is acceptable and feasible for neonates and children aged 5 to 16 years, and HR values in older children aged 12 to 16 years correlated well with the current standard. The rPPG algorithms need to be further refined for younger children, and for obtaining RR and SpO 2 in all children. If successful, rPPG will provide a viable contact-free alternative for assessing paediatric vital signs, with potential use in remote monitoring and telemedicine.

show abstract

Real-time realizable mobile imaging photoplethysmography

Cited by 12 publications

References 55 publications

Remote Photoplethysmography (rPPG): A State-of-the-Art Review

Remote Photoplethysmography (rPPG): A State-of-the-Art Review

Cost-effective Mobile Solution for Autonomous and Continuous Vital Signs Monitoring

A two-phased study on the use of remote photoplethysmography (rPPG) in paediatric care

Contact Info

Product

Resources

About