Obstructive sleep apnea (OSA) is a respiratory disorder characterized by interruption to breathing during sleep. Usually, the OSA is more severe in the supine sleeping position. Recent studies also demonstrated that the head position may play an important role in the pathophysiology of the OSA. Therefore, monitoring the sleeping body and the head position has high clinical importance to optimize the treatment of the OSA. In this paper, three machine learning approaches were used to detect the head position during sleep in infrared images. In the first two methods, supervised classifiers were trained to estimate the head position based on different feature sets extracted from infrared images. In the third method, three different convolutional neural network (CNN) structures (ResNet50, MobileNet, and Darknet19) were trained to detect the head position during sleep. To detect the body position, the same CNN architectures were trained on infrared images. Overnight sleeping data (sleep duration = 5±1 h) from 50 participants (age: 53 ± 15 years, BMI: 29 ± 6 kg/m2, and 30 men/20 women) with various levels of OSA severity as measured by the apnea-hypopnea index (AHI = 25 ± 29 events/h and OSA severity: 12 normal, 13 mild, 11 moderate, and 14 severe) were collected for this paper. The models were trained on the data collected in one laboratory room from half of the participants and tested on the data from the other half collected in a different laboratory room. The best performing model (Darknet19) correctly estimated the lateral versus supine head position with 92% accuracy and 94% F1-Score and the lateral versus supine body position with 87% accuracy and 87% F1-Score. INDEX TERMS Computer vision, machine learning, position detection, sleep apnea, non-contact monitoring. The associate editor coordinating the review of this manuscript and approving it for publication was Thomas Penzel.

A reliable, accessible, and non-intrusive method for tracking respiratory and heart rate is important for improving monitoring and detection of sleep apnea. In this study, an algorithm based on motion analysis of infrared video recordings was validated in 50 adults referred for clinical overnight polysomnography (PSG). The algorithm tracks the displacements of selected feature points on each sleeping participant and extracts respiratory rate using principal component analysis and heart rate using independent component analysis. For respiratory rate estimation (mean ± standard deviation), 89.89 % ± 10.95 % of the overnight estimation was accurate within 1 breath per minute compared to the PSG-derived respiratory rate from the respiratory inductive plethysmography signal, with an average root mean square error (RMSE) of 2.10 ± 1.64 breaths per minute. For heart rate estimation, 77.97 % ± 18.91 % of the overnight estimation was within 5 beats per minute of the heart rate derived from the pulse oximetry signal from PSG, with mean RMSE of 7.47 ± 4.79 beats per minute. No significant difference in estimation of RMSE of either signal was found according to differences in body position, sleep stage, or amount of the body covered by blankets. This vision-based method may prove suitable for overnight, non-contact monitoring of respiratory rate. However, at present, heart rate monitoring is less reliable and will require further work to improve accuracy.

No abstract

Background Sleep apnea is a respiratory disorder characterized by an intermittent reduction (hypopnea) or cessation (apnea) of breathing during sleep. Depending on the presence of a breathing effort, sleep apnea is divided into obstructive sleep apnea (OSA) and central sleep apnea (CSA) based on the different pathologies involved. If the majority of apneas in a person are obstructive, they will be diagnosed as OSA or otherwise as CSA. In addition, as it is challenging and highly controversial to divide hypopneas into central or obstructive, the decision about sleep apnea type (OSA vs CSA) is made based on apneas only. Choosing the appropriate treatment relies on distinguishing between obstructive apnea (OA) and central apnea (CA). Objective The objective of this study was to develop a noncontact method to distinguish between OAs and CAs. Methods Five different computer vision-based algorithms were used to process infrared (IR) video data to track and analyze body movements to differentiate different types of apnea (OA vs CA). In the first two methods, supervised classifiers were trained to process optical flow information. In the remaining three methods, a convolutional neural network (CNN) was designed to extract distinctive features from optical flow and to distinguish OA from CA. Results Overnight sleeping data of 42 participants (mean age 53, SD 15 years; mean BMI 30, SD 7 kg/m2; 27 men and 15 women; mean number of OA 16, SD 30; mean number of CA 3, SD 7; mean apnea-hypopnea index 27, SD 31 events/hour; mean sleep duration 5 hours, SD 1 hour) were collected for this study. The test and train data were recorded in two separate laboratory rooms. The best-performing model (3D-CNN) obtained 95% accuracy and an F1 score of 89% in differentiating OA vs CA. Conclusions In this study, the first vision-based method was developed that differentiates apnea types (OA vs CA). The developed algorithm tracks and analyses chest and abdominal movements captured via an IR video camera. Unlike previously developed approaches, this method does not require any attachment to a user that could potentially alter the sleeping condition.