Indoor Activity and Vital Sign Monitoring for Moving People with Multiple Radar Data Fusion

Abstract

The monitoring of human activity and vital signs plays a significant role in remote health-care. Radar provides a non-contact monitoring approach without privacy and illumination concerns. However, multiple people in a narrow indoor environment bring dense multipaths for activity monitoring, and the received vital sign signals are heavily distorted with body movements. This paper proposes a framework based on Frequency Modulated Continuous Wave (FMCW) and Impulse Radio Ultra-Wideband (IR-UWB) radars to address these challenges, designing intelligent spatial-temporal information fusion for activity and vital sign monitoring. First, a local binary pattern (LBP) and energy features are extracted from FMCW radar, combined with the wavelet packet transform (WPT) features on IR-UWB radar for activity monitoring. Then the additional information guided fusing network (A-FuseNet) is proposed with a modified generative and adversarial structure for vital sign monitoring. A Cascaded Convolutional Neural Network (CCNN) module and a Long Short Term Memory (LSTM) module are designed as the fusion sub-network for vital sign information extraction and multisensory data fusion, while a discrimination sub-network is constructed to optimize the fused heartbeat signal. In addition, the activity and movement characteristics are introduced as additional information to guide the fusion and optimization. A multi-radar dataset with an FMCW and two IR-UWB radars in a cotton tent, a small room and a wide lobby is constructed, and the accuracies of activity and vital sign monitoring achieve 99.9% and 92.3% respectively. Experimental results demonstrate the superiority and robustness of the proposed framework.

A Novel Drinking Category Detection Method Based on Wireless Signals and Artificial Neural Network

“…Compared with current sensing technology [ 20 , 21 , 22 , 23 ], it has the three following advantages: (1) sensorless, it is no longer necessary to deploy special sensors to sense people and environment, which is different from wireless sensor networks in which sensors are responsible for sensing and wireless signals are responsible for communication; (2) wireless, no need to deploy wired lines for communications and sensors; (3) contactless, compared with various wearable smart devices, users do not need to wear any devices.…”

A Review on Knitted Flexible Strain Sensors for Human Activity Monitoring

“…Combining signal processing and output circuits on flexible fabric boards to achieve smart wearable electronic devices in biomedicine shows great potential for future applications. [ 140 ]…”

Radar-based remote physiological sensing: Progress, challenges, and opportunities

“…The human study was also carried out using radar at different medical centers; the respiratory rate was extracted in subjects with lung conditions and obstructive sleep apnea; the accuracy of the reported system was greater than 98.25% ( Broic-Lubecke et al, 2012 ). Indoor activity and vital signs monitoring during different activities is also possible using the FMCW radar module as Radar can provide the range, velocity, and angle information of humans ( Yang et al, 2021 ).…”