A Conditional GAN for Generating Time Series Data for Stress Detection in Wearable Physiological Sensor Data

Abstract

Human-centered applications using wearable sensors in combination with machine learning have received a great deal of attention in the last couple of years. At the same time, wearable sensors have also evolved and are now able to accurately measure physiological signals and are, therefore, suitable for detecting body reactions to stress. The field of machine learning, or more precisely, deep learning, has been able to produce outstanding results. However, in order to produce these good results, large amounts of labeled data are needed, which, in the context of physiological data related to stress detection, are a great challenge to collect, as they usually require costly experiments or expert knowledge. This usually results in an imbalanced and small dataset, which makes it difficult to train a deep learning algorithm. In recent studies, this problem is tackled with data augmentation via a Generative Adversarial Network (GAN). Conditional GANs (cGAN) are particularly suitable for this as they provide the opportunity to feed auxiliary information such as a class label into the training process to generate labeled data. However, it has been found that during the training process of GANs, different problems usually occur, such as mode collapse or vanishing gradients. To tackle the problems mentioned above, we propose a Long Short-Term Memory (LSTM) network, combined with a Fully Convolutional Network (FCN) cGAN architecture, with an additional diversity term to generate synthetic physiological data, which are used to augment the training dataset to improve the performance of a binary classifier for stress detection. We evaluated the methodology on our collected physiological measurement dataset, and we were able to show that using the method, the performance of an LSTM and an FCN classifier could be improved. Further, we showed that the generated data could not be distinguished from the real data any longer.

Machine Learning for Smart Irrigation in Agriculture: How Far along Are We?

“…They can effectively detect sensor failures, which helps make the right decisions about irrigation. For example, the use of Autoencoders [98] and GANs [99] should be further investigated considering the recent promising results in [100,101].…”

Stress Assessment for Augmented Reality Applications Based on Head Movement Features

“…The unpleasant pictures in the International Affective Picture System (IAPS) database can be used to induce a stress response [21]. In [22], [23], the onset of stress is caused by a horn sound played randomly during the test. In the Cold Pressor Test [24], participants are asked to immerse a hand or foot in cold water.…”

Hybrid deep learning model for wearable sensor‐based stress recognition for Internet of Medical Things (IoMT) system

“…Sano and Piccard 26 attempted to distinguish between stress and neutral states using an accelerometer (Acc), an EDA, a phone call, and hybrid models such as principal component analysis (PCA) + SVM and PCA + kNN. Ehrhart et al 27 used conditional generative adversarial networks (GANs) for physiological signal augmentation, which increased the performance of LSTM and fully connected network classifier in detecting stress from wearable sensors.…”