EnsemConvNet: a deep learning approach for human activity recognition using smartphone sensors for healthcare applications

Mukherjee, Debadyuti; Mondal, Riktim; Singh, Pawan Kumar; Sarkar, Ram; Bhattacharjee, Debotosh

doi:10.1007/s11042-020-09537-7

Cited by 88 publications

(51 citation statements)

References 24 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In segmentation (semantic segmentation), the target object edges are surrounded by outlines, which also label them; moreover, fitting a single image (which could be 2D or 3D) onto another refers to registration. One of the most important and wide-ranging DL applications are in healthcare [225][226][227][228][229][230]. This area of research is critical due to its relation to human lives.…”

Section: Applications Of Deep Learningmentioning

confidence: 99%

Review of deep learning: concepts, CNN architectures, challenges, applications, future directions

et al. 2021

View full text Add to dashboard Cite

In the last few years, the deep learning (DL) computing paradigm has been deemed the Gold Standard in the machine learning (ML) community. Moreover, it has gradually become the most widely used computational approach in the field of ML, thus achieving outstanding results on several complex cognitive tasks, matching or even beating those provided by human performance. One of the benefits of DL is the ability to learn massive amounts of data. The DL field has grown fast in the last few years and it has been extensively used to successfully address a wide range of traditional applications. More importantly, DL has outperformed well-known ML techniques in many domains, e.g., cybersecurity, natural language processing, bioinformatics, robotics and control, and medical information processing, among many others. Despite it has been contributed several works reviewing the State-of-the-Art on DL, all of them only tackled one aspect of the DL, which leads to an overall lack of knowledge about it. Therefore, in this contribution, we propose using a more holistic approach in order to provide a more suitable starting point from which to develop a full understanding of DL. Specifically, this review attempts to provide a more comprehensive survey of the most important aspects of DL and including those enhancements recently added to the field. In particular, this paper outlines the importance of DL, presents the types of DL techniques and networks. It then presents convolutional neural networks (CNNs) which the most utilized DL network type and describes the development of CNNs architectures together with their main features, e.g., starting with the AlexNet network and closing with the High-Resolution network (HR.Net). Finally, we further present the challenges and suggested solutions to help researchers understand the existing research gaps. It is followed by a list of the major DL applications. Computational tools including FPGA, GPU, and CPU are summarized along with a description of their influence on DL. The paper ends with the evolution matrix, benchmark datasets, and summary and conclusion.

show abstract

Section: Applications Of Deep Learningmentioning

confidence: 99%

Review of deep learning: concepts, CNN architectures, challenges, applications, future directions

et al. 2021

View full text Add to dashboard Cite

show abstract

“…This is mainly due to two factors: the increasingly low cost of hardware and the wide spread of mobile devices equipped with inertial sensors. The use of smartphones to both acquire and process signals opens opportunities in a variety of application contexts such as surveillance, healthcare, and delivering [2][3][4].…”

Section: Introductionmentioning

confidence: 99%

Trends in human activity recognition using smartphones

Ferrari

Micucci

Mobilio

et al. 2021

J Reliable Intell Environ

View full text Add to dashboard Cite

Recognizing human activities and monitoring population behavior are fundamental needs of our society. Population security, crowd surveillance, healthcare support and living assistance, and lifestyle and behavior tracking are some of the main applications that require the recognition of human activities. Over the past few decades, researchers have investigated techniques that can automatically recognize human activities. This line of research is commonly known as Human Activity Recognition (HAR). HAR involves many tasks: from signals acquisition to activity classification. The tasks involved are not simple and often require dedicated hardware, sophisticated engineering, and computational and statistical techniques for data preprocessing and analysis. Over the years, different techniques have been tested and different solutions have been proposed to achieve a classification process that provides reliable results. This survey presents the most recent solutions proposed for each task in the human activity classification process, that is, acquisition, preprocessing, data segmentation, feature extraction, and classification. Solutions are analyzed by emphasizing their strengths and weaknesses. For completeness, the survey also presents the metrics commonly used to evaluate the goodness of a classifier and the datasets of inertial signals from smartphones that are mostly used in the evaluation phase.

show abstract

“…During this stage, the researchers also dealt with dataset imbalance, which occurs when there are different numbers of observations for different activity classes in the training dataset. Such a situation makes the classifier susceptible to overfitting in favor of the larger class; in the reviewed studies, this issue was resolved using up-sampling or down-sampling of data 17,[57][58][59] . In addition, the measurements were processed for high-frequency noise cancellation (i.e., "denoising").…”

Section: Data Preprocessingmentioning

confidence: 99%

A systematic review of smartphone-based human activity recognition methods for health research

2021

View full text Add to dashboard Cite

Smartphones are now nearly ubiquitous; their numerous built-in sensors enable continuous measurement of activities of daily living, making them especially well-suited for health research. Researchers have proposed various human activity recognition (HAR) systems aimed at translating measurements from smartphones into various types of physical activity. In this review, we summarized the existing approaches to smartphone-based HAR. For this purpose, we systematically searched Scopus, PubMed, and Web of Science for peer-reviewed articles published up to December 2020 on the use of smartphones for HAR. We extracted information on smartphone body location, sensors, and physical activity types studied and the data transformation techniques and classification schemes used for activity recognition. Consequently, we identified 108 articles and described the various approaches used for data acquisition, data preprocessing, feature extraction, and activity classification, identifying the most common practices, and their alternatives. We conclude that smartphones are well-suited for HAR research in the health sciences. For population-level impact, future studies should focus on improving the quality of collected data, address missing data, incorporate more diverse participants and activities, relax requirements about phone placement, provide more complete documentation on study participants, and share the source code of the implemented methods and algorithms.

show abstract

EnsemConvNet: a deep learning approach for human activity recognition using smartphone sensors for healthcare applications

Cited by 88 publications

References 24 publications

Review of deep learning: concepts, CNN architectures, challenges, applications, future directions

Review of deep learning: concepts, CNN architectures, challenges, applications, future directions

Trends in human activity recognition using smartphones

A systematic review of smartphone-based human activity recognition methods for health research

Contact Info

Product

Resources

About