Human action recognition based on low- and high-level data from wearable inertial sensors

Abstract

Human action recognition supported by highly accurate specialized systems, ambulatory systems, or wireless sensor networks has a tremendous potential in the areas of healthcare or wellbeing monitoring. Recently, several studies carried out focused on the recognition of actions using wearable inertial sensors, in which raw sensor data are used to build classification models, and in a few of them high-level representations are obtained which are directly related to anatomical characteristics of the human body. This research focuses on classifying a set of activities of daily living, such as functional mobility, and instrumental activities of daily living, such as preparing meals, performed by test subjects in their homes in naturalistic conditions. The joint angles of upper and lower limbs are estimated using information from five wearable inertial sensors placed on the body of five test subjects. A set of features related to human limb motions is extracted from the orientation signals (high-level data) and another set from the acceleration raw signals (low-level data) and both are used to build classifiers using four inference algorithms. The proposed features in this work are the number of movements and the average duration of consecutive movements. The classifiers are capable of successfully classifying the set of actions using raw data with up to 77.8% and 93.3% from high-level data. This study allowed comparing the use of two data levels to classify a set of actions performed in daily environments using an inertial sensor network.

Exploring 3D Human Action Recognition Using STACOG on Multi-View Depth Motion Maps Sequences

“…They combined DPI and att-DTIs through multi-stream deep neural networks and a late fusion scheme. Inertial sensor-based low-level and high-level features are used in [ 46 ] to categorize human actions acted by a performer in real time. Haider et al [ 47 ] introduced balanced, imbalanced, and super-bagging methods to recognize volleyball action.…”

A Novel Martingale Based Model Using a Smartphone to Detect Gait Bout in Human Activity Recognition

“…HAR monitoring using these sensors can characterize human movement (e.g., walking) given a set of observations. This process can be achieved by monitoring and analyzing walking information acquired from various sources such as the environment and sensors [18,19].…”

Human behaviour recognition with mid‐level representations for crowd understanding and analysis

“…Many previous action recognition frameworks directly match low-level features with action class labels [13][14][15][16], in which abundant visual spatiotemporal information can hardly be generalized by the raw low-level features. To overcome the aforementioned drawback, recent works show that attributes built upon the raw low-level features can act as higher semantic concepts and bridge the gap between low-level features and action class labels.…”