Automatic Recognition of Construction Worker Activities Using Deep Learning Approaches and Wearable Inertial Sensors

Abstract

The automated evaluation and analysis of employee behavior in an Industry 4.0-compliant manufacturing firm are vital for the rapid and accurate diagnosis of work performance, particularly during the training of a new worker. Various techniques for identifying and detecting worker performance in industrial applications are based on computer vision techniques. Despite widespread computer vision-based approaches, it is challenging to develop technologies that assist the automated monitoring of worker actions at external working sites where camera deployment is problematic. Through the use of wearable inertial sensors, we propose a deep learning method for automatically recognizing the activities of construction workers. The suggested method incorporates a convolutional neural network, residual connection blocks, and multi-branch aggregate transformation modules for high-performance recognition of complicated activities such as construction worker tasks. The proposed approach has been evaluated using standard performance measures, such as precision, F1-score, and AUC, using a publicly available benchmark dataset known as VTT-ConIoT, which contains genuine construction work activities. In addition, standard deep learning models (CNNs, RNNs, and hybrid models) were developed in different empirical circumstances to compare them to the proposed model. With an average accuracy of 99.71% and an average F1-score of 99.71%, the experimental findings revealed that the suggested model could accurately recognize the actions of construction workers. Furthermore, we examined the impact of window size and sensor position on the identification efficiency of the proposed method.

Leveraging LDA Feature Extraction to Augment Human Activity Recognition Accuracy

“…The real-time human activity classification method in [47] showed better performance for CNN compared to SVM, BLSTM, LSTM, and MLP models on Pamap2 and UCI datasets. Another application of deep learning was automatic activity recognition based on wearable inertial sensors for the activities of construction workers using the ConIoT-VTT dataset, the results of the proposed WorkerNeXt model was the accuracy of 99.71% with F1score of 99.72% [48].…”