Human Action Recognition: A Paradigm of Best Deep Learning Features Selection and Serial Based Extended Fusion

Abstract

Human action recognition (HAR) has gained significant attention recently as it can be adopted for a smart surveillance system in Multimedia. However, HAR is a challenging task because of the variety of human actions in daily life. Various solutions based on computer vision (CV) have been proposed in the literature which did not prove to be successful due to large video sequences which need to be processed in surveillance systems. The problem exacerbates in the presence of multi-view cameras. Recently, the development of deep learning (DL)-based systems has shown significant success for HAR even for multi-view camera systems. In this research work, a DL-based design is proposed for HAR. The proposed design consists of multiple steps including feature mapping, feature fusion and feature selection. For the initial feature mapping step, two pre-trained models are considered, such as DenseNet201 and InceptionV3. Later, the extracted deep features are fused using the Serial based Extended (SbE) approach. Later on, the best features are selected using Kurtosis-controlled Weighted KNN. The selected features are classified using several supervised learning algorithms. To show the efficacy of the proposed design, we used several datasets, such as KTH, IXMAS, WVU, and Hollywood. Experimental results showed that the proposed design achieved accuracies of 99.3%, 97.4%, 99.8%, and 99.9%, respectively, on these datasets. Furthermore, the feature selection step performed better in terms of computational time compared with the state-of-the-art.

A Review of Deep Learning Methods for Compressed Sensing Image Reconstruction and Its Medical Applications

“…However, they have not been studied deeply. In addition, compressed sensing, or inverse problem also exists in the area of surveillance [205], medical [206], agriculture [207], speech [208] and telecommunications. Our proposed framework may be helpful to inspire researchers to improve their works.…”

Tracking of a Fixed-Shape Moving Object Based on the Gradient Descent Method

“…The proposed algorithm has a significant scope to improve in the future, as the gradient descent algorithm can be further improved and its ensemble with particle swarm optimization can yield even better convergence results for object and human recognition [ 49 , 50 , 51 ]. Moreover, the deep learning based shall be more useful for the recognition task [ 52 , 53 , 54 , 55 , 56 , 57 , 58 , 59 ].…”

Mango Leaf Disease Recognition and Classification Using Novel Segmentation and Vein Pattern Technique

“…The overall performance of the proposed method is much improved compared to already available methods. However, the following improvements will be considered in the future: (1) increase the number of images in the dataset, (2) minimize the identification time through feature optimization algorithms [39][40][41] to implement it in real time, and (3) implement some latest deep learning models [42][43][44][45].…”