Histogram of Oriented Gradient-Based Fusion of Features for Human Action Recognition in Action Video Sequences

Abstract

Human Action Recognition (HAR) is the classification of an action performed by a human. The goal of this study was to recognize human actions in action video sequences. We present a novel feature descriptor for HAR that involves multiple features and combining them using fusion technique. The major focus of the feature descriptor is to exploits the action dissimilarities. The key contribution of the proposed approach is to built robust features descriptor that can work for underlying video sequences and various classification models. To achieve the objective of the proposed work, HAR has been performed in the following manner. First, moving object detection and segmentation are performed from the background. The features are calculated using the histogram of oriented gradient (HOG) from a segmented moving object. To reduce the feature descriptor size, we take an averaging of the HOG features across non-overlapping video frames. For the frequency domain information we have calculated regional features from the Fourier hog. Moreover, we have also included the velocity and displacement of moving object. Finally, we use fusion technique to combine these features in the proposed work. After a feature descriptor is prepared, it is provided to the classifier. Here, we have used well-known classifiers such as artificial neural networks (ANNs), support vector machine (SVM), multiple kernel learning (MKL), Meta-cognitive Neural Network (McNN), and the late fusion methods. The main objective of the proposed approach is to prepare a robust feature descriptor and to show the diversity of our feature descriptor. Though we are using five different classifiers, our feature descriptor performs relatively well across the various classifiers. The proposed approach is performed and compared with the state-of-the-art methods for action recognition on two publicly available benchmark datasets (KTH and Weizmann) and for cross-validation on the UCF11 dataset, HMDB51 dataset, and UCF101 dataset. Results of the control experiments, such as a change in the SVM classifier and the effects of the second hidden layer in ANN, are also reported. The results demonstrate that the proposed method performs reasonably compared with the majority of existing state-of-the-art methods, including the convolutional neural network-based feature extractors.

The Impact of Leadership Styles on Employees Productivity in Organizations: A Comparative Study Among Leadership Styles

“…Therefore, all should be interpreted as referring to tasks and individuals even if many words have been used to describe such two-leadership reality [41]. Leaders' actions may be evaluated by evaluating what leaders do in the success of the mission and by retaining people's efforts [42]. Job-centered and staff-centred leadership Scholars have established two distinct management types, job-centred and employee-centred, by interviewing leading figures and followers [43].…”

Harvesting social media sentiment analysis to enhance stock market prediction using deep learning

“…The performance of the SA is fed to stock-market prediction to any machine learning models. Patel et al (2015Patel et al ( , 2020 discusses the application of forecasting stock and share price index movements in an Indian equity market using a machine learning framework. They used four forecasting models to analyze the data: (1) ANN, (2) SVM, (3) Random Forest and (4) Naïve Bayes.…”

A Low-Cost Assistive Robot for Children with Neurodevelopmental Disorders to Aid in Daily Living Activities

“…Traditionally, the task of action detection in videos has been addressed mainly from an offline perspective, e.g., [ 42 , 43 , 44 , 45 , 46 , 47 , 48 , 49 , 50 , 51 ]. These offline models basically assume that they dispose of the entire video in which the action takes place in order to perform the action detection.…”