Machine Vision-Based Human Action Recognition Using Spatio-Temporal Motion Features (STMF) with Difference Intensity Distance Group Pattern (DIDGP)

Abstract

In recent years, human action recognition is modeled as a spatial-temporal video volume. Such aspects have recently expanded greatly due to their explosively evolving real-world uses, such as visual surveillance, autonomous driving, and entertainment. Specifically, the spatio-temporal interest points (STIPs) approach has been widely and efficiently used in action representation for recognition. In this work, a novel approach based on the STIPs is proposed for action descriptors i.e., Two Dimensional-Difference Intensity Distance Group Pattern (2D-DIDGP) and Three Dimensional-Difference Intensity Distance Group Pattern (3D-DIDGP) for representing and recognizing the human actions in video sequences. Initially, this approach captures the local motion in a video that is invariant to size and shape changes. This approach extends further to build unique and discriminative feature description methods to enhance the action recognition rate. The transformation methods, such as DCT (Discrete cosine transform), DWT (Discrete wavelet transforms), and hybrid DWT+DCT, are utilized. The proposed approach is validated on the UT-Interaction dataset that has been extensively studied by past researchers. Then, the classification methods, such as Support Vector Machines (SVM) and Random Forest (RF) classifiers, are exploited. From the observed results, it is perceived that the proposed descriptors especially the DIDGP based descriptor yield promising results on action recognition. Notably, the 3D-DIDGP outperforms the state-of-the-art algorithm predominantly.

Sugarcane stem node identification algorithm based on improved YOLOv5

“…Existing sugarcane stem node identification methods are mainly divided into traditional machine vision and deep learning methods. Traditional machine learning algorithms have matured significantly and found extensive application [3][4][5]. In the study of sugarcane stem nodes, conventional machine learning methods primarily employ features such as texture, grayscale, color, and edges of the sugarcane for identification.…”

An Elliptical Modeling Supported System for Human Action Deep Recognition Over Aerial Surveillance

“…This section presents HAR systems based on machine learning approaches (supervised, unsupervised, and semisupervised). In [28], a unique approach focusing on Spatio-Temporal Interest Points (STIPs) was proposed for representing and recognizing human actions in video streams. For the representation of human actions, they used 2D and 3D Difference Intensity Distance Group Pattern (2D/3D-DIDGP) and employed a Support Vector Machine (SVM) for the classification.…”

Stochastic Growth Models for the Spreading of Fake News

“…where S(t 0 ) = x 0 and Ξ(s, t) are defined in Equation (27). Some examples of the threshold (33) and the density g(S(t), t|x 0 , t 0 ) given in (34) are plotted in Figure 15.…”

“…Hence, identifying and extracting the most appropriate and significant features from information flows is one of the biggest challenges for AI-based detection. In this area, examples of recent contributions related to feature extraction and anomaly detection can be found in Khan et al [32] and Arunnehru et al [33].…”