Hand Gesture Recognition via Lightweight VGG16 and Ensemble Classifier

Abstract

Gesture recognition has been studied for a while within the fields of computer vision and pattern recognition. A gesture can be defined as a meaningful physical movement of the fingers, hands, arms, or other parts of the body with the purpose to convey information for the environment interaction. For instance, hand gesture recognition (HGR) can be used to recognize sign language which is the primary means of communication by the deaf and mute. Vision-based HGR is critical in its application; however, there are challenges that will need to be overcome such as variations in the background, illuminations, hand orientation and size and similarities among gestures. The traditional machine learning approach has been widely used in vision-based HGR in recent years but the complexity of its processing has been a major challenge—especially on the handcrafted feature extraction. The effectiveness of the handcrafted feature extraction technique was not proven across various datasets in comparison to deep learning techniques. Therefore, a hybrid network architecture dubbed as Lightweight VGG16 and Random Forest (Lightweight VGG16-RF) is proposed for vision-based hand gesture recognition. The proposed model adopts feature extraction techniques via the convolutional neural network (CNN) while using the machine learning method to perform classification. Experiments were carried out on publicly available datasets such as American Sign Language (ASL), ASL Digits and NUS Hand Posture dataset. The experimental results demonstrate that the proposed model, a combination of lightweight VGG16 and random forest, outperforms other methods.

Predictive Artificial Intelligence Model for Detecting Dental Age Using Panoramic Radiograph Images

“…After the conventional layer, the max-pooling layer is used to reduce the amount of data that are sent to the next layer. Three fully connected layers are included in this architecture [22].…”

Secure Convolutional Neural Network-Based Internet-of-Healthcare Applications

“…IV-A). As our first contribution is to provide a comparison between model complexity and its effect on robustness against attacks, we use five well-known pre-trained networks, such as LeNet5 [65], MobileNetV1 [66], VGG16 [67], ResNet50 [68], and InceptionV3 [69]. The first represents the model with the lowest computational cost compared to the others.…”

HGR-ViT: Hand Gesture Recognition with Vision Transformer

“…In general, there are two categories of hand gesture recognition: static hand gesture recognition and dynamic hand gesture recognition. Static hand gesture recognition [ 1 , 2 , 3 , 4 , 5 , 6 , 7 , 8 ] involves interpreting hand gestures in a stationary position, resulting in higher accuracy due to less susceptibility to environmental factors. On the other hand, dynamic hand gesture recognition [ 9 , 10 , 11 , 12 , 13 ] recognises gestures with complex movements and temporal dynamics, which are more intuitive, natural, and versatile.…”