Sign Language Recognition with Quaternion Moment Invariants: A Comparative Study

In recent years, convolutional neural networks have significantly advanced the field of computer vision by automatically extracting features from image data. CNNs enable the modeling of complex and abstract image features using learnable filters, eliminating the need for manual feature extraction. However, combining feature maps obtained from CNNs with different approaches can lead to more complex and interpretable inferences, thereby enhancing model performance and generalizability. In this study, we propose a new method called RGB angle rotation to effectively obtain feature maps from RGB images. Our method rotates color channels at different angles and uses the angle information between channels to generate new feature maps. We then investigate the effects of integrating models trained with these feature maps into an ensemble architecture. Experimental results on the CIFAR-10 dataset show that using the proposed method in the ensemble model results in performance increases of 9.10 and 8.42% for the B and R channels, respectively, compared to the original model, while the effect of the G channel is very limited. For the CIFAR-100 dataset, the proposed method resulted in a 17.09% improvement in ensemble model performance for the R channel, a 5.06% increase for the B channel, and no significant improvement for the G channel compared to the original model. Additionally, we compared our method with traditional feature extraction methods like scale-invariant feature transform and local binary pattern and observed higher performance. In conclusion, it has been observed that the proposed RGB angle rotation method significantly impacts model performance.

show abstract

RGB-D feature extraction method for hand gesture recognition based on a new fast and accurate multi-channel cartesian Jacobi moment invariants

Ouariachi

Benouini

Zenkouar

et al. 2022

Multimed Tools Appl

View full text Add to dashboard Cite

Sign Language Recognition with Quaternion Moment Invariants: A Comparative Study

Cited by 5 publications

References 18 publications

A Word-Based Moroccan Sign Language Dataset for Emergency Situations: Use Case COVID-19

A Word-Based Moroccan Sign Language Dataset for Emergency Situations: Use Case COVID-19

Enhancing CNN model classification performance through RGB angle rotation method

RGB-D feature extraction method for hand gesture recognition based on a new fast and accurate multi-channel cartesian Jacobi moment invariants

Contact Info

Product

Resources

About