Turkish sign language recognition application using Motion History Image

Yalcinkaya, Ozge; Atvar, Anil; Duygulu, Pınar

doi:10.1109/siu.2016.7495861

Cited by 3 publications

(1 citation statement)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…For 22 onehanded and 28 two-handed expressions, the accuracy rate was found to be 95.7 %. Yalcınkaya et al [11] used the Motion History Images method for representing the expressions on the training data that comprised 8 different sign language videos. They performed the classification process at 95 % accuracy rate with k-NN.…”

Section: Related Studiesmentioning

confidence: 99%

Real-Time Turkish Sign Language Recognition Using Cascade Voting Approach with Handcrafted Features

Karacı

Akyol

Turut

2021

Applied Computer Systems

View full text Add to dashboard Cite

In this study, a machine learning-based system, which recognises the Turkish sign language person-independent in real-time, was developed. A leap motion sensor was used to obtain raw data from individuals. Then, handcraft features were extracted by using Euclidean distance on the raw data. Handcraft features include finger-to-finger, finger -to-palm, finger -to-wrist bone, palm-to-palm and wrist-to-wrist distances. LR, k-NN, RF, DNN, ANN single classifiers were trained using the handcraft features. Cascade voting approach was applied with two-step voting. The first voting was applied for each classifier’s final prediction. Then, the second voting, which voted the prediction of all classifiers at the final decision stage, was applied to improve the performance of the proposed system. The proposed system was tested in real-time by an individual whose hand data were not involved in the training dataset. According to the results, the proposed system presents 100 % value of accuracy in the classification of one hand letters. Besides, the recognition accuracy ratio of the system is 100 % on the two hands letters, except “J” and “H” letters. The recognition accuracy rates were 80 % and 90 %, respectively for “J” and “H” letters. Overall, the cascade voting approach presented a high average classification performance with 98.97 % value of accuracy. The proposed system enables Turkish sign language recognition with high accuracy rates in real time.

show abstract

Section: Related Studiesmentioning

confidence: 99%