An Recognition–Verification Mechanism for Real-Time Chinese Sign Language Recognition Based on Multi-Information Fusion

Abstract

For online sign language recognition (SLR) based on inertial measurement unit (IMU) and a surface electromyography (sEMG) sensor, achieving high-accuracy is a major challenge. The traditional method for that is the segmentation–recognition mechanism, which has two key challenges: (1) it is difficult to design a highly robust segmentation method for online data with inconspicuous segmentation information; and (2) the diversity of input data will increase the burden of the classification. The recognition–verification mechanism was proposed to improve the performance of online SLR. In the recognition stage, we used sliding windows to pull the data, and applied a convolutional neural network (CNN) to classify the sign language signal. In the verification stage, the confidence was evaluated by the Siamese network to judge the correctness of the classification results. The accuracy and rapidity of the classification model were discussed for 86 categories of Chinese sign language. In the experiments for online SLR, the superiority of the recognition–verification mechanism compared to the segmentation–recognition mechanism was verified.

Analysis of the interaction between A1R and A2AR proteins in living cells based on FRET imaging and batch processing method

“…These results indicated that the method of combing FRET imaging with batch processing was time-saving, simply and efficient to perform without the need for expertise, and saved the time and became more pronounced as the number of counted cells increased. It was worth mentioning that the batch processing could speed up the operation [29]. Our results also confirmed it.…”

Design of Watercolor Cultural and Creative Products Based on Style Transfer Algorithm

“…e convolution operation is included in the activation function, as shown in formula (7) [21], to reduce the amount of computation of the network and avoid the over-fitting phenomenon.…”

American Sign Language Recognition and Translation Using Perception Neuron Wearable Inertial Motion Capture System

“…The Myo armband is a lightweight off-the-shelf wearable device providing nine inertial and eight-channel EMG signals. Many studies on sign language word and gesture recognition have used this device considering the portability of the armband [ 9 , 10 , 11 , 12 , 13 ]. Savur & Sahin [ 14 ] classified the gestures of 26 English alphabet letters with Myo armband.…”