Multilayer architecture in sign language recognition system

Abstract

Up to now analytical or statistical methods have been used in sign language recognition with large vocabulary. Analytical methods such as Dynamic Time Wrapping (DTW) or Euclidian distance have been used for isolated word recognition, but the performance is not satisfactory enough because it is easily interfered by noise. Statistical methods, especially hidden Markov Models are commonly used, for both continuous sign language and isolated words and with the expansion of vocabulary the processing time becomes increasingly unacceptable. Therefore, a multilayer architecture of sign language recognition for large vocabulary is proposed in this paper for the purpose of speeding up the recognition process. In this method the gesture sequence to be recognized is first located at a set of words that are easy to be confused (confusion set) through a global cursory search and then the gesture is recognized through a latter local search and the generation of confusion set is realized by DTW/ISODATA algorithm.

Real Time Large Vocabulary Continuous Sign Language Recognition Based on OP/Viterbi Algorithm

“…Our previous work [2], formed by the multilayer architecture of sign language recognition based on DTW/HMM, is about isolated words. At present, the continuous sign language recognition is mainly based on the statistical approach, which uses the method of Viterbi-Beam searching of HMM.…”