Development of speech recognition system in native language for hearing impaired

Abstract

This paper presents the performance of the speech recognition system with reference to children with normal hearing and children with hearing impairment. Though the nasal and oral cavities of the hearing impaired are perfect, they cannot produce sounds since they cannot hear anything. The reason is that the ability to understand language and speech production is coordinated by the brain. So a person with a problem in the ear or damage in brain activities due to an accident, stroke or birth defect may have problems in producing speech. They are classified as profoundly deaf and hard of hearing, based on the degree of hearing ability. Early detection of deafness would enable the hearing impaired to produce sounds by speech therapy. If deafness is detected at a later stage, it is difficult to make the speech of the hearing impaired understandable. So, it is necessary to develop the system for recognizing their speeches, especially in the native language. In this paper, a system is developed for Tamil language by using, Melfrequency cepstral coefficient feature extraction at the front end and Hidden Markov Model tool kit at the back end. System is evaluated and the comparison is done between the speeches of normal speakers and the hearing impaired. Recognition accuracy is 92.4% for hearing impaired speeches and 98.4% for normal speeches. Though it is difficult for the unfamiliar listeners to understand the hearing impaired speeches, this system can be utilized for recognizing the speeches of Hearing impaired by others.Keywords: Deaf or hearing impaired (HI); hidden markov model tool kit (HTK); melfrequency cepstral coefficients (MFCC); perceptual linear prediction (PLP); sub harmonic-toharmonic ratio (SHR).

Real-Time Detection of Important Sounds with a Wearable Vibration Based Device for Hearing-Impaired People

“…Jeyalakshmi et al [20] offered a speech recognition system for normal hearing and hearingimpaired children. This system was developed using MFCC feature extraction and HMM.…”

Efficient speech recognition system for hearing impaired children in classical Tamil language

“…Deaf children are trained to speak in their native language, because they cannot follow the different facial expressions and throat vibrations. Like a speech therapist, tactile method is used to record the speeches of the hearing impaired (Jeyalakshmi et al, 2014). Hard of hearing children would prefer school for normal hearing children, since their impairment is not severe.…”

Fast and Accurate Recognition for Codes on Complex Backgrounds for Real-Life Industrial Applications

“…In the past several decades, Deep learning, a hot spot in the field of computer vision, has achieved significant successes in speech recognition (Jeyalakshmi et al, 2014), detectionn , and segmentation (Tang et al 2019, Tang et al 2021. Specifically, inkjet printing process has been primarily used to spray characters such as the date of manufacture and the shelf life on the surface of food packaging.…”