Eye Tracking as a form of Alternate and Augmentative Communication for people with Speech, Language and Communication Needs

S, Adithyan; Dhyaneshwar, G; Shivani, S; Karthik, Varshini; Devaraj, Ashokkumar

doi:10.1109/icssit48917.2020.9214189

Cited by 1 publication

(1 citation statement)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The research work [35] evaluates the impact of automated driving on visual risk perception by analysing gaze pattern dispersion during manual and automated driving tasks. The eye tracking based system for AAC proposed in [36] uses a camera to track the eye movement. However, the work is very primitive with evaluation for tracking the eyes but not any useful communication.…”

Section: Related Workmentioning

confidence: 99%

Netravaad: Interactive Eye Based Communication System for People With Speech Issues

Kannan Megalingam,

Kuttankulangara Manoharan,

Riju

et al. 2024

IEEE Access

View full text Add to dashboard Cite

People who have speech disability due to apahsia caused by stroke, head injury or brain tumor, amyotrophic lateral sclerosis, cerebral palsy, locked-in syndrome or other motor impairments can use augmentative and alternative communication (AAC) for expressing their mind. Communication based on eye movements is very common for these people. Current systems based on eye gestures or eye tracking are very expensive, require re-calibration very often, slower in operation and might need a human interpreter in many cases. To overcome these limitations, we propose Netravaad, a communication system for people with speech disability to use their eyes to create signs and speak through eyes. Through the eye sign language Netravaani, the user can speak English language using eye signs. These eye signs are captured by a low-cost USB camera which are converted to a word, a phrase, a complete sentence, or even multiple sentences using the Sarani algorithm. The text thus created is displayed on the screen and converted to speech to play the audio via speaker making this interactive multi-modal interface for the benefit of the users. Predictive text feature is implemented to reduce the effort of the users in creating signs for all characters in a word. In addition, the need for human interpreters can be eliminated. Thus, the user can communicate to the caretaker, physician or relative through eyes with a feeling that is same as speaking via mouth. The tests conducted with volunteers from different age groups suggest that, on average, the system achieves an accuracy of 91%, 100%, and 93% in detecting alphabets, words, and numbers, respectively, among individuals aged 26 to 35 years. These findings underscore the robustness of the system, indicating its potential to provide significant benefits to the community of individuals with speech disabilities.

show abstract

Section: Related Workmentioning

confidence: 99%