Two decades of assistive technologies to empower people with disability: a systematic mapping study

Enríquez, J. G.; Soria Morillo, Luis M.; García-García, J. A.; Álvarez-García, Juan A.

doi:10.1080/17483107.2023.2263504

Cited by 1 publication

(1 citation statement)

References 99 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Additionally, we explored the feasibility of running inference tasks on edge computing nodes, specifically single board computers. This investigation contributes insights toward the development of a local Voice User Interface (VUI) tailored for disordered speech, which is an area of high demand in assistive technology [10].…”

Section: Introductionmentioning

confidence: 99%

A Voice User Interface on the Edge for People with Speech Impairments

Mulfari,

Villari

2024

Electronics

View full text Add to dashboard Cite

Nowadays, fine-tuning has emerged as a powerful technique in machine learning, enabling models to adapt to a specific domain by leveraging pre-trained knowledge. One such application domain is automatic speech recognition (ASR), where fine-tuning plays a crucial role in addressing data scarcity, especially for languages with limited resources. In this study, we applied fine-tuning in the context of atypical speech recognition, focusing on Italian speakers with speech impairments, e.g., dysarthria. Our objective was to build a speaker-dependent voice user interface (VUI) tailored to their unique needs. To achieve this, we harnessed a pre-trained OpenAI’s Whisper model, which has been exposed to vast amounts of general speech data. However, to adapt it specifically for disordered speech, we fine-tuned it using our private corpus including 65 K voice recordings contributed by 208 speech-impaired individuals globally. We exploited three variants of the Whisper model (small, base, tiny), and by evaluating their relative performance, we aimed to identify the most accurate configuration for handling disordered speech patterns. Furthermore, our study dealt with the local deployment of the trained models on edge computing nodes, with the aim to realize custom VUIs for persons with impaired speech.

show abstract

Section: Introductionmentioning

confidence: 99%