Analysis of User Requirements for a Mobile Augmented Reality Application to Support Literacy Development Amongst Hearing-Impaired Children

Abstract

Literacy is fundamental for children’s growth and development, as it impacts their educational, societal, and vocational progress. However, the mapping of language to printed text is different for children with hearing impairments. When reading, a hearing-impaired child maps text to sign language (SL) which is a visual language that can benefit from technological advancements, such as augmented reality (AR). There exist several efforts that utilise AR for the purpose of advancing the educational needs of people who are hearing impaired for different SLs. Nevertheless, only a few directly elicit the visual needs of children who are hearing impaired. This study aims to address this gap in the literature with a series of user studies to elicit user requirements for the development of an AR application that supports the literacy development of Arab children who are hearing impaired. Three instruments were utilised in these user studies, each targeting a different group of literacy influencers: questionnaires issued to parents of children with hearing impairments, interviews with teachers, and observations of children who were deaf or hard of hearing. The findings indicated that the parents and teachers preferred Arabic SL (ArSL), pictures, and videos, whereas the children struggled with ArSL and preferred finger-spelling. These preferences highlighted the importance of integrating various resources to strengthen the written Arabic and ArSL literacy of Arab children. The findings have contributed to the literature on the preferences of Arab children who are hearing impaired, their educators, and parents. They also showed the importance of establishing requirements elicited directly from intended users who are disabled to proactively support their learning process. The results of the study were used in the preliminary development of Word & Sign, an AR mobile application intended to aid Arab children who are hearing impaired in their linguistic development.

Requirements of Enjoyable Mobile Learning Applications for Deaf Children

“…These requirements are compiled for both desktop and mobile applications. An additional requirement was proposed by Al-Megren and Almutairi (2019); they found that captioning is given more importance since video and other audio-related files could be easily interpreted by deaf people (Al-Megren & Almutairi, 2019). Besides that, their findings also indicated that signed video would benefit deaf people for navigational purposes and provide an easily understandable user guideline.…”