Mobile Application with Augmented Reality to Improve the Process of Learning Sign Language

Abstract

Language for a long time is an indispensable tool for society, since it allows communication and interaction between people. Learning sign language is a very big problem, either because access to information is scarce, there are no interpreters of this language or because learning of this language is not taught from an early age. This document shows the development of a mobile application with augmented reality following the mobile methodology and determining the influence it has on the Peruvian sign language learning process, with a sample of 30 students as a control group and an experimental group. It started with a performance percentage of 23 percent and using the mobile application significantly improved the performance of the sign language student by 65 percent.

Inclusive Education: Mobile App for Students with Hearing Impairment

“…Likewise, there is a study focused on the development of a digital orthographic system for sign language, seeking to benefit students with hearing disabilities, through the entry of a paragraph of text with the information required by the student with a disability and shown in sign language through a video, the authors' work [11], The result is uncertain as to the viability of the software's operation and has the scarcity of a previous analysis, in addition to having unattractive interfaces for the software's target audience.…”

An Educational Arabic Sign Language Mobile Application for Children with Hearing Impairment

“…In addition, the delay in exposing deafmute children to sign language at an early age will delay their learning skills and add more challenges to their education, communication, and blending with the community [36], [37]. Thus, it is crucial for those groups of learners to use different methods and assistive technologies to help them acquire the knowledge and skills as do their normal peers [5], [9], [30]. Technology helps to improve the knowledge and improve communication between learners and impaired hearing people [28], [29], [30].…”

“…Thus, it is crucial for those groups of learners to use different methods and assistive technologies to help them acquire the knowledge and skills as do their normal peers [5], [9], [30]. Technology helps to improve the knowledge and improve communication between learners and impaired hearing people [28], [29], [30]. Furthermore, to find a suitable learning method, particularly for those with hearing impairment, it is essential that education providers consider the language and vocabulary used during the learning process.…”

“…Various methodologies and applications have been proposed to develop and embed different technologies within the sign language learning process. The aim of these systems is to improve the interaction and learning between the deaf and other people through the daily practice of communication [5], [6], [10], [23], [30], [34]. Many projects have used PC-based or mobile-based applications to enhance communication between people with disabilities [27], [33] and in particular between deaf people and nondeaf people to improve the experience of learning sign languages [30].…”

“…The aim of these systems is to improve the interaction and learning between the deaf and other people through the daily practice of communication [5], [6], [10], [23], [30], [34]. Many projects have used PC-based or mobile-based applications to enhance communication between people with disabilities [27], [33] and in particular between deaf people and nondeaf people to improve the experience of learning sign languages [30]. Using smart mobile devices in learning is widely adopted among learners of different ages [32].…”