Augmented reality based mobile application for real-time Arabic language translation

Abstract

Augmented Reality (AR) technologies are nowadays widely and ubiquitously used to enhance our real world experience in novel and enriched ways. With the new generation of smart phones and AR technologies, we are embracing a stimulating way of Human-Computer Interaction. Many AR mobile applications were developed in many fields such as education, health, design and Translation... This paper deals with text translation. Many applications are proposed on the market but they are yet limited to a few number of languages. Arabic language is one of these unsupported ones. To overcome this shortage, an AR mobile application for real time Arabic text translation is developed. The user simply hover the device's camera on the desired text and it will be translated automatically and rapidly. This type of application consists of three main components which are: text detection, text extraction and text translation. To ensure the application is performing well, the application is tested on different datasets under different conditions. We showed that the translation took least time in all datasets. However, the recognition took more time; it is due that the job is done on the cloud over the internet. In addition, a user study test is conducted to test the usability and user satisfaction.

Effect of using mobile translation applications for translating collocations

“…The recent versions of these applications incorporate new advanced technologies, e.g. augmented reality (Ouertani and Tatwany, 2019;Pu et al, 2017;Saudagar and Mohammad, 2018;Wolk, 2020), artificial intelligence and machine learning (Tomasello, 2019;van der Meer, 2020), to enhance their accuracy and functionality. Despite their popularity, mobile translation applications have been criticized for their limited capabilities and security concerns (Schwartz, 2013).…”

“…The recent versions of these applications incorporate new advanced technologies, e.g. augmented reality (Ouertani and Tatwany, 2019; Pu et al. , 2017; Saudagar and Mohammad, 2018; Wolk, 2020), artificial intelligence and machine learning (Tomasello, 2019; van der Meer, 2020), to enhance their accuracy and functionality.…”