Developing a Prototype to Translate Text and Speech to Pakistan Sign Language With Bilingual Subtitles: A Framework

Abstract

The purpose of the study is to provide a literature review of the work done on sign language (SL) around the world and in Pakistan and to develop a translation tool of speech and text to Pakistan Sign Language (PSL) with bilingual subtitles. Information and communication technology and tools development for teaching and learning purposes improve the learning process and facilitate both teachers and students. In Pakistan, unimpaired people face a lot of problems to communicate with deaf people due to the lack of SL understanding, learning resources, and interpreters. This problem is faced by the teachers who communicate with deaf students in the classrooms. The communication gap is filled with the development of a translation tool as Haseeb and Illyas concluded in their study that using this kind of tool, deaf people will have more opportunities to communicate with other members of society at every level. Different components of technology such as Python programming language, Natural Language Tool Kit, prerecorded PSL videos, Linux-based server, and databases are used to develop the prototype of PSL translation tool. This study provides a literature review to highlight the existing technological work done around the world and in Pakistan and also provides an architectural framework of the PSL translation tool which is developed by the researchers to facilitate the people who face difficulty to communicate with deaf people.

Developing a Prototype to Translate Pakistan Sign Language into Text and Speech While Using Convolutional Neural Networking

“…Supreme urbanized nations have addressed the problems in their listening to-impaired people by throwing schemes related to information technology for minimizing the gap among the deaf and ordinary people (Abbas & Sarfraz, 2018). Pakistan communication via gestures is a phonetically underneath researched in the nonappearance of any organized data around the language substance, syntax, and devices and administrations for discussion.…”

“…They interact, communicate and share their ideas using language. Language is described as the process of human communication, both the spoken and written languages including the use of words in a structured and manner (Abbas& Sarfraz, 2018).…”

“…There are 72 million deaf people in the world. They want to interact with other people through a language (Abbas & Sarfraz 2018).…”

“…In the field of deep learning with recent advances, neural networks can have far-reaching applications and implications for sign language interpretation as (Radpour, 2017) present a method to classify images of both the letters and digits in American sign language using deep convolutional networks and Abbas & Sarfraz (2018) have highlighted the similar gap and developed a prototype to convert texts and speech into Pakistani sign language in order to facilitate the communication between the deaf and the unimpaired people.…”

A Comparative Study of the Effect of Bilingual Subtitles and English Subtitles on College English Teaching

“…Accepting theory, also known as accepting aesthetics. As a theory of literary criticism, it is an important faction in Western contemporary literature theory (Abbas, & Sarfraz, 2018). In the late 1960s and early 1970s, the Constance School of the Federal Republic of Germany, represented by Hans Robert Kauss and Wolfgan Iser, was founded.…”