Conversion of Malayalam text to Indian sign language using synthetic animation

Nair, Malu S; A, NimithA; Idicula, Sumam Mary

doi:10.1109/icngis.2016.7854002

Cited by 35 publications

(3 citation statements)

References 2 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Moreover, validation conducted using two publicly available datasets affirms the superior performance of the developed model compared to other comparative research endeavors. Prof. Sonia Waghmare, Praveen Rathod, Ved Satdeve, Rohit Gaware, Ritesh Khapare [3] stated that Individuals are primarily dependent on visual and auditory cues to communicate back and forth. This interaction is a two-way interaction, which means that the speaker and the listener must both take part in the conversation.…”

Section: Literature Surveymentioning

confidence: 99%

Sustainable Hand Gesture Recognition for Speech Conversion, Empowering the Speech-Impaired

Ledalla,

Reddy,

Nagendra Kumar

et al. 2023

E3S Web Conf.

View full text Add to dashboard Cite

A sustainable language disorder affects an individual’s ability to reach out to others through speaking and listening. So utilizing sustainable hand gestures is among the most widespread means of non-verbal and visual communication used by people with speech disabilities worldwide. However, even though sustainable sign language is used everywhere by speech-impaired and hearing-impaired people, most of the populace who don't have any knowledge about sign language face difficulties in sustainably communicating with them. This sustainable problem requires better solutions that can successfully support communication for people with speech disabilities. This sustainable approach will reduce the communication gap for the speech-impaired population. There are many sustainable solutions in the market such as using sensors to make a sustainable device that gives a helpful output. But these sustainable solutions are expensive and not everyone can afford them. We are employing Convolutional Neural Networks to create a sustainable model that is trained on different gestures. This sustainable model enables speech-impaired individuals to convey their information using signs which get converted to human-understandable language, and sustainable voice is given as output. The sustainable hand gestures made are captured as a series of sustainable images which are processed using Python code. This sustainable endeavor introduces a solution that not only automates the identification of sustainable hand gestures but also transforms them into sustainable speech. By interpreting these recognized sustainable gestures, the corresponding recorded audio will be played sustainably. The focus of this sustainable paper is to offer accessibility, convenience, and safety to individuals with speech impairments in a sustainable manner. These sustainable individuals often experience societal discrimination solely due to their disabilities. This sustainable paper is aimed at innovating a sustainable device to help those without the knowledge of sign language sustainably communicate with the people who face difficulty in speech.

show abstract

Section: Literature Surveymentioning

confidence: 99%

Sustainable Hand Gesture Recognition for Speech Conversion, Empowering the Speech-Impaired

Ledalla,

Reddy,

Nagendra Kumar

et al. 2023

E3S Web Conf.

View full text Add to dashboard Cite

show abstract

“…An android app-based translation system has been designed to convert sign movements from hand gestures of ISL [18]. In [19], the authors designed a Malayalam text to ISL translation system using a synthetic animation approach. Their model has been used to promote sign language education among the common people of Kerala, India.…”

Section: Sign Language Translation Systemsmentioning

confidence: 99%

3D Avatar Approach for Continuous Sign Movement Using Speech/Text

et al. 2021

View full text Add to dashboard Cite

Sign language is a visual language for communication used by hearing-impaired people with the help of hand and finger movements. Indian Sign Language (ISL) is a well-developed and standard way of communication for hearing-impaired people living in India. However, other people who use spoken language always face difficulty while communicating with a hearing-impaired person due to lack of sign language knowledge. In this study, we have developed a 3D avatar-based sign language learning system that converts the input speech/text into corresponding sign movements for ISL. The system consists of three modules. Initially, the input speech is converted into an English sentence. Then, that English sentence is converted into the corresponding ISL sentence using the Natural Language Processing (NLP) technique. Finally, the motion of the 3D avatar is defined based on the ISL sentence. The translation module achieves a 10.50 SER (Sign Error Rate) score.

show abstract

“…softwares tradutores da língua oral para língua de sinais, com uso de avatares, também é explorado no contexto internacional. Traduc ¸ões da língua oral para língua de sinais árabe, indiana e turca são apresentadas em [El-Gayyar et al 2016], [Nair et al 2016] e [Eryigit et al 2016], respectivamente. Característica comum a todos esses trabalhos é a constatac ¸ão de que esses softwares ainda estão em seus estágios iniciais e que testes envolvendo usuários da comunidade surda são essenciais e precisam ser mais bem explorados.…”

Section: A Estrutura Da Librasunclassified

Análise de tradução automática português-Libras no contexto do edital do Enem 2018

Bedana

Freitas

Peres

et al. 2019

Anais Do XXX Simpósio Brasileiro De Informática Na Educação (SBIE 2019)

View full text Add to dashboard Cite

In this paper, automatic Portuguese-Libras translations are analyzed in the educational context of deaf people. The speeches in Libras, obtained in the translation functions, are uttered by an avatar. The communication promoted by the avatars is contrasted with translations offered by human interpreters and analyzed in relation to the use of Signed Portuguese and fingerspelling, and to the contextualization and correctness of the information being transmitted. The analysis revealed that the translation technology available for such communication modality still does not present maturity for using in critical contexts in which mistranslations can lead to losses for users, as it is the case in the official guidelines referring to the Brazilian National High School Examination.Resumo. Neste artigo, traduc ¸ões português-Libras são analisadas no contexto educacional da pessoa surda. Os discursos em Libras obtidos na traduc ¸ão automática são apresentados via avatares. A comunicac ¸ão promovida pelos avatares é contrastada com traduc ¸ões oferecidas por intérpretes humanos, e analisada em relac ¸ão ao uso de datilologia e português sinalizado, e à contextualizac ¸ão e corretude da informac ¸ão transmitida. A análise revelou que a tecnologia de traduc ¸ão disponível para tal modalidade de comunicac ¸ão não possui maturidade para uso em contextos críticos nos quais um equívoco de traduc ¸ão possa levar a perdas para usuários, como é o caso nas orientac ¸ões oficiais referentes ao Exame Nacional do Ensino Médio.

show abstract

Conversion of Malayalam text to Indian sign language using synthetic animation

Cited by 35 publications

References 2 publications

Sustainable Hand Gesture Recognition for Speech Conversion, Empowering the Speech-Impaired

Sustainable Hand Gesture Recognition for Speech Conversion, Empowering the Speech-Impaired

3D Avatar Approach for Continuous Sign Movement Using Speech/Text

Análise de tradução automática português-Libras no contexto do edital do Enem 2018

Contact Info

Product

Resources

About