Development of a New Sign Language Translation System for People with Autism Spectrum Disorder

Pezzuoli, Francesco; Tafaro, Donatella; Pane, Marika; Corona, Dario; Corradini, Maria Letizia

doi:10.1007/s41252-020-00175-6

Cited by 8 publications

(8 citation statements)

References 34 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Moreover, according to our findings, manual signs are strictly connected to imitation skills and imitation and language processing are closely connected. In addition, it is now established that Broca’s area, previously considered a speech production area, contains neurons activated by execution/observation/imitation [ 19 , 20 ].…”

Section: Discussionmentioning

confidence: 99%

“…Compared to other forms of AAC, signs are distinguished by their practicality since, while other methods require the use of devices or the retrieval of images or symbols, the hands are always available [ 19 , 20 ]. So, if the child shows interest in a new object, game or activity, the corresponding sign can be shown immediately.…”

Section: Discussionmentioning

confidence: 99%

“…It is possible to identify two different approaches. Some specialists argue the importance of introducing manual signs since the grammatical characteristics of manual signs seem to facilitate understanding [ 19 ]; on the other hand, there are those who consider it more appropriate to use AAC, as it requires the development of specific skills, which are often absent or reduced in children with communication difficulties. In any case, it is preferred to carefully analyze the individual characteristics of autistic subjects (cognitive, motor, imitative, discriminatory abilities).…”

Section: Discussionmentioning

confidence: 99%

See 2 more Smart Citations

AAC and Autism: Manual Signs and Pecs, a Comparison

Frolli

Ciotola²,

Esposito³

et al. 2022

Behavioral Sciences

View full text Add to dashboard Cite

Autism Spectrum Disorders (ASD) represent a heterogeneous group of disorders, with onset in developmental age, which present a clinical expressiveness that varies from subject to subject and in the same subject over time. The DSM 5 defines Autism Spectrum Disorders according to two main criteria: persistent deficits in social communication and social interaction in multiple contexts and limited and repetitive patterns of behavior, interests or activities. This disorder can manifest itself across a broad spectrum of severity levels. Indeed, ASD includes clinical conditions from low functioning (LF—Low Functioning) to high functioning (HF—High Functioning), taking cognitive and adaptive functioning as a reference. One of the main characteristics of individuals with ASD is a delay in receptive and expressive communication. These deficits have led to the identification of evidence-based practices, particularly for those with severe communication difficulties. Augmentative Alternative Communication (AAC) has been implemented to compensate for deficits in functional communication and language skills in individuals with complex communication deficits. The AAC comprises communication systems including the Manual Signs, speech and image output devices (Communicators), and Image Exchange Systems (PECS); these systems have been shown to actually improve various abilities in autism such as social skills, modify and improve dysfunctional behaviors and, above all, improve learning. Recent meta-analyses have shown how PECS and Manual Sign can have great effects on the communication skills of young people with autism. The aim of this study is to compare these two types of intervention to improve communication in terms of vocalization in subjects with ASD and try to understand which of the two lead to more significant and rapid improvements.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Discussionmentioning

confidence: 99%

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

AAC and Autism: Manual Signs and Pecs, a Comparison

Frolli

Ciotola²,

Esposito³

et al. 2022

Behavioral Sciences

View full text Add to dashboard Cite

show abstract

“…However, these systems have limitations, such as difficulties in recording hand and finger movements and an inability to capture facial expressions, lip movements, and eye movements. Moreover, the accuracy of the data collected by the data glove may be impacted by the external environment [16].…”

Section: Data Glovesmentioning

confidence: 99%

“…Furthermore, sign languages have unique grammar structures that must be taken into account in the translation process [16]. The translation of sign language into spoken language is limited by the collection of gesture data.…”

Section: Real-time Translation Approachesmentioning

confidence: 99%

A Survey of Advancements in Real-Time Sign Language Translators: Integration with IoT Technology

2023

View full text Add to dashboard Cite

Real-time sign language translation systems are of paramount importance in enabling communication for deaf and hard-of-hearing individuals. This population relies on various communication methods, including sign languages and visual techniques, to interact with others. While assistive technologies, such as hearing aids and captioning, have improved their communication capabilities, a significant communication gap still exists between sign language users and non-users. In order to bridge this gap, numerous sign language translation systems have been developed, encompassing sign language recognition and gesture-based controls. Our research aimed to analyze the advancements in real-time sign language translators developed over the past five years and their integration with IoT technology. By closely examining these technologies, we aimed to attain a deeper comprehension of their practical applications and evolution in the domain of sign language translation. We analyzed the current literature, technical reports, and conference papers on real-time sign language translation systems. Our results offer insights into the current state of the art in real-time sign language translation systems and their integration with IoT technology. We also provide a deep understanding of the recent developments in sign language translation technology and the potential for their fusion with Internet of Things technology to improve communication and promote inclusivity for the deaf and hard-of-hearing population.

show abstract

Machine translation from signed to spoken languages: state of the art and challenges

Coster

Shterionov

Herreweghe

et al. 2023

Univ Access Inf Soc

View full text Add to dashboard Cite

Automatic translation from signed to spoken languages is an interdisciplinary research domain on the intersection of computer vision, machine translation (MT), and linguistics. While the domain is growing in terms of popularity—the majority of scientific papers on sign language (SL) translation have been published in the past five years—research in this domain is performed mostly by computer scientists in isolation. This article presents an extensive and cross-domain overview of the work on SL translation. We first give a high level introduction to SL linguistics and MT to illustrate the requirements of automatic SL translation. Then, we present a systematic literature review of the state of the art in the domain. Finally, we outline important challenges for future research. We find that significant advances have been made on the shoulders of spoken language MT research. However, current approaches often lack linguistic motivation or are not adapted to the different characteristics of SLs. We explore challenges related to the representation of SL data, the collection of datasets and the evaluation of SL translation models. We advocate for interdisciplinary research and for grounding future research in linguistic analysis of SLs. Furthermore, the inclusion of deaf and hearing end users of SL translation applications in use case identification, data collection, and evaluation, is of utmost importance in the creation of useful SL translation models.

show abstract

Development of a New Sign Language Translation System for People with Autism Spectrum Disorder

Cited by 8 publications

References 34 publications

AAC and Autism: Manual Signs and Pecs, a Comparison

AAC and Autism: Manual Signs and Pecs, a Comparison

A Survey of Advancements in Real-Time Sign Language Translators: Integration with IoT Technology

Machine translation from signed to spoken languages: state of the art and challenges

Contact Info

Product

Resources

About