LSA-T: The First Continuous Argentinian Sign Language Dataset for Sign Language Translation

Bianco, Pedro Dal; Ríos, Gastón Gustavo; Ronchetti, Franco; Quiroga, Facundo; Stanchi, Oscar; Hasperué, Waldo; Rosete-Suárez, Alejandro

doi:10.1007/978-3-031-22419-5_25

Cited by 4 publications

(2 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Human pose estimation systems are used to extract features in fifteen papers [35, 36, 62, 69, 73, 79, 80, 84, 85, 88-90, 94, 95, 97]. The estimated poses can be the only inputs to the translation model [35,62,69,73,84,85,90,94,97], or they can augment other spatial or spatio-temporal features [36,79,80,88,89,95]. Often, the keypoints are used as a sign language representation directly.…”

Section: Extraction Methodsmentioning

confidence: 99%

Machine translation from signed to spoken languages: state of the art and challenges

Coster

Shterionov

Herreweghe

et al. 2023

Univ Access Inf Soc

View full text Add to dashboard Cite

Automatic translation from signed to spoken languages is an interdisciplinary research domain on the intersection of computer vision, machine translation (MT), and linguistics. While the domain is growing in terms of popularity—the majority of scientific papers on sign language (SL) translation have been published in the past five years—research in this domain is performed mostly by computer scientists in isolation. This article presents an extensive and cross-domain overview of the work on SL translation. We first give a high level introduction to SL linguistics and MT to illustrate the requirements of automatic SL translation. Then, we present a systematic literature review of the state of the art in the domain. Finally, we outline important challenges for future research. We find that significant advances have been made on the shoulders of spoken language MT research. However, current approaches often lack linguistic motivation or are not adapted to the different characteristics of SLs. We explore challenges related to the representation of SL data, the collection of datasets and the evaluation of SL translation models. We advocate for interdisciplinary research and for grounding future research in linguistic analysis of SLs. Furthermore, the inclusion of deaf and hearing end users of SL translation applications in use case identification, data collection, and evaluation, is of utmost importance in the creation of useful SL translation models.

show abstract

Section: Extraction Methodsmentioning

confidence: 99%

Machine translation from signed to spoken languages: state of the art and challenges

Coster

Shterionov

Herreweghe

et al. 2023

Univ Access Inf Soc

View full text Add to dashboard Cite

show abstract

“…These grammatical variances are observable in sign language as well. For example, Mexican Sign Language (MSL) differs from Spanish Sign Language [ 3 ] or Argentinian Sign Language [ 4 ]. Hence, the necessity for a dataset tailored to the native sign language prompted its design, acknowledging and addressing its limitations.…”

Section: Experimental Design Materials and Methodsmentioning

confidence: 99%