Crossing language identification: Multilingual ASR framework based on semantic dataset creation &amp; Wav2Vec 2.0

Anidjar, Or Haim; Yozevitch, Roi; Bigon, Nerya; Abdalla, Najeeb; Myara, Benjamin; Marbel, Revital

doi:10.1016/j.mlwa.2023.100489

Cited by 2 publications

(1 citation statement)

References 41 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…On the other hand, their large differences at the lexical and syntactic levels allow us to use a single language model (trained on Basque and Spanish texts) that naturally switches from one language to another based only on the acoustic-phonetic clues found by the acoustic models. By the way, this approach makes it easy to deal with code switchings [22] (quite common in Basque Parliament sessions) compared to other recent approaches in the literature [23][24][25][26][27][28][29].…”

Section: Introductionmentioning

confidence: 99%

A Bilingual Basque–Spanish Dataset of Parliamentary Sessions for the Development and Evaluation of Speech Technology

Varona,

Penagarikano,

Bordel

et al. 2024

Applied Sciences

View full text Add to dashboard Cite

The development of speech technology requires large amounts of data to estimate the underlying models. Even when relying on large multilingual pre-trained models, some amount of task-specific data on the target language is needed to fine-tune those models and obtain competitive performance. In this paper, we present a bilingual Basque–Spanish dataset extracted from parliamentary sessions. The dataset is designed to develop and evaluate automatic speech recognition (ASR) systems but can be easily repurposed for other speech-processing tasks (such as speaker or language recognition). The paper first compares the two target languages, emphasizing their similarities at the acoustic-phonetic level, which sets the basis for sharing data and compensating for the relatively small amount of spoken resources available for Basque. Then, Basque Parliament plenary sessions are characterized in terms of organization, topics, speaker turns and the use of the two languages. The paper continues with the description of the data collection procedure (involving both speech and text), the audio formats and conversions along with the creation and postprocessing of text transcriptions and session minutes. Then, it describes the semi-supervised iterative procedure used to cut, rank and select the training segments and the manual supervision process employed to produce the test set. Finally, ASR experiments are presented using state-of-the-art technology to validate the dataset and to set a reference for future works. The datasets, along with models and recipes to reproduce the experiments reported in the paper, are released through Hugging Face.

show abstract

Section: Introductionmentioning

confidence: 99%

A Bilingual Basque–Spanish Dataset of Parliamentary Sessions for the Development and Evaluation of Speech Technology

Varona,

Penagarikano,

Bordel

et al. 2024

Applied Sciences

View full text Add to dashboard Cite

show abstract

A Bibliometric Approach and Meta-Analysis of Effects of Automatic Speech Recognition on Second Language Learning

Lou,

Xu,

Liu

2024

International Journal of Web-Based Learning and Teaching Technologies

View full text Add to dashboard Cite

Although automatic speech recognition technologies have gained popularity in second language learning, there are still difficulties facing the use of automatic speech recognition in second language learning. Through a bibliometric review and a meta-analysis, this study examines the effects of automatic speech recognition on second language learning. The results of this investigation show that automatic speech recognition technologies can improve second language speaking skills and reduce speaking anxiety, but whether the listening skills can be improved relies on the degree of advancement of the automatic speech recognition technologies. Teachers and students positively evaluate the use of automatic speech recognition technologies in second language learning. Bibliometric analyses reveal the top ten authors, organizations, countries, cited sources, and cited authors, as well as the chronological research trend in the research on the automatic speech recognition used in second language education.

show abstract

Crossing language identification: Multilingual ASR framework based on semantic dataset creation & Wav2Vec 2.0

Cited by 2 publications

References 41 publications

A Bilingual Basque–Spanish Dataset of Parliamentary Sessions for the Development and Evaluation of Speech Technology

A Bilingual Basque–Spanish Dataset of Parliamentary Sessions for the Development and Evaluation of Speech Technology

A Bibliometric Approach and Meta-Analysis of Effects of Automatic Speech Recognition on Second Language Learning

Contact Info

Product

Resources

About