Cross-language speech attribute detection and phone recognition for Tibetan using deep learning

Wang, Hui; Zhao, Yue; Xu, Yanmin; Xu, Xiaona; Suo, Xingmei; Ji, Qiang

doi:10.1109/iscslp.2014.6936682

Cited by 4 publications

(1 citation statement)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Additionally, AFs are universal; hence, AFs of a specific language are common with many different languages [ 10 ]. In this context, several studies have been proposed to build universal (i.e., cross-language) speech recognition systems based on the universal property of AFs [ 11 , 12 ].…”

Section: Introductionmentioning

confidence: 99%

Deep Learning-Based Detection of Articulatory Features in Arabic and English Speech

Algabri

Mathkour

Alsulaiman

et al. 2021

Sensors

View full text Add to dashboard Cite

This study proposes using object detection techniques to recognize sequences of articulatory features (AFs) from speech utterances by treating AFs of phonemes as multi-label objects in speech spectrogram. The proposed system, called AFD-Obj, recognizes sequence of multi-label AFs in speech signal and localizes them. AFD-Obj consists of two main stages: firstly, we formulate the problem of AFs detection as an object detection problem and prepare the data to fulfill requirement of object detectors by generating a spectral three-channel image from the speech signal and creating the corresponding annotation for each utterance. Secondly, we use annotated images to train the proposed system to detect sequences of AFs and their boundaries. We test the system by feeding spectrogram images to the system, which will recognize and localize multi-label AFs. We investigated using these AFs to detect the utterance phonemes. YOLOv3-tiny detector is selected because of its real-time property and its support for multi-label detection. We test our AFD-Obj system on Arabic and English languages using KAPD and TIMIT corpora, respectively. Additionally, we propose using YOLOv3-tiny as an Arabic phoneme detection system (i.e., PD-Obj) to recognize and localize a sequence of Arabic phonemes from whole speech utterances. The proposed AFD-Obj and PD-Obj systems achieve excellent results for Arabic corpus and comparable to the state-of-the-art method for English corpus. Moreover, we showed that using only one-scale detection is suitable for AFs detection or phoneme recognition.

show abstract

Section: Introductionmentioning

confidence: 99%