A small vocabulary database of ultrasound image sequences of vocal tract dynamics

Castillo, M Andrea; Rubio, Felipe Alves; Porras, Dagoberto; Contreras-Ortiz, Sonia H.; Sepúlveda-Sepúlveda, Alexander

doi:10.1109/stsiva.2019.8730224

Cited by 2 publications

(3 citation statements)

References 23 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Researchers and clinical linguists have widely adopted the use of lingual ultrasound for different applications. Some of these applications include using it as a visual feedback for second language teaching [ 65 , 66 ], speech remediation to correct articulation for people with speech disabilities [ 67 ], speech-related disorders such as autism [ 4 , 68 , 69 ], articulation research and analysis [ 10 , 65 , 70 ], swallowing studies [ 71 ], tongue 3D modelling [ 72 ], and silent speech interface [ 7 , 73 , 74 , 75 ]. Furthermore, ultrasound imaging analysis is used in many applications in medical imaging analysis for object detection and segmentation.…”

Section: Overview Of Ultrasound Imaging In Speech Recognitionmentioning

confidence: 99%

Tongue Contour Tracking and Segmentation in Lingual Ultrasound for Speech Recognition: A Review

et al. 2022

View full text Add to dashboard Cite

Lingual ultrasound imaging is essential in linguistic research and speech recognition. It has been used widely in different applications as visual feedback to enhance language learning for non-native speakers, study speech-related disorders and remediation, articulation research and analysis, swallowing study, tongue 3D modelling, and silent speech interface. This article provides a comparative analysis and review based on quantitative and qualitative criteria of the two main streams of tongue contour segmentation from ultrasound images. The first stream utilizes traditional computer vision and image processing algorithms for tongue segmentation. The second stream uses machine and deep learning algorithms for tongue segmentation. The results show that tongue tracking using machine learning-based techniques is superior to traditional techniques, considering the performance and algorithm generalization ability. Meanwhile, traditional techniques are helpful for implementing interactive image segmentation to extract valuable features during training and postprocessing. We recommend using a hybrid approach to combine machine learning and traditional techniques to implement a real-time tongue segmentation tool.

show abstract

Section: Overview Of Ultrasound Imaging In Speech Recognitionmentioning

confidence: 99%

Tongue Contour Tracking and Segmentation in Lingual Ultrasound for Speech Recognition: A Review

et al. 2022

View full text Add to dashboard Cite

show abstract

“…Each speaker uttered 30 Spanish sentences in a total of 340 seconds, and approximately 4000 images per speaker were recorded. For additional details, the interested reader can find information in [28].…”

Section: Data Acquisitionmentioning

confidence: 99%

“…Equipment used for the parallel acoustic-articulatory data collection: microphone, personal computer, ultrasound probe and stabilization headset. Source:[28].…”

mentioning

confidence: 99%

Speaker verification system based on articulatory information from ultrasound recordings

Sepúlveda

Porras-Plata

Sarria-Paja

2020

DYNA

View full text Add to dashboard Cite

Current state-of-the-art speaker verification (SV) systems are known to be strongly affected by unexpected variability presented during testing, such as environmental noise or changes in vocal effort. In this work, we analyze and evaluate articulatory information of the tongue's movement as a means to improve the performance of speaker verification systems. We use a Spanish database, where besides the speech signals, we also include articulatory information that was acquired with an ultrasound system. Two groups of features are proposed to represent the articulatory information, and the obtained performance is compared to an SV system trained only with acoustic information. Our results show that the proposed features contain highly discriminative information, and they are related to speaker identity; furthermore, these features can be used to complement and improve existing systems by combining such information with cepstral coefficients at the feature level.

show abstract

A small vocabulary database of ultrasound image sequences of vocal tract dynamics

Cited by 2 publications

References 23 publications

Tongue Contour Tracking and Segmentation in Lingual Ultrasound for Speech Recognition: A Review

Tongue Contour Tracking and Segmentation in Lingual Ultrasound for Speech Recognition: A Review

Speaker verification system based on articulatory information from ultrasound recordings

Contact Info

Product

Resources

About