Multimodal speech data acquisition with the use of EMA, fast-speed video cameras and a dedicated microphone array

Mik, Ł.; Wielgat, Robert; Król, Daniel; Jędryka, Rafał; Lorenc, Anita; Święciński, Radosław

doi:10.1109/mixdes.2016.7529777

Cited by 5 publications

(2 citation statements)

References 7 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…For this purpose the Carstens articulograph (AG500), a vision system consisting of three Point Gray high speed cam-eras (Gazelle GZL-CL-22C5M-C), and an audio recorder with 16-channel microphone array [15,16] were used. The construction of the measuring system and its dependencies are shown in Figure 1, while its operation is described in detail in [17].…”

Section: Methodsmentioning

confidence: 99%

The EMA Study on the Inter-individual Variability and Differences in Articulation between Polish Oral and Nasalised Vowels

Wielgat

Lorenc

2017

Sci. Tech., Innov

Self Cite

View full text Add to dashboard Cite

The electromagnetic articulography (EMA) is a relatively exact and efficient method used in study on speech production physiology. It allows to precisely estimate movement trajectories of speech articulators like tongue, lips, jaw etc. by tracking position of sensors fixed to the articulators. This paper presents results of EMA research on Polish oral and nasalised vowels in orthography represented by the graphemes <e>, <o>, <ę>, <ą>. Inter-individual variability of tongue and lips position in X-axis direction during realization of the same phoneme has been estimated. Differences between oral and nasalised vowels in terms of movement of articulators in X-axis direction have been assessed too.

show abstract

Section: Methodsmentioning

confidence: 99%

The EMA Study on the Inter-individual Variability and Differences in Articulation between Polish Oral and Nasalised Vowels

Wielgat

Lorenc

2017

Sci. Tech., Innov

Self Cite

View full text Add to dashboard Cite

show abstract

“…The proposed device [21] consists of a 16-channel recorder, a circular microphone array, microphone amplifiers and analog-to-digital converters, and a signal processor. Mik et al [22], [23] extended the system to a multimodal framework consisting of an electromagnetic articulograph, a 16-channel microphone array, and three ultrafast cameras. The system enables synchronous video acquisition of the mouth area, distribution of acoustic field intensity, and tracking trajectories of characteristic face points.…”

Section: ) Data Acquisition Systemsmentioning

confidence: 99%

Multichannel Speech Acquisition and Analysis for Computer-Aided Sigmatism Diagnosis in Children

et al. 2020

View full text Add to dashboard Cite

A novel concept for acoustic data acquisition for computer-aided diagnosis of a common speech disorder (sigmatism) is presented in this paper. We designed and built a data acquisition device enabling repeatable speech signal acquisition in up to fifteen spatially-organized acoustic channels. The system is safe, non-invasive, comfortable, visually attractive to the user, and does not affect the articulation process. It is easy and convenient to use and transport and does not require a specialized measuring room. We collected a large speech corpus containing speech samples from 107 children aged five or six. The data were acquired according to a dedicated protocol. They consisted of multichannel acoustic recordings of selected words containing sibilants and diagnostic descriptions of articulatory features prepared by speech therapy experts. The data acquisition device was examined for responses and repeatability of individual microphones in the presence of various synthetic and human-generated acoustic stimuli. Then, it was verified for its ability to indicate distinctive patterns in spatial energy distribution in different realizations of two sibilants: /s/, /S/ in three pronunciation categories each, based on collected speech-articulation corpus. The results confirm that a multichannel speech signal can be successfully employed for the analysis of the spatial distribution of airflow during normative or pathological realization of sibilant sounds in children. The method is promising for comprehensive analysis of articulatory features, which follows new trends in the description of speech disorders; such an approach was not employed in speech diagnosis or therapy so far.

show abstract

Speech inversion by dynamic time warping method

Wielgat

Lorenc

2016

2016 International Conference on Signals and Electronic Systems (ICSES)

View full text Add to dashboard Cite

Multimodal speech data acquisition with the use of EMA, fast-speed video cameras and a dedicated microphone array

Cited by 5 publications

References 7 publications

The EMA Study on the Inter-individual Variability and Differences in Articulation between Polish Oral and Nasalised Vowels

The EMA Study on the Inter-individual Variability and Differences in Articulation between Polish Oral and Nasalised Vowels

Multichannel Speech Acquisition and Analysis for Computer-Aided Sigmatism Diagnosis in Children

Speech inversion by dynamic time warping method

Contact Info

Product

Resources

About