Phoneme-level articulatory animation in pronunciation training

Wang, Lan; Chen, Hui; Li, Sheng; Meng, Helen

doi:10.1016/j.specom.2012.02.003

Cited by 39 publications

(21 citation statements)

References 21 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Globally considered, there has recently been a revival of interest in pronunciation teaching to make L2 learners more efficient users of the target language (Luchini, 2005), and this interest has been more apparent as a number studies have been published in leading journals in ELT (e.g., Ali, 2016;Engwall, 2012;Golonka, Bowles, Frank, Richardson, & Freynik, 2014;Hsu, 2016;Lee & Lyster, 2016;Liakin, Cardoso, & Liakina, 2017;Luo, 2016;Martinsen, Montgomery, & Willardson, 2017;Mbah, Mbah, Iloene, & Iloene, 2014;Meng, Wang, Li, Meng, & Chen, 2012;Mompean & FouzGonzález, 2016;Olson, 2014;Ouni, 2014;Sun et al, 2017;Thomson, 2011Thomson, , 2012Thomson & Derwing, 2015;van Doremalen, Boves, Colpaert, Cucchiarini, & Strik, 2016). The EIL and LFC perspective has had a great impact on this.…”

Section: )mentioning

confidence: 99%

A Discussion of the Ins and Outs of L2 Pronunciation Instruction: A Clash of Methodologies

Bakla

Demirezen²

2018

Ana Dili Eğitimi Dergisi

View full text Add to dashboard Cite

The value attached to pronunciation has kept changing continually in the methodological history of language instruction. Depending on the nature of methodological considerations that dominated research and teaching agenda, it either received too much attention or was marginalized. This study sets out to provide a comprehensive overview of pronunciation instruction from the 1950s to the present day, with a particular reference to popular bipolar debates that characterized this methodologically fluctuating period. Moreover, it attempts to examine the general outlook on pronunciation and summarize major issues concerning what components of pronunciation to include in the syllabus and how to teach it. The study also discusses the role of computers and technology in pronunciation instruction by incorporating data from empirical studies. Although some of the debates have been inconclusive up until today, the intellectual effort put in the process seems to have proved fruitful in providing some guidelines for dealing with the challenging task of improving learners' pronunciation. Keywords:Computer-assisted pronunciation teaching (CAPT), segmental/suprasegmental phonology, accuracy, intelligibility, nativeness, teacher education İkinci Dilde Sesletim Öğretiminin Özüne Dair Bir Tartışma: Metodolojilerin Çatışması ÖzDil eğitiminin metodolojik tarihinde sesletime verilen önem farklılık gösteregelmiştir. Araştırma ve öğretime dair gündemin baskın olan ideolojilerin ve metodolojik değerlendirmelerin doğasına bağlı olarak, sesletim ya çok fazla ilgi görmüş ya da bir kenara itilmiştir. Bu çalışma özellikle metodolojik anlamda dalgalı bir dönemi simgeleyen iki kutuplu popüler tartışmaların çerçevesinde, 1950'lerden günümüze sesletim eğitimine ayrıntılı bir bakış ortaya koymayı hedeflemiştir. Bunun yanında sesletime genel bakışı incelemeye ve müfredata dahil edilecek sesletim unsurlarına ve sesletimin nasıl öğretilmesi gerektiğine dair temel konuları özetlemeye çalışmıştır. Çalışma aynı zamanda ampirik araştırmalardan elde edilmiş veriler vasıtasıyla bilgisayar ve teknolojinin sesletim eğitimindeki yerini ele almaktadır. Sesletime dair tartışmalardan bazıları bu güne kadar bir sonuca ulaşamamış olsa da bu süreçte ortaya konulan zihinsel çaba; zorlu bir iş olan öğrencilerin sesletimlerini geliştirme işinin nasıl ele alınması gerektiğine dair bazı ilkeler ortaya koymada semeresini vermiştir.Anahtar Kelimeler: Bilgisayar destekli sesletim eğitimi (BDSE), parçacıl/parçaüstü fonoloji, doğruluk, anlaşılırlık, yerlilik, öğretmen eğitimi

show abstract

Section: )mentioning

confidence: 99%

A Discussion of the Ins and Outs of L2 Pronunciation Instruction: A Clash of Methodologies

Bakla

Demirezen²

2018

Ana Dili Eğitimi Dergisi

View full text Add to dashboard Cite

show abstract

“…Figure 1. The 3D talking head presents for individual with facial view (Wang, L., et al, 2012) Stevens et al (2013) suggested that observation of the primary and secondary reaction times (RT) associated with manipulated audio-visual (AV) and auditory (A) is an effective evaluation to assess operational environments and ascertain cognitive load where multiple tasks are carried out simultaneously. This evaluation process was carried out by making adjustments to AV and A produced by text to speech (TTS) synthesis and by comparing the performance of a talking head and a human male.…”

Section: Visual Motion Speech Synthesismentioning

confidence: 99%

Realistic Lip Syncing for Virtual Character Using Common Viseme Set

Ali¹,

Sulong²,

Kolivand³

2015

CIS

View full text Add to dashboard Cite

Speech is one of the most important interaction methods between the humans. Therefore, most of avatar researches focus on this area with significant attention. Creating animated speech requires a facial model capable of representing the myriad shapes the human face expressions during speech. Moreover, a method to produce the correct shape at the correct time is also in order. One of the main challenges is to create precise lip movements of the avatar and synchronize it with a recorded audio. This paper proposes a new lip synchronization algorithm for realistic applications, which can be employed to generate synchronized facial movements among the audio generated from natural speech or through a text-to-speech engine. This method requires an animator to construct animations using a canonical set of visemes for all pair wise combination of a reduced phoneme set. These animations are then stitched together smoothly to construct the final animation.

show abstract

“…Then, the modified blending synthesis method based on phoneme-based articulatory model was utilized to generate the movement contours. The details of these methods can be found in previous study [17]. Finally, the synthesized curve was sampled at 25 frames per second, and the deformations on both external and internal articulators in 3D talking head can be driven by this curve.…”

Section: Applicationsmentioning

confidence: 99%

A multi-channel/multi-speaker articulatory database in Mandarin for speech visualization

Zhang

Liu

Yan

et al. 2014

The 9th International Symposium on Chinese Spoken Language Processing

Self Cite

View full text Add to dashboard Cite

The application of articulatory database in speech production and automatic speech recognition has been practiced for many years. The goal of the research was to build an articulatory database specifying in Chinese Mandarin production and to investigate its efficacy in speech animation. Carstens EMA AG501 device were respectively used to capture acoustic data and articulatory data. Also, a Microsoft Kinect camera was applied to capture face-tracking data as a supplement. Finally, we tried several methods to extract acoustic parameters and built up a 3D talking head model to verify the efficacy of the database. Index Terms: articulatory database, Mandarin, EMA, Kinect camera 978-1-4799-4219-0/14/$31.00 c 2014 IEEE

show abstract

Phoneme-level articulatory animation in pronunciation training

Cited by 39 publications

References 21 publications

A Discussion of the Ins and Outs of L2 Pronunciation Instruction: A Clash of Methodologies

A Discussion of the Ins and Outs of L2 Pronunciation Instruction: A Clash of Methodologies

Realistic Lip Syncing for Virtual Character Using Common Viseme Set

A multi-channel/multi-speaker articulatory database in Mandarin for speech visualization

Contact Info

Product

Resources

About