Comparison of Rater’s Reliability on Perceptual Evaluation of Different Types of Voice Sample

Law, Tsz Ting; Kim, Jean H.; Lee, Kathy; Tang, Eric C.-H.; Lam, Joffee H.; Hasselt, Andrew C. van; Tong, Michael C. F.

doi:10.1016/j.jvoice.2011.08.003

Cited by 36 publications

(25 citation statements)

References 27 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Previous studies comparing types of voice samples often, but not always (see, e.g., Awan et al, 2010;de Krom, 1994;Parsa & Jamieson, 2001;Revis et al, 1999), demonstrated differences in acoustic and perceptual measures of voice quality between the two stimulus types, with rating reliability usually in the low-to-moderate range, but equal for both kinds of stimuli (e.g., de Krom, 1994;Law et al, 2012;Maryn & Roy, 2012;Revis et al, 1999). The different kinds of information available from connected speech and steady-state vowels have led some authors to advocate inclusion of both kinds of stimuli in evaluations of voice quality (e.g., Maryn & Roy, 2012;Wolfe, Fitch, & Cornell, 1995), and the Acoustic Voice Quality Index (Maryn et al, 2010a;Maryn, De Bodt, & Roy, 2010b) and CAPE-V protocols, in fact, include analyses of both continuous speech and sustained vowels.…”

Section: Purposementioning

confidence: 98%

Comparing Measures of Voice Quality From Sustained Phonation and Continuous Speech

Gerratt

Kreiman

Garellek

2016

J Speech Lang Hear Res

View full text Add to dashboard Cite

Purpose:The question of what type of utterance-a sustained vowel or continuous speech-is best for voice quality analysis has been extensively studied but with equivocal results. This study examines whether previously reported differences derive from the articulatory and prosodic factors occurring in continuous speech versus sustained phonation. Method: Speakers with voice disorders sustained vowels and read sentences. Vowel samples were excerpted from the steadiest portion of each vowel in the sentences. In addition to sustained and excerpted vowels, a 3rd set of stimuli was created by shortening sustained vowel productions to match the duration of vowels excerpted from continuous speech. Acoustic measures were made on the stimuli, and listeners judged the severity of vocal quality deviation. Results: Sustained vowels and those extracted from continuous speech contain essentially the same acoustic and perceptual information about vocal quality deviation. Conclusions: Perceived and/or measured differences between continuous speech and sustained vowels derive largely from voice source variability across segmental and prosodic contexts and not from variations in vocal fold vibration in the quasisteady portion of the vowels. Approaches to voice quality assessment by using continuous speech samples average across utterances and may not adequately quantify the variability they are intended to assess.

show abstract

Section: Purposementioning

confidence: 98%

Comparing Measures of Voice Quality From Sustained Phonation and Continuous Speech

Gerratt

Kreiman

Garellek

2016

J Speech Lang Hear Res

View full text Add to dashboard Cite

show abstract

“…The sustained vowel has the advantage of being easier to elicit and still being unaffected by the articulation of the subject [10, 11] but this production model is unnatural and not representative of the daily speaking voice [12]. In contrast, continuous speech is more natural but some speaking characteristics (articulation, speech rate) may substantially influence the assessment of the voice quality [13]. With regard to the debate about both the reliability and validity of one or the other vocal sample used, a few authors use composite methods alternating continuous speech to assess certain GRBASI components (e.g., roughness, breathiness, and instability) and sustained vowel for other components (i.e., asthenia and strain) [14-16].…”

Section: Introductionmentioning

confidence: 99%

“…With regard to the debate about both the reliability and validity of one or the other vocal sample used, a few authors use composite methods alternating continuous speech to assess certain GRBASI components (e.g., roughness, breathiness, and instability) and sustained vowel for other components (i.e., asthenia and strain) [14-16]. Moreover, in the last decades, a few researchers have studied the impact of the choice of the task on the results of the perceptual voice quality evaluations and they found mixed results, especially concerning the interrater reliability and agreement between judges [13, 17-19]. Thus, some data supported that sustained vowels are rated significantly more dysphonic than continuous speech [20], while other did not find a significant difference [18].…”

Section: Introductionmentioning

confidence: 99%

“…Thus, some data supported that sustained vowels are rated significantly more dysphonic than continuous speech [20], while other did not find a significant difference [18]. The controversy also concerns the impact of speech task on the interrater reliability since some authors did not find significant differences in interrater reliability between dysphonia severity ratings of sustained vowels and continuous speech [13, 20, 21], while others supported that the counting task and/or sustained /a/ phonation are the optimal tasks for perceptual voice judgment with regard to interrater reliability [17]. Most of the studies selected perceptual moderate or severe dysphonia samples to demonstrate a task’s effect, but they did not compare the absolute agreement, intra- and interrater reliabilities of mild or moderate dysphonia that often remain harder to grade than severe dysphonic voice [22, 23].…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

The Effect of the Speech Task Characteristics on Perceptual Judgment of Mild to Moderate Dysphonia: A Methodological Study

Lechien

Morsomme

Finck

et al. 2018

Folia Phoniatr Logop

View full text Add to dashboard Cite

Objective: To study the differences in perceptual ratings of mild and moderate dysphonia related to the speech task, and their impact on intrarater and interrater reliabilities. Patients and Methods: Voice recordings of 15 outpatients with mild or moderate dysphonia related to laryngopharyngeal reflux were presented to 6 female experienced judges blinded to the clinical state of the patients. From these, the GRBASI (Grade, Roughness, Breathiness, Asthenia, Strain, and Instability) evaluations were performed on connected speech and sustained vowel of the pretreatment voice recordings and absolute agreement, and both intrarater and interrater reliabilities were assessed. Results: The average GRBASI scores were significantly worse when performed on sustained vowel. Intrarater reliability substantially varied according to the judge and the task. Good interrater reliability was broadly found for the evaluations of all GRBASI components irrespective of the speech task. Concerning agreement, we only found absolute agreement between judges for G and R items assessed on text. Conclusion: Average grade of perceptual voice impairment, intrarater reliability, and agreement vary according to the speech task.

show abstract

“…An intraword vowel [a:] has commonly been used in voice analyses that apply glottal inverse filtering [e.g., [18,19,20]], as well as in some EGG studies [e.g., [21,22,23]]. A reading task to furnish connected speech material has been recommended for research purposes, while spontaneous speech has been recommended for clinical use [24]. In the current study, loud voice and noise exposure were used to create a situation where the participants used their voices as if they were in noisy working conditions, which we considered likely to bring out a tendency to use a pressed voice.…”

Section: Introductionmentioning

confidence: 99%

EGG and Acoustic Analyses of Different Voice Samples: Comparison between Perceptual Evaluation and Voice Activity and Participation Profile

Kankare

Liu

Laukkanen

et al. 2013

Folia Phoniatr Logop

View full text Add to dashboard Cite

Objective: This study investigated whether different electroglottographic (EGG) parameters may be used to estimate voice quality and loading related to it, and whether voice quality is related to self-estimation of voice problems and laryngeal status. The effect of sample type was also considered. Methods: EGG and acoustic signals of a sustained vowel [a:] (90 dB_{6 cm}) and text reading during noise exposure were recorded from 93 female kindergarten teachers. Analyses were made from the sustained vowel and vowel [a:] from a stressed word. Contact quotient (CQ) was calculated. Maximum velocity of increase in contact area inferred from derivative (MDEGG) was examined. Fundamental frequency was calculated from the EGG signal. From the acoustic signal sound pressure level (SPL) was computed and pressedness in voice quality was evaluated perceptually. Self-evaluation was made with Voice Activity and Participation Profile (VAPP). Indirect laryngoscopy was also performed. Results: Pressedness in voice correlated with EGG results only for the sustained vowel, and better with MDEGG than CQ values. VAPP and laryngeal evaluation did not correlate with the acoustic or EGG parameters or with perception. Conclusions: MDEGG is worth testing as an indicator of impact stress. Sustained vowel at a controlled SPL is more suitable for voice quality evaluation than a long stressed vowel from connected speech.

show abstract

Comparison of Rater’s Reliability on Perceptual Evaluation of Different Types of Voice Sample

Cited by 36 publications

References 27 publications

Comparing Measures of Voice Quality From Sustained Phonation and Continuous Speech

Comparing Measures of Voice Quality From Sustained Phonation and Continuous Speech

The Effect of the Speech Task Characteristics on Perceptual Judgment of Mild to Moderate Dysphonia: A Methodological Study

EGG and Acoustic Analyses of Different Voice Samples: Comparison between Perceptual Evaluation and Voice Activity and Participation Profile

Contact Info

Product

Resources

About