Multimodal stress detection: Testing for covariation in vocal, hormonal and physiological responses to Trier Social Stress Test

Pisanski, Katarzyna; Jakubowska, Luba; Nowak, Judyta; Walter, Amélia; Błaszczyński, Kamil; Kasprzyk, Magda; Łysenko, Krystyna; Sukiennik, Irmina; Piątek, Katarzyna; Frąckowiak, Tomasz; Sorokowski, Piotr

doi:10.1016/j.yhbeh.2018.08.014

Cited by 27 publications

(22 citation statements)

References 36 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Importantly, in two recent papers, we show that increases in cortisol levels under lab-induced psychosocial stress (Trier Social Stress Test) and under naturally occurring stress (oral examination) predict increases in voice fundamental frequency ( F 0, pitch) among women (Pisanski, Nowak, et al., 2016; Pisanski et al., 2018). Similarly, Buchanan et al.…”

Section: Introductionmentioning

confidence: 65%

“…In the present study, we tested whether changes in the salivary cortisol levels and vocal parameters of speakers who were recorded under real-life stress predict listeners’ voice-based judgments of those speakers’ stress levels. Importantly, in light of recent evidence that vocal changes under stress covary with the magnitude of the biological stress response (Buchanan et al., 2014; Pisanski, Nowak, et al., 2016; Pisanski et al., 2018), we test the prediction that listeners’ stress ratings will correlate positively with the underlying cortisol levels of speakers, and with their stress-linked vocal parameters, particularly voice pitch.…”

Section: Introductionmentioning

confidence: 99%

“…Vocal communication of stress has been a central topic of research for decades (Kreiman & Sidtis, 2011b;Scherer, 1986). Yet, due to the inherent complexities of defining, evoking, and measuring stress (Murray et al, 1996), and individual differences in the magnitude of the stress response and in its behavioral manifestation (Pisanski et al, 2018;Scherer, 1986), the effects of stress on vocal production and perception remain unclear.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Human Stress Detection: Cortisol Levels in Stressed Speakers Predict Voice-Based Judgments of Stress

Pisanski

Sorokowski

2020

Perception

Self Cite

View full text Add to dashboard Cite

Despite recent evidence of a positive relationship between cortisol levels and voice pitch in stressed speakers, the extent to which human listeners can reliably judge stress from the voice remains unknown. Here, we tested whether voice-based judgments of stress co-vary with the free cortisol levels and vocal parameters of speakers recorded in a real-life stressful situation (oral examination) and baseline (2 weeks prior). Hormone and acoustic analyses indicated elevated salivary cortisol levels and corresponding changes in voice pitch, vocal tract resonances (formants), and speed of speech during stress. In turn, listeners’ stress ratings correlated significantly with speakers’ cortisol levels. Higher pitched voices were consistently perceived as more stressed; however, the influence of formant frequencies, vocal perturbation and noise parameters on stress ratings varied across contexts, suggesting that listeners utilize different strategies when assessing calm versus stressed speech. These results indicate that nonverbal vocal cues can convey honest information about a speaker’s underlying physiological level of stress that listeners can, to some extent, detect and utilize, while underscoring the necessity to control for individual differences in the biological stress response.

show abstract

Section: Introductionmentioning

confidence: 65%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Human Stress Detection: Cortisol Levels in Stressed Speakers Predict Voice-Based Judgments of Stress

Pisanski

Sorokowski

2020

Perception

Self Cite

View full text Add to dashboard Cite

show abstract

“…Yet, while NLPs have received attention from researchers studying the evolution and functions of animal calls [5][6][7][8][9], the nature of this information, and thus the function of NLPs in human and animal vocalizations, remains debated. NLPs primarily occur when f 0 or subglottal pressure are high, which is indicative of high vocal effort and an aroused physiological state [5,10]. In addition, NLPs render a signal less predictable, which attracts attention [7] and reduces habituation in listeners [8].…”

Section: Introductionmentioning

confidence: 99%

“…To make our findings more generalizable, in this study, we tested two types of NLPs (subharmonics/sidebands and chaos) and four types of nonverbal vocalizations: screams, roars, gasps and moans (table 1). 5 [1,10] 22 [15,27] 25 [16,32] 33 [25,36] [15,25] 18 [14,23] 15 [8,17] 13 [7,26] 17 [11,27] 27 [16,37] a HNR (harmonics-to-noise ratio) for the three manipulations: no NLPs (top value), subharmonics/sidebands (centre), and chaos (bottom). royalsocietypublishing.org/journal/rsos R. Soc.…”

mentioning

confidence: 99%

Do nonlinear vocal phenomena signal negative valence or high emotion intensity?

2020

Self Cite

View full text Add to dashboard Cite

Nonlinear vocal phenomena (NLPs) are commonly reported in animal calls and, increasingly, in human vocalizations. These perceptually harsh and chaotic voice features function to attract attention and convey urgency, but they may also signal aversive states. To test whether NLPs enhance the perception of negative affect or only signal high arousal, we added subharmonics, sidebands or deterministic chaos to 48 synthetic human nonverbal vocalizations of ambiguous valence: gasps of fright/surprise, moans of pain/pleasure, roars of frustration/achievement and screams of fear/delight. In playback experiments ( N = 900 listeners), we compared their perceived valence and emotion intensity in positive or negative contexts or in the absence of any contextual cues. Primarily, NLPs increased the perceived aversiveness of vocalizations regardless of context. To a smaller extent, they also increased the perceived emotion intensity, particularly when the context was negative or absent. However, NLPs also enhanced the perceived intensity of roars of achievement, indicating that their effects can generalize to positive emotions. In sum, a harsh voice with NLPs strongly tips the balance towards negative emotions when a vocalization is ambiguous, but with sufficiently informative contextual cues, NLPs may be re-evaluated as expressions of intense positive affect, underlining the importance of context in nonverbal communication.

show abstract

Stress Classification Model Using Speech: An Ambulatory Protocol-Based Database Study

Prado,

Hongn,

Pelle

et al. 2024

Lecture Notes in Computer Science

View full text Add to dashboard Cite

Multimodal stress detection: Testing for covariation in vocal, hormonal and physiological responses to Trier Social Stress Test

Cited by 27 publications

References 36 publications

Human Stress Detection: Cortisol Levels in Stressed Speakers Predict Voice-Based Judgments of Stress

Human Stress Detection: Cortisol Levels in Stressed Speakers Predict Voice-Based Judgments of Stress

Do nonlinear vocal phenomena signal negative valence or high emotion intensity?

Stress Classification Model Using Speech: An Ambulatory Protocol-Based Database Study

Contact Info

Product

Resources

About