Expression of affect in spontaneous speech: Acoustic correlates and automatic detection of irritation and resignation

Laukka, Petri; Neiberg, Daniel; Forsell, Mimmi; Karlsson, Inger; Elenius, Kjell

doi:10.1016/j.csl.2010.03.004

Cited by 67 publications

(49 citation statements)

References 73 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…In general, the pattern of results also resembles the findings from the expressive performance studies, particularly for the acoustic features of Ratio of highfrequency to low-frequency energy and Articulation, which have been linked to systematic differences between the basic emotions expressed in music (e.g., Bresin & Friberg, 2000;Gabrielsson & Lindström, 1995;Juslin, 1997Juslin, , 2000. These observations, in turn, have been linked with similar patterns of results in expressive speech (e.g., Ilie & Thompson, 2006;Juslin & Laukka, 2003;Laukka, Neiberg, Forsell, Karlsson, & Elenius, 2011).…”

Section: Resultsmentioning

confidence: 70%

Timbre and Affect Dimensions: Evidence from Affect and Similarity Ratings and Acoustic Correlates of Isolated Instrument Sounds

2012

View full text Add to dashboard Cite

considerable effort has been made towards understanding how acoustic and structural features contribute to emotional expression in music, but relatively little attention has been paid to the role of timbre in this process. Our aim was to investigate the role of timbre in the perception of affect dimensions in isolated musical sounds, by way of three behavioral experiments. In Experiment 1, participants evaluated perceived affects of 110 instrument sounds that were equal in duration, pitch, and dynamics using a three-dimensional affect model (valence, energy arousal, and tension arousal) and preference and emotional intensity. In Experiment 2, an emotional dissimilarity task was applied to a subset of the instrument sounds used in Experiment 1 to better reveal the underlying affect structure. In Experiment 3, the perceived affect dimensions as well as preference and intensity of a new set of 105 instrument sounds were rated by participants. These sounds were also uniform in pitch, duration, and playback dynamics but contained systematic manipulations in the dynamics of sound production, articulation, and ratio of high-frequency to low-frequency energy. The affect dimensions for all the experiments were then explained in terms of the three kinds of acoustic features extracted: spectral (e.g., ratio of high-frequency to low-frequency energy), temporal (e.g., attack slope), and spectro-temporal (e.g., spectral flux). High agreement among the participants' ratings across the experiments suggested that even isolated instrument sounds contain cues that indicate affective expression, and these are recognized as such by the listeners. A dominant portion (50-57%) of the two dimensions of affect (valence and energy arousal) could be predicted by linear combinations of few acoustic features such as ratio of high-frequency to low-frequency energy, attack slope, and spectral regularity. Links between these features and those observed in the vocal expression of affects and other sound phenomena are discussed.

show abstract

Section: Resultsmentioning

confidence: 70%

Timbre and Affect Dimensions: Evidence from Affect and Similarity Ratings and Acoustic Correlates of Isolated Instrument Sounds

2012

View full text Add to dashboard Cite

show abstract

“…[ANG et al, s.d. ;FUJISAWA et al, 2003;TOIVANEN et al, 2004;VOGT et al, 2005;COOK et al, 2006;VIDRASCU;DEVILLERS, 2007;RONG et al, 2007;NEIBERG;ELENIUS, 2008;BUSSO et al, 2009;YANG;LUGGER, 2010;LAUKKA et al, 2011).…”

Section: Introductionunclassified

ExProsodia

Netto¹

2016

View full text Add to dashboard Cite

“…Otherwise, specific affective states can also be chosen that would be more fitted for the particular data collected. For example, studies on affective states such as interest, approval, attention and prohibition, and motherese and empathic [28]. Natural vocal changes have very high ecological validity and therefore seem to be the ideal research paradigm [36].…”

Section: B Natural Vocal Expressionsmentioning

confidence: 99%

Obtaining speech assets for judgement analysis on low-pass filtered emotional speech

Snel¹,

Cullen²

2011

Face and Gesture 2011

View full text Add to dashboard Cite

Expression of affect in spontaneous speech: Acoustic correlates and automatic detection of irritation and resignation

Cited by 67 publications

References 73 publications

Timbre and Affect Dimensions: Evidence from Affect and Similarity Ratings and Acoustic Correlates of Isolated Instrument Sounds

Timbre and Affect Dimensions: Evidence from Affect and Similarity Ratings and Acoustic Correlates of Isolated Instrument Sounds

ExProsodia

Obtaining speech assets for judgement analysis on low-pass filtered emotional speech

Contact Info

Product

Resources

About