Epistemic intonation and epistemic gesture are mutually co-expressive: Empirical results from two intonation-gesture matching tasks

Abstract

While several studies have investigated the temporal relationship between co-speech gestures and prosodic structure, little is known about their potential interaction at the level of their encoding of pragmatic meaning. Here we report the results of two complementary intonationgesture matching tasks which investigate the potential co-dependencies between intonation patterns related to epistemic commitment operators and their associated gestures in Catalan. In Experiment 1, participants were shown audio-muted videos in which a speaker performed gestures conveying epistemic information of certainty or uncertainty while uttering statements and questions. The subjects were then asked to produce a stipulated target word, the goal being to examine whether they would produce the word with a tune that was semantically consistent with the gestures they had seen. In Experiment 2, participants were primed by hearing intonation patterns conveying epistemic information (certainty-uncertainty) and were then asked to select one of two silent videos which seemed to best match the intonation they had heard. The results suggest converging positive effects in both matching tasks and suggest a close interrelation between the pragmatic representations of intonation and gesture that needs to be taken into account when investigating multimodal pragmatic encoding. Highlights• One-to-one correspondences can be made between prosodic tunes and gesture sets used to convey epistemic meanings • Speakers can be successfully primed by epistemic gestures to produce corresponding epistemic intonation. • Listeners can be successfully primed by epistemic intonation to visually select corresponding epistemic gestures. • Results support the idea of a tight interplay between intonational meaning and gestural meaning.

Integrating qualitative and quantitative analyses of stance: A case study of Englishthat/zero variation

“…The pragmatic tests that we use here can be applied to code other data, and as a guide in the experimental investigation of different sources of pragmatic meaning such as morphology (Grandi & Körtvélyessy 2015), intonation (Prieto & Borràs-Comes 2018), discourse particles (Prieto & Roseano 2021), and gestures (Borràs-Comes, Kiagia, & Prieto 2019). Furthermore, the pragmatic reasoning behind our coding protocol is not restricted to the aspects of stance proposed in this article.…”

Individual empathy levels affect gradual intonation-meaning mapping: The case of biased questions in Salerno Italian

“…Though speakers' epistemic disposition towards a proposition, such as the degree of certainty towards its content, can also be expressed through lexical marking (for instance, through adverbials such as 'surely,' 'certainly'), intonational form has been recently found to be a relevant cue (Vanrell, Mascaro, Torres-Tamarit, & Prieto, 2013 for confirmationseeking questions in Catalan), as well as facial and body gestures (Palmer, 2001;Borràs-Comes, Kiagia, & Prieto, 2019). Confirmation-seeking questions, for instance, can be defined as questions for which the speaker shows a bias which can be calculated on the basis of private beliefs combined with world knowledge and information made available by the discourse background (cf.…”

Language Style Used in the Body of Truck : Grammatical Fluidity and Social Function

“…Whereas, the third finding elaborates on the linguistic context which sees the meaning of the language on the body truck as a whole exchange. The last finding of this part emphasizes the social relation between text and reader in which one of the examples is concerning daily habit in society that has the potential to produce humorous as the earlier study of Borra s-Comes; Kiagia;and Prieto (2019).…”