Offering a Hand to Pragmatic Understanding: The Role of Speech and Gesture in Comprehension and Memory

Kelly, Spencer D.; Barr, Dale J.; Church, R. Breckinridge; Lynch, Katheryn

doi:10.1006/jmla.1999.2634

Cited by 250 publications

(210 citation statements)

References 26 publications

Supporting

Mentioning

202

Contrasting

Unclassified

Order By: Relevance

“…This corroborates past research showing that gestures can help language comprehension (e.g., Kelly, Barr, Church, & Lynch, 1999). It may seem surprising that we did not find a main effect of modality in our reaction time data for addressed recipients-thus contrasting with some earlier studies, such as Kelly et al (2010, see experimental results referred to in footnote 2).…”

Section: Discussionsupporting

confidence: 89%

Social eye gaze modulates processing of speech and co-speech gesture

et al. 2014

View full text Add to dashboard Cite

a b s t r a c tIn human face-to-face communication, language comprehension is a multi-modal, situated activity. However, little is known about how we combine information from different modalities during comprehension, and how perceived communicative intentions, often signaled through visual signals, influence this process. We explored this question by simulating a multi-party communication context in which a speaker alternated her gaze between two recipients. Participants viewed speech-only or speech + gesture object-related messages when being addressed (direct gaze) or unaddressed (gaze averted to other participant). They were then asked to choose which of two object images matched the speaker's preceding message. Unaddressed recipients responded significantly more slowly than addressees for speech-only utterances. However, perceiving the same speech accompanied by gestures sped unaddressed recipients up to a level identical to that of addressees. That is, when unaddressed recipients' speech processing suffers, gestures can enhance the comprehension of a speaker's message. We discuss our findings with respect to two hypotheses attempting to account for how social eye gaze may modulate multi-modal language comprehension.

show abstract

Section: Discussionsupporting

confidence: 89%

Social eye gaze modulates processing of speech and co-speech gesture

et al. 2014

View full text Add to dashboard Cite

show abstract

“…As an aside, one may wonder whether native speakers notice the difference between native and nonnative-like gesturing. Although many studies indicate that listeners attend to and integrate gestural information (e.g., Gullberg & Kita, accepted;Kelly, Barr, Breckinridge Church, & Lynch, 1999;Özyürek, Willems, Kita, & Hagoort, 2007;Riseborough, 1981), no study to date has tested native speakers' sensitivity to 'foreign gesture'. This is clearly a worthwhile enterprise.…”

Section: Gesture Production In Native English and L2 Dutchmentioning

confidence: 99%

Reconstructing verb meaning in a second language

Gullberg

2009

ARCL

View full text Add to dashboard Cite

General rights Copyright and moral rights for the publications made accessible in the public portal are retained by the authors and/or other copyright owners and it is a condition of accessing publications that users recognise and abide by the legal requirements associated with these rights.• Users may download and print one copy of any publication from the public portal for the purpose of private study or research.• You may not further distribute the material or use it for any profit-making activity or commercial gain • You may freely distribute the URL identifying the publication in the public portal Take down policy If you believe that this document breaches copyright please contact us providing details, and we will remove access to the work immediately and investigate your claim.

show abstract

“…The use of short video clips is common in gesture comprehension research [31,45,46,[59][60][61] as it allows for fine-grained analysis, demonstrating that the effect of gestures is directly attributable to the information they contain, rather than, for example, participants just guessing more information when gestures are present. However, these are not representative of the longer, more complete pain descriptions that occur within clinical interactions, limiting the applicability of the findings.…”

Section: -39] This Is the First To Experimentally Demonstrate Thatmentioning

confidence: 99%

I see how you feel: Recipients obtain additional information from speakers’ gestures about pain

Rowbotham

Holler

Wearden

et al. 2016

Patient Education and Counseling

View full text Add to dashboard Cite

Objective: Despite the need for effective pain communication, pain is difficult to verbalise. Cospeech gestures frequently add information about pain that is not contained in the accompanying speech. We explored whether recipients can obtain additional information from gestures about the pain that is being described.Methods: Participants (n = 135) viewed clips of pain descriptions under one of four conditions: 1) Speech Only; 2) Speech and Gesture; 3) Speech, Gesture and Face; and 4) Speech, Gesture and Face plus Instruction (short presentation explaining the pain information that gestures can depict). Participants provided free-text descriptions of the pain that had been described.Responses were scored for the amount of information obtained from the original clips. Conclusions: Gestures produced during pain descriptions provide additional information about pain that recipients are able to pick up without detriment to their uptake of spoken information.Practice implications: Healthcare professionals may benefit from instruction in gestures to enhance uptake of information about patients' pain experiences.

show abstract

Offering a Hand to Pragmatic Understanding: The Role of Speech and Gesture in Comprehension and Memory

Cited by 250 publications

References 26 publications

Social eye gaze modulates processing of speech and co-speech gesture

Social eye gaze modulates processing of speech and co-speech gesture

Reconstructing verb meaning in a second language

I see how you feel: Recipients obtain additional information from speakers’ gestures about pain

Contact Info

Product

Resources

About