Mnemonic effect of iconic gesture and beat gesture in adults and children: Is meaning in gesture important for memory recall?

So, Wing-Chee; Chen-Hui, Colin Sim; Wei-Shan, Julie Low

doi:10.1080/01690965.2011.573220

Cited by 101 publications

(136 citation statements)

References 61 publications

Supporting

Mentioning

122

Contrasting

Order By: Relevance

“…Further, our results help to explain previous findings that in robots beat gestures have little or no impact on memory of speech that they accompany [14][4], whereas they have been found to do so in humans [31].…”

Section: Discussionsupporting

confidence: 83%

“…While humanoid robots such as the NAO are modelled to mimic human communication strategies, how the communication output are processed by the receiving human appears to be different. Further, these findings may provide some explanation as to the differences in the literature in effects of beat gestures on information recall between human [31] and robot [14][4] studies.…”

Section: Resultsmentioning

confidence: 98%

See 1 more Smart Citation

Speech and Gesture Emphasis Effects for Robotic and Human Communicators

Bremner

Leonards

2015

Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction

View full text Add to dashboard Cite

Emphasis, by means of either pitch accents or beat gestures (rhythmic co-verbal gestures with no semantic meaning), has been shown to serve two main purposes in human communication: syntactic disambiguation and salience. To use beat gestures in this role, interlocutors must be able to integrate them with the speech they accompany. Whether such integration is possible when the multi-modal communication information is produced by a humanoid robot, and whether it is as efficient as for human communicators, are questions that need to be answered to further understanding of the efficacy of humanoid robots for naturalistic human-like communication.Here, we present an experiment which, using a fully within subjects design, shows that there is a marked difference in speech and gesture integration between human and robot communicators, being significantly less effective for the robot. In contrast to beat gestures, the effects of speech emphasis are the same whether that speech is played through a robot or as part of a video of a human. Thus, while integration of speech emphasis and verbal information do occur for robot communicators, integration of non-informative beat gestures and verbal information does not, despite comparable timing and motion profiles to human gestures.

show abstract

Section: Discussionsupporting

confidence: 83%

Section: Resultsmentioning

confidence: 98%

Speech and Gesture Emphasis Effects for Robotic and Human Communicators

Bremner

Leonards

2015

Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction

View full text Add to dashboard Cite

show abstract

“…In a subsequent experiment, enhanced memory performance was found even when participants were explicitly instructed to either gesture or not, rather than being allowed to spontaneously gesture. Stevanoni and Salmon (2005) found similar results with children, and recent studies have further investigated the influence of gestures on learning and memory (e.g., Straube et al, 2008; Macedonia et al, 2011; So et al, 2012). …”

Section: Gesture To Remembermentioning

confidence: 82%

Using actions to enhance memory: effects of enactment, gestures, and exercise on human memory

Madan¹,

Singhal²

2012

Front. Psychology

103

View full text Add to dashboard Cite

“…In the current study, the storyteller’s gestures were not scripted and, as a result, gesture type and spoken content were confounded. Different gesture types (iconic versus beat gestures) have been shown to have differential effects on children’s recall (So, Chen-Hui, & Wei-Shan, 2012), and future work needs to explore whether the type of gesture also influences children’s recall of information in the context of narrative retellings. Elicitation format had an impact on narrative production but not on narrative comprehension, as indexed by scores on our comprehension questions.…”

Section: Discussionmentioning

confidence: 99%

Narrative processing in typically developing children and children with early unilateral brain injury: Seeing gesture matters.

Demir

Fisher

Goldin‐Meadow

et al. 2014

Developmental Psychology

View full text Add to dashboard Cite

Narrative skill in kindergarteners has been shown to be a reliable predictor of later reading comprehension and school achievement. However, we know little about how to scaffold children’s narrative skill. Here we examine whether the quality of kindergarten children’s narrative retellings depends on the kind of narrative elicitation they are given. We asked this question in typically developing (TD) kindergarten children and in children with pre- or perinatal unilateral brain injury (PL), a group that has been shown to have difficulty with narrative production. We compared children’s skill in story retellings under four different elicitation formats: (1) wordless cartoons, (2) stories told by a narrator through the auditory modality, (3) stories told by a narrator through the audiovisual modality without co-speech gestures, and (4) stories told by a narrator in the audiovisual modality with co-speech gestures. We found that children told better structured narratives in the fourth, audiovisual + gesture elicitation format than in the other three elicitation formats, consistent with findings that co-speech gestures can scaffold other aspects of language and memory. The audiovisual + gesture elicitation format was particularly beneficial to children who had the most difficulty telling a well-structured narrative, a group that included children with larger lesions associated with cerebrovascular infarcts.

show abstract

Mnemonic effect of iconic gesture and beat gesture in adults and children: Is meaning in gesture important for memory recall?

Cited by 101 publications

References 61 publications

Speech and Gesture Emphasis Effects for Robotic and Human Communicators

Speech and Gesture Emphasis Effects for Robotic and Human Communicators

Using actions to enhance memory: effects of enactment, gestures, and exercise on human memory

Narrative processing in typically developing children and children with early unilateral brain injury: Seeing gesture matters.

Contact Info

Product

Resources

About