Putting Language Back in the Body: Speech and Gesture on Three Time Frames

Abstract

This article investigates the role that nonverbal actions play in language processing over 3 different time frames. First, we speculate that nonverbal actions played a role in how formal language systems emerged from our primate ancestors over evolutionary time. Next, we hypothesize that if nonverbal behaviors played a foundational role in the emergence of language over evolution, these actions should influence how children learn language in the present. Finally, we argue that nonverbal actions continue to play a role for adults in the moment-to-moment processing of language. Throughout, we take an embodied view of language and argue that the neural, cognitive, and social components of language processing are firmly grounded in bodily action.Human language is special because it is at the pinnacle of the mind's capabilities and is most notably what separates our minds from the minds of other thinking animals. Language is so special, in fact, that many people have argued that there is a designated language device built into the human brain at birth. These views, madeRequests for reprints should be sent to

Integrating Speech and Iconic Gestures in a Stroop-like Task: Evidence for Automatic Processing

“…This interest is fueled by the discovery that language shares neural substrates that are involved in more basic processes such as the production and the perception of action (Nishitani, Schurmann, Amunts, & Hari, 2005;Rizzolatti & Craighero, 2004;Rizzolatti & Arbib, 1998). These findings have led many researchers to view language as an ability that grew out of action systems in our evolutionary past (Armstrong & Wilcox, 2007;Corballis, 2003;Kelly et al, 2002), or as Elizabeth Bates so eloquently put it, "[as] a new machine that nature has constructed out of old parts" (MacWhinney & Bates, 1989;Bates, Benigni, Bretherton, Camaioni, & Volterra, 1979). Taking this embodied view that language is inextricably tied to action in present day communication, the current article investigates the strength of this relationship by focusing on a potential interface between the two systems: cospeech iconic gesture.…”

Considering the role of social dynamics and positional behavior in gestural communication research

“…A growing body of research has also shown that neural networks involved in language production and comprehension are active during body movements and gesture production and processing, and these networks have correlates in non-human primates [e.g., Arbib, 2005;Perrett et al, 1985]. Collectively, these findings demonstrate evolutionary continuity between language and motor actions in primates [Arbib, 2005;Kelly et al, 2002] as well as illustrate an important feature of gestural signaling-that body movements are inherently connected to language comprehension and production. The question now becomes: what can we learn about the origins and evolution of human language by studying the gestural communication of African apes and how can we best investigate this connection?…”

“…Using the upper limbs, perhaps along with facial expressions, communication could be achieved between group members over long distances without drawing attention from predators like vocalizations potentially could. Kelly et al [2002] argue that "the original functions of communication and language systems were perfectly suited for the body, and that the body continued to shape language over time [324]." Donald [1991] contends that the transition to obligate bipedality could have sparked the development of "mimetic culture," in which pantomimes of the hands and body were used to communicate about external events.…”

“…In humans and monkeys, this region is also active during facial and forearm movements [Kelly et al, 2002]. Furthermore, Xu et al [2009] found that symbolic gestures (i.e., pantomimes and emblems that signify actions or objects and stand alone without speech) are processed by the same neural system as spoken language.…”

52. Experimental methods in co-speech gesture research

“…One aspect of this debate focuses on the function(s) of co-speech gestures and the idea that they may not necessarily be communicatively intended, but, rather, benefit the speaker him or herself (such as through the facilitation of lexical access (e.g., Krauss, Chen, and Gottesman 2000;Rauscher, Krauss, and Chen 1996) or conceptual planning (e.g., Hostetter, Alibali, and Kita 2007;Kita and Davies 2009)). A more overarching question, then, is why we gesture when we speak -which, in addition to the discussion about inter-and intrapersonal functions of gesture, also addressees the evolutionary roots and development of co-speech gestures and language (Corballis 2003;Kelly et al 2002;Rizzolatti and Arbib 1998;Tomasello 2008). …”