No abstract

A fundamental question in language development is how infants start to assign meaning to words. Here, using three Electroencephalogram (EEG)-based measures of brain activity, we establish that preverbal 11-month-old infants are sensitive to the non-arbitrary correspondences between language sounds and concepts, that is, to sound symbolism. In each trial, infant participants were presented with a visual stimulus (e.g., a round shape) followed by a novel spoken word that either sound-symbolically matched ("moma") or mismatched ("kipi") the shape. Amplitude increase in the gamma band showed perceptual integration of visual and auditory stimuli in the match condition within 300 msec of word onset. Furthermore, phase synchronization between electrodes at around 400 msec revealed intensified large-scale, left-hemispheric communication between brain regions in the mismatch condition as compared to the match condition, indicating heightened processing effort when integration was more demanding. Finally, event-related brain potentials showed an increased adult-like N400 response - an index of semantic integration difficulty - in the mismatch as compared to the match condition. Together, these findings suggest that 11-month-old infants spontaneously map auditory language onto visual experience by recruiting a cross-modal perceptual processing system and a nascent semantic network within the first year of life.

In visual search tasks, the relative proportions of target-present and -absent trials have important effects on behavior. Miss error rates rise as target prevalence decreases (Wolfe, Horowitz, & Kenner, Nature 435, 439–440, 2005). At the same time, search termination times on target-absent trials become shorter (Wolfe & Van Wert, Current Biology 20, 121–124, 2010). These effects must depend on some implicit or explicit knowledge of the current prevalence. What is the nature of that knowledge? In Experiment 1, we conducted visual search tasks at three levels of prevalence (6%, 50%, and 94%) and analyzed performance as a function of “local prevalence,” the prevalence over the last n trials. The results replicated the usual effects of overall prevalence but revealed only weak or absent effects of local prevalence. In Experiment 2, the overall prevalence in a block of trials was 20%, 50%, or 80%. However, a 100%-valid cue informed observers of the prevalence on the next trial. These explicit cues had a modest effect on target-absent RTs, but explicit expectation could not explain the full prevalence effect. We conclude that observers predict prevalence on the basis of an assessment of a relatively long prior history. Each trial contributes a small amount to that assessment, and this can be modulated but not overruled by explicit instruction.

What are the relations between linguistic encoding and gestural representations of events during online speaking? The few studies that have been conducted on this topic have yielded somewhat incompatible results with regard to whether and how gestural representations of events change with differences in the preferred semantic and syntactic encoding possibilities of languages. Here we provide large scale semantic, syntactic and temporal analyses of speech-gesture pairs that depict 10 different motion events from 20 Turkish and 20 English speakers. We find that the gestural representations of the same events differ across languages when they are encoded by different syntactic frames (i.e., verb-framed or satellite-framed). However, where there are similarities across languages, such as omission of a certain element of the event in the linguistic encoding, gestural representations also look similar and omit the same content. The results are discussed in terms of what gestures reveal about the influence of language specific encoding on online thinking patterns and the underlying interactions between speech and gesture during the speaking process.