Sensorimotor experience and verb-category mapping in human sensory, motor and parietal neurons

Abstract

Semantic grounding is the process of relating meaning to symbols (e.g., words). It is the foundation for creating a representational symbolic system such as language. Semantic grounding for verb meaning is hypothesized to be achieved through two mechanisms: sensorimotor mapping, i.e., directly encoding the sensorimotor experiences the verb describes, and verb-category mapping, i.e., encoding the abstract category a verb belongs to. These two mechanisms were investigated by examining neuronal-level spike (i.e. neuronal action potential) activities from the motor, somatosensory and parietal areas in two human participants. Motor and a portion of somatosensory neurons were found to be involved in primarily sensorimotor mapping, while parietal and some somatosensory neurons were found to be involved in both sensorimotor and verb-category mapping. The time course of the spike activities and the selective tuning pattern of these neurons indicate that they belong to a large neural network used for semantic processing. This study is the first step towards understanding how words are processed by neurons.

Neural Encoding of Felt and Imagined Touch Within Human Posterior Parietal Cortex

“…This will be a subject of future investigation. A conjecture is that neural activity during the cue-delay and imagery epochs may reflect a combination of semantic processing of the verbal cue, sensory memory, sensory anticipation of a tactile stimulus, and imagery itself (4,7,65). An involvement of semantic processing is especially likely as we recently reported processing of read action verbs within the same neuronal population (7).…”

Six Challenges for Embodiment Research

“…Intracranial recordings deliver high temporal and spatial resolution that, in combination with MVPA, can be used to put specific hypotheses to the test. In rare cases, MVPA can be done at the single neuron level, making it possible to test whether sensorimotor neurons are also tuned to sensorimotor aspects of word meanings (Yang et al, 2017), which constitutes a direct test of the simulation hypothesis in its strongest form.…”

The Story So Far: How Embodied Cognition Advances Our Understanding of Meaning-Making

“…Hence, more abstract categorization of biological and artifact concepts might emerge at the intersection of the ventral or dorsal stream and the sensorimotor cortex, respectively. Yang et al (2017) measured neuronal spike activity in sensorimotor cortex and adjacent parietal regions during an action verb reading task. The researchers observed a gradual shift from neurons predominantly exhibiting verb meaning mapping in sensorimotor cortex to abstract verb category processing by neurons in parietal regions.…”