Shared neural and cognitive mechanisms in action and language: The multiscale information transfer framework

Abstract

This review compares how humans process action and language sequences produced by other humans. On the one hand, we identify commonalities between action and language processing in terms of cognitive mechanisms (e.g., perceptual segmentation, predictive processing, integration across multiple temporal scales), neural resources (e.g., the left inferior frontal cortex), and processing algorithms (e.g., comprehension based on changes in signal entropy). On the other hand, drawing on sign language with its particularly strong motor component, we also highlight what differentiates (both oral and signed) linguistic communication from nonlinguistic action sequences. We propose the multiscale information transfer framework (MSIT) as a way of integrating these insights and highlight directions into which future empirical research inspired by the MSIT framework might fruitfully evolve. This article is categorized under: Psychology > Language Linguistics > Language in Mind and Brain Psychology > Motor Skill and Performance Psychology > Prediction

Age of sign language acquisition has lifelong effect on syntactic preferences in sign language users

“…As sign language input is quantitatively different from nonlinguistic biological motion that humans can be exposed to (Blumenthal-Drame & Malaia, 2018; Borneman et al, 2018; Malaia et al, 2016), the reliance on semantics for communication in later learners might suggest that there are limits to neuroplasticity as the brain matures. The results of the study highlight the importance of comprehensive analysis of language proficiency at the interfaces between multiple linguistic domains to better understand the processes that underlie language acquisition.…”

Syllable as a unit of information transfer in linguistic communication: The entropy syllable parsing model

“…The findings demonstrate that the cortical tracking of spectro‐temporal entropy of the signal is a modality‐independent mechanism for event segmentation for communication, or syllable parsing, in humans. Such results point to the likelihood of modality‐independent evolution of language based on cortical entrainment that facilitates scene segmentation, and action perception and production (Blumenthal‐Dramé & Malaia, ).…”

“…Oscillatory activity of the brain, and the mechanisms of entrainment (to a stationary external stimulus) and phase re-setting (to an incoming stimulus) are crucial to both cognition and language (Giraud & Poeppel, 2012). Various frequencies of human brain activity, including delta (~2 Hz), theta (4 Hz), and gamma (<30 Hz), have been implicated in linguistic processing (Gross et al, 2013), which proceeds on multiple timescales simultaneously-compare, for example, the <1 Hz envelope of intonation versus~4 Hz envelope of syllabic parsing (Blumenthal-Dramé & Malaia, 2018). However, multiple studies of intelligibility parameters indicate that the temporal granularity of 4 Hz is crucial to syllabic parsing, which appears to be an indispensable step in language comprehension.…”

VirtEl - Software for Magnetic Encephalography Data Analysis by the Method of Virtual Electrodes

“…Основная идея метода изучения деятельности мозга фМРТ [12,13] заключается в том, что потоки крови и собственно мозговая активность связаны. Если какая-то область мозга начинает более активно работать, туда приливает кровь, и это можно измерить.…”