Imagined and Executed Actions in the Human Motor System: Testing Neural Similarity Between Execution and Imagery of Actions with a Multivariate Approach

Zabicki, Adam; Haas, Benjamin de; Zentgraf, Karen; Stark, Rudolf; Munzert, Jörn; Krüger, Britta

doi:10.1093/cercor/bhw257

Cited by 64 publications

(72 citation statements)

References 65 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…To investigate shared representations between auditory motion directions and sound source locations, we created multiple computational models ranging from a fully condition-distinct model to a fully condition-invariant model with intermediate gradients in between (Zabicki et al, 2017; see Fig. 4C).…”

Section: Computational Modelsmentioning

confidence: 99%

Representation of Auditory Motion Directions and Sound Source Locations in the Human Planum Temporale

et al. 2019

View full text Add to dashboard Cite

The ability to compute the location and direction of sounds is a crucial perceptual skill to efficiently interact with dynamic environments. How the human brain implements spatial hearing is, however, poorly understood. In our study, we used fMRI to characterize the brain activity of male and female humans listening to sounds moving left, right, up, and down as well as static sounds. Whole-brain univariate results contrasting moving and static sounds varying in their location revealed a robust functional preference for auditory motion in bilateral human planum temporale (hPT). Using independently localized hPT, we show that this region contains information about auditory motion directions and, to a lesser extent, sound source locations. Moreover, hPT showed an axis of motion organization reminiscent of the functional organization of the middle-temporal cortex (hMTϩ/V5) for vision. Importantly, whereas motion direction and location rely on partially shared pattern geometries in hPT, as demonstrated by successful cross-condition decoding, the responses elicited by static and moving sounds were, however, significantly distinct. Altogether, our results demonstrate that the hPT codes for auditory motion and location but that the underlying neural computation linked to motion processing is more reliable and partially distinct from the one supporting sound source location. Significance StatementCompared with what we know about visual motion, little is known about how the brain implements spatial hearing. Our study reveals that motion directions and sound source locations can be reliably decoded in the human planum temporale (hPT) and that they rely on partially shared pattern geometries. Our study, therefore, sheds important new light on how computing the location or direction of sounds is implemented in the human auditory cortex by showing that those two computations rely on partially shared neural codes. Furthermore, our results show that the neural representation of moving sounds in hPT follows a "preferred axis of motion" organization, reminiscent of the coding mechanisms typically observed in the occipital middle-temporal cortex (hMTϩ/V5) region for computing visual motion.

show abstract

Section: Computational Modelsmentioning

confidence: 99%

Representation of Auditory Motion Directions and Sound Source Locations in the Human Planum Temporale

et al. 2019

View full text Add to dashboard Cite

show abstract

“…An interesting next step could now involve a more in-depth examination using multi-voxel pattern analysis (MVPA) of fMRI data into the precise anatomical substrates involved for different AO+MI states. Pilgramm et al (2016) recently used MVPA to discriminate between different types of imagined actions purely on the basis of brain activity recorded in frontal and parietal areas, while Zabicki et al (2016) distinguished between different action types within two modalities (imagined and executed). Furthermore, Filimon et al (2015) also decoded the neural signatures for independent AO, MI and execution of a reaching action within brain areas jointly activated by all three modalities.…”

Section: Conceptualizing Concurrent Action Observation and Motor Imagmentioning

confidence: 99%

Motor Imagery during Action Observation: A Brief Review of Evidence, Theory and Future Research Opportunities

et al. 2016

View full text Add to dashboard Cite

Motor imagery (MI) and action observation (AO) have traditionally been viewed as two separate techniques, which can both be used alongside physical practice to enhance motor learning and rehabilitation. Their independent use has largely been shown to be effective, and there is clear evidence that the two processes can elicit similar activity in the motor system. Building on these well-established findings, research has now turned to investigate the effects of their combined use. In this article, we first review the available neurophysiological and behavioral evidence for the effects of combined action observation and motor imagery (AO+MI) on motor processes. We next describe a conceptual framework for their combined use, and then discuss several areas for future research into AO+MI processes. In this review, we advocate a more integrated approach to AO+MI techniques than has previously been adopted by movement scientists and practitioners alike. We hope that this early review of an emergent body of research, along with a related set of research questions, can inspire new work in this area. We are optimistic that future research will further confirm if, how, and when this combined approach to AO+MI can be more effective in motor learning and rehabilitation settings, relative to the more traditional application of MI or AO independently.

show abstract

“…We computed the upper boundary of these noise ceilings by calculating the mean correlation of each individual's data vector as acquired from their performance difference matrix (see above) with the average data vector across all participants. For the lower boundary, performance difference vectors as acquired from individual difference vectors were correlated with the average difference matrix of all other participants, but excluding the current individual ( [44], [45], see Table 3).…”

Section: Plos Onementioning

confidence: 99%

Contrast versus identity encoding in the face image follow distinct orientation selectivity profiles

Jacobs¹,

Petras

Moors

et al. 2020

PLoS ONE

View full text Add to dashboard Cite

Orientation selectivity is a fundamental property of primary visual encoding. High-level processing stages also show some form of orientation dependence, with face identification preferentially relying on horizontally-oriented information. How high-level orientation tuning emerges from primary orientation biases is unclear. In the same group of participants, we derived the orientation selectivity profile at primary and high-level visual processing stages using a contrast detection and an identity matching task. To capture the orientation selectivity profile, we calculated the difference in performance between all tested orientations (0, 45, 90, and 135˚) for each task and for upright and inverted faces, separately. Primary orientation selectivity was characterized by higher sensitivity to oblique as compared to cardinal orientations. The orientation profile of face identification showed superior horizontal sensitivity to face identity. In each task, performance with upright and inverted faces projected onto qualitatively similar a priori models of orientation selectivity. Yet the fact that the orientation selectivity profiles of contrast detection in upright and inverted faces correlated significantly while such correlation was absent for identification indicates a progressive dissociation of orientation selectivity profiles from primary to high-level stages of orientation encoding. Bayesian analyses further indicate a lack of correlation between the orientation selectivity profiles in the contrast detection and face identification tasks, for upright and inverted faces. From these findings, we conclude that orientation selectivity shows distinct profiles at primary and high-level stages of face processing and that a transformation must occur from general cardinal attenuation when processing basic properties of the face image to horizontal tuning when encoding more complex properties such as identity.

show abstract

Imagined and Executed Actions in the Human Motor System: Testing Neural Similarity Between Execution and Imagery of Actions with a Multivariate Approach

Cited by 64 publications

References 65 publications

Representation of Auditory Motion Directions and Sound Source Locations in the Human Planum Temporale

Representation of Auditory Motion Directions and Sound Source Locations in the Human Planum Temporale

Motor Imagery during Action Observation: A Brief Review of Evidence, Theory and Future Research Opportunities

Contrast versus identity encoding in the face image follow distinct orientation selectivity profiles

Contact Info

Product

Resources

About