Fronto-parietal mirror neuron system modeling: Visuospatial transformations support imitation learning independently of imitator perspective

Oh, Hyuk; Braun, Allen R.; Reggia, James A.; Gentili, Rodolphe J.

doi:10.1016/j.humov.2018.05.013

Cited by 13 publications

(8 citation statements)

References 129 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…their own right side in anticipating that the agent would-from her perspective-go to the left-side box, and that adults leaned to their own left side when anticipating that the agent would-from her perspective-go to the right-side box, fits with computational and conceptual models suggesting that motor representations and processes may be able to remap the agent's allocentric frame of reference into subjects' own egocentric frame of reference [35]. There are, however, studies showing that the link between action observation/prediction and action execution can be motorically mapped in some somatotopic manner (e.g.…”

Section: Discussionsupporting

confidence: 59%

“…Numbers of participants in the TB and FB conditions (n = 23 and n = 18, respectively) who provided fact-based, ability-based or mental-state-based reasons for the questions that sought explanations of why they went to open one box and did not go to open the alternative box. One participant in the TB condition did not answer these questions, and hence the coding of reasons in TB condition was based on data from 23 their own right side in anticipating that the agent would-from her perspective-go to the left-side box, and that adults leaned to their own left side when anticipating that the agent would-from her perspective-go to the right-side box, fits with computational and conceptual models suggesting that motor representations and processes may be able to remap the agent's allocentric frame of reference into subjects' own egocentric frame of reference [35]. There are, however, studies showing that the link between action observation/prediction and action execution can be motorically mapped in some somatotopic manner (e.g.…”

Section: Discussionsupporting

confidence: 58%

See 1 more Smart Citation

Mindreading in the balance: adults' mediolateral leaning and anticipatory looking foretell others’ action preparation in a false-belief interactive task

2020

View full text Add to dashboard Cite

Anticipatory looking on mindreading tasks can indicate our expectation of an agent's action. The challenge is that social situations are often more complex, involving instances where we need to track an agent's false belief to successfully identify the outcome to which an action is directed. If motor processes can guide how action goals are understood, it is conceivable—where that kind of goal ascription occurs in false-belief tasks—for motor representations to account for someone's belief-like state. Testing adults ( N = 42) in a real-time interactive helping scenario, we discovered that participants' early mediolateral motor activity (leftwards–rightwards leaning on balance board) foreshadowed the agent's belief-based action preparation. These results suggest fast belief-tracking can modulate motor representations generated in the course of one's interaction with an agent. While adults' leaning, and anticipatory looking, revealed the contribution of fast false-belief tracking, participants did not correct the agent's mistake in their final helping action. These discoveries suggest that adults may not necessarily use another's belief during overt social interaction or find reflecting on another's belief as being normatively relevant to one's own choice of action. Our interactive task design offers a promising way to investigate how motor and mindreading processes may be variously integrated.

show abstract

Section: Discussionsupporting

confidence: 59%

Section: Discussionsupporting

confidence: 58%

Mindreading in the balance: adults' mediolateral leaning and anticipatory looking foretell others’ action preparation in a false-belief interactive task

2020

View full text Add to dashboard Cite

show abstract

“…In the FB condition, adults leaned towards the empty box; and in the TB condition, they leaned towards the full box. The fact that adults leaned to their own right side in anticipating that the agent would -from her perspective -go to the left-side box, and that adults leaned to their own left side when anticipating that the agent would -from her perspective -go to the right-side box, fits with computational and conceptual models suggesting that motor representations and processes may be able to remap the agent's allocentric frame of reference into subjects' own egocentric frame of reference (Oh, Braun, Reggia, & Gentili, 2019). There are, however, studies showing that the link between action observation/prediction and action execution can be motorically mapped in some somatotopic manner (e.g., see Fadiga, Craighero, and Olivier (2005) for a review).…”

Section: Discussionsupporting

confidence: 58%

Action Prediction: a Multimodal Techniques Investigation of the Functional Relationship Between Belief-Tracking and Motor Processes

Zani¹

View full text Add to dashboard Cite

<p>Anticipatory responses during action observation can indicate our expectation of an agent’s goals. The challenge is that social situations are often more complex, involving instances where we need to perceive and track an agent’s false belief to successfully identify and interpret the outcome to which an action is directed. One theoretical possibility is that if motor processes can guide how action goals are understood, it is conceivable—where that kind of goal ascription occurs in false-belief tasks—for motor representations to account for someone’s belief-like state. Multiple experiments were conducted to test that possibility. In Experiment 1A, adults (N = 42) were tested in a real-time interactive helping scenario, and the results showed that participants’ early mediolateral motor activity (leftwards–rightwards leaning on a balance board) and anticipatory gaze foreshadowed the agent’s belief-based action preparation. In Experiment 1B, adults (N = 39) did not show sensitivity to belief in their leaning or eye gaze when participants had to work out the chain of inferences governing the agent’s actions. The combined results suggest that small changes in the context can affect adults’ ability to spontaneously anticipate and to motorically represent an agent’s action. Experiment 2 presented the interactive helping scenario as a multi-trial computerized task. Experiment 2 measured the dynamics of adults’ leaning as well as hand trajectories as they attempted to reach a target object whilst an agent had a true or false belief about the object’s location (as a manipulation of motor representations, the agent was also shown as being motorically able or unable to grasp the target object). Replicating Experiment 1A, adults’ mediolateral balance during the action anticipation stage took into consideration an agent’s false- and true-belief about the target’s location. However, there was no evidence that the hand trajectories participants produced to provide a response were influenced by the agent’s beliefs. Manipulation of the agent’s ability to move did not affect participant’s mediolateral balance or the dynamics of their hand trajectories. While in Experiments 1A, 1B and 2, participants were shown the outcome to which the agent’s action was directed, in Experiments 3A (N = 51 adults), the task context was changed so that the agent did not present any outcome-directed action and participants were simply instructed to click as fast as possible on the box containing the target object. Experiment 3B (N = 55 adults) was the same as Experiment 3A, except that the task was presented in a go/no-go format. In Experiment 3A, there was no evidence that the agent’s belief influenced the degree to which participants’ mouse-movement trajectories deviated from a direct path to the object location. In Experiment 3B, the agent’s belief had a puzzling effect; participants’ mouse movements showed a more conspicuous attraction towards the full box (containing the target object) when the agent had a false-belief as compared to when the agent had a true-belief. While adults’ leaning, anticipatory looking and, more tentatively, hand movements, revealed some contribution of fast false-belief tracking, participants across the various experiments did not consistently correct the agent’s belief-induced mistake in their final helping action. This thesis will discuss the extent to which motor and mindreading processes may be variously integrated, and that adults may not necessarily use another’s belief during overt social interaction or find reflecting on another’s belief as being normatively relevant to one’s own choice of action.</p>

show abstract

“…The SPL has previously been reported to be activated during both action observation and execution (Rizzolatti et al, 2014) and is considered to play a critical role in mental rotation and spatial transformation (Buneo and Andersen, 2006; Lamm et al, 2007). Oh et al’s (2019) model indicated that the SPL may be involved in visuospatial transformation, allowing the MNS to observe and imitate actions independently of demonstrator-imitator spatial relationships.…”

Section: Discussionmentioning

confidence: 99%

Neural Activity and Decoding of Action Observation Using Combined EEG and fNIRS Measurement

Wang

Liu

et al. 2019

Front. Hum. Neurosci.

View full text Add to dashboard Cite

In a social world, observing the actions of others is fundamental to understanding what they are doing, as well as their intentions and feelings. Studies of the neural basis and decoding of action observation are important for understanding action-related processes and have implications for cognitive, social neuroscience, and human-machine interaction (HMI). In the current study, we first investigated temporal-spatial dynamics during action observation using a combined 64-channel electroencephalography (EEG) and 48-channel functional near-infrared spectroscopy (fNIRS) system. We measured brain activation while 16 healthy participants observed three action tasks: (1) grasping a cup with the intention of drinking; (2) grasping a cup with the intention of moving it; and (3) touching a cup with an unclear intention. The EEG and fNIRS source analysis results revealed the dynamic involvement of both the mirror neuron system (MNS) and the theory of mind (ToM)/mentalizing network during action observation. The source analysis results suggested that the extent to which these two systems were engaged was determined by the clarity of the intention of the observed action. Based on the difference in neural activity observed among different action-observation tasks in the first experiment, we conducted a second experiment to classify the neural processes underlying action observation using a feature classification method. We constructed complex brain networks based on the EEG and fNIRS data. Fusing features from both EEG and fNIRS complex brain networks resulted in a classification accuracy of 72.7% for the three action observation tasks. This study provides a theoretical and empirical basis for elucidating the neural mechanisms of action observation and intention understanding, and a feasible method for decoding the underlying neural processes.

show abstract

Fronto-parietal mirror neuron system modeling: Visuospatial transformations support imitation learning independently of imitator perspective

Cited by 13 publications

References 129 publications

Mindreading in the balance: adults' mediolateral leaning and anticipatory looking foretell others’ action preparation in a false-belief interactive task

Mindreading in the balance: adults' mediolateral leaning and anticipatory looking foretell others’ action preparation in a false-belief interactive task

Action Prediction: a Multimodal Techniques Investigation of the Functional Relationship Between Belief-Tracking and Motor Processes

Neural Activity and Decoding of Action Observation Using Combined EEG and fNIRS Measurement

Contact Info

Product

Resources

About