The Study of Visual-Auditory Interactions on Lower Limb Motor Imagery

Yu, Zhonghai; Li, Lili; Song, Jong-Hwa; Lv, Hangyuan

doi:10.3389/fnins.2018.00509

Cited by 10 publications

(5 citation statements)

References 60 publications

(63 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The fact that all control participants showed increases in functional connections at resting-state might suggest that their visual and auditory processing were altered following the MI practice sessions. modulation by the mirror neuron system during MI and visual-occipital stimulation (Yu et al 2018). This relationship might have been elicited during the MI practice of the control subjects, which produced the functional connectivity pattern changes observed in figures 7(A) and 8(A).…”

Section: Fmri Graphsmentioning

confidence: 82%

Motor imagery practice and feedback effects on functional connectivity

Filho¹,

Attux²,

Castellano³

2021

J. Neural Eng.

View full text Add to dashboard Cite

– Objective: the use of motor imagery (MI) in motor rehabilitation protocols has been increasingly investigated as a potential technique for enhancing traditional treatments, yielding better clinical outcomes. However, since MI performance can be challenging, practice is usually required. This demands appropriate training, actively engaging the MI-related brain areas, consequently enabling the user to properly benefit from it. The role of feedback is central for MI practice. Yet, assessing which underlying neural changes are feedback-specific or purely due to MI practice is still a challenging effort, mainly due to the difficulty in isolating their contributions. In this work, we aimed to assess functional connectivity (FC) changes following MI practice that are either extrinsic or specific to feedback. Approach: to achieve this, we investigated FC, using graph theory, in electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) data, during MI performance and at resting-state (rs), respectively. Thirty healthy subjects were divided into three groups, receiving no feedback (control), “false” feedback (sham) or actual neurofeedback (active). Participants underwent 12 to 13 hands-MI EEG sessions and pre- and post-MI training fMRI exams. Main results: following MI practice, control participants presented significant increases in degree and in eigenvector centrality for occipital nodes at rs-fMRI scans, whereas sham-feedback produced similar effects, but to a lesser extent. Therefore, MI practice, by itself, seems to stimulate visual information processing mechanisms that become apparent during basal brain activity. Additionally, only the active group displayed decreases in inter-subject FC patterns, both during MI performance and at rs-fMRI. Significance: hence, actual neurofeedback impacted FC by disrupting common inter-subject patterns, suggesting that subject-specific neural plasticity mechanisms become important. Future studies should consider this when designing experimental NFBT protocols and analyses.

show abstract

Section: Fmri Graphsmentioning

confidence: 82%

Motor imagery practice and feedback effects on functional connectivity

Filho¹,

Attux²,

Castellano³

2021

J. Neural Eng.

View full text Add to dashboard Cite

show abstract

“…A natural way of interaction is acceptable to users, which increases its usefulness in practice ( Xu et al, 2021 ). Previous studies used visual induction consistent with motor tasks to enhance LMI ability ( Boord et al, 2010 , Kitahara et al, 2017 , Yu et al, 2018 ). Additionally, kinesthetic illusion (KI) is a type of proprioception that can complement the biological control loop.…”

Section: Discussionmentioning

confidence: 99%

“…Consequently, it may be more conducive to the training and rehabilitation of most stroke patients. Previous studies have found that activated areas of the cerebral cortex are biased toward the contralateral sensorimotor cortex during performing the LMI and visual observation task ( Li et al, 2015 ; Yu et al, 2018 ). In this research ( Tariq et al, 2020 ), LDA, SVM, and KNN model were used to classify bilateral foot LMI task.…”

Section: Discussionmentioning

confidence: 99%

Enhanced lower-limb motor imagery by kinesthetic illusion

Wang

Shi

et al. 2023

Front. Neurosci.

View full text Add to dashboard Cite

Brain-computer interface (BCI) based on lower-limb motor imagery (LMI) enables hemiplegic patients to stand and walk independently. However, LMI ability is usually poor for BCI-illiterate (e.g., some stroke patients), limiting BCI performance. This study proposed a novel LMI-BCI paradigm with kinesthetic illusion(KI) induced by vibratory stimulation on Achilles tendon to enhance LMI ability. Sixteen healthy subjects were recruited to carry out two research contents: (1) To verify the feasibility of induced KI by vibrating Achilles tendon and analyze the EEG features produced by KI, research 1 compared the subjective feeling and brain activity of participants during rest task with and without vibratory stimulation (V-rest, rest). (2) Research 2 compared the LMI-BCI performance with and without KI (KI-LMI, no-LMI) to explore whether KI enhances LMI ability. The analysis methods of both experiments included classification accuracy (V-rest vs. rest, no-LMI vs. rest, KI-LMI vs. rest, KI-LMI vs. V-rest), time-domain features, oral questionnaire, statistic analysis and brain functional connectivity analysis. Research 1 verified that induced KI by vibrating Achilles tendon might be feasible, and provided a theoretical basis for applying KI to LMI-BCI paradigm, evidenced by oral questionnaire (Q1) and the independent effect of vibratory stimulation during rest task. The results of research 2 that KI enhanced mesial cortex activation and induced more intensive EEG features, evidenced by ERD power, topographical distribution, oral questionnaire (Q2 and Q3), and brain functional connectivity map. Additionally, the KI increased the offline accuracy of no-LMI/rest task by 6.88 to 82.19% (p < 0.001). The simulated online accuracy was also improved for most subjects (average accuracy for all subjects: 77.23% > 75.31%, and average F1_score for all subjects: 76.4% > 74.3%). The LMI-BCI paradigm of this study provides a novel approach to enhance LMI ability and accelerates the practical applications of the LMI-BCI system.

show abstract

“…In summary, the study shows that the pitch, volume, and vocal track alternation scheme in a joint audio-visual interaction is closely related to spatial height, distance, and direction in realistic environments. They also have a wide range of applications in the positioning, medical, and transportation fields [38][39][40]. However, there is still a gap in how to efficiently optimize spatial-visual interactions through auditory assistance in MR environments.…”

Section: Introductionmentioning

confidence: 99%

Induction Mechanism of Auditory-Assisted Vision for Target Search Localization in Mixed Reality (MR) Environments

Wang

Dang

et al. 2022

Aerospace

View full text Add to dashboard Cite

In MR (mixed reality) environments, visual searches are often used for search and localization missions. There are some problems with search and localization technologies, such as a limited field of view and information overload. They are unable to satisfy the need for the rapid and precise location of specific flying objects in a group of air and space targets under modern air and space situational requirements. They lead to inefficient interactions throughout the mission process. A human being’s decision and judgment will be affected by inefficient interactions. Based on this problem, we carried out a multimodal optimization study on the use of an auditory-assisted visual search for localization in an MR environment. In the spatial–spherical coordinate system, the target flight object position is uniquely determined by the height h, distance r, and azimuth θ. Therefore, there is an urgent need to study the cross-modal connections between the auditory elements and these three coordinates based on a visual search. In this paper, an experiment was designed to study the correlation between auditory intuitive perception and vision and the cognitive induction mechanism. The experiment included the three cross-modal mappings of pitch–height, volume–distance, and vocal tract alternation–spatial direction. The research conclusions are as follows: (1) Visual cognition is induced by high, medium, and low pitches to be biased towards the high, medium, and low spatial regions of the visual space. (2) Visual cognition is induced by loud, medium, and low volumes to be biased towards the near, middle, and far spatial regions of the visual space. (3) Based on the HRTF application, the vocal track alternation scheme is expected to significantly improve the efficiency of visual interactions. Visual cognition is induced by left short sounds, right short sounds, left short and long sounds, and right short and long sounds to be biased towards the left, right, left-rear, and right-rear directions of visual space. (4) The cognitive load of search and localization technologies is significantly reduced by incorporating auditory factors. In addition, the efficiency and effect of the accurate search and positioning of space-flying objects have been greatly improved. The above findings can be applied to the research on various types of target search and localization technologies in an MR environment and can provide a theoretical basis for the subsequent study of spatial information perception and cognitive induction mechanisms in an MR environment with visual–auditory coupling.

show abstract

The Study of Visual-Auditory Interactions on Lower Limb Motor Imagery

Cited by 10 publications

References 60 publications

Motor imagery practice and feedback effects on functional connectivity

Motor imagery practice and feedback effects on functional connectivity

Enhanced lower-limb motor imagery by kinesthetic illusion

Induction Mechanism of Auditory-Assisted Vision for Target Search Localization in Mixed Reality (MR) Environments

Contact Info

Product

Resources

About