Combining VR with electroencephalography as a frontier of brain-computer interfaces

Li, Hongbian; Shin, Hyonyoung; Sentis, Luis; Siu, Ka-Chun; Millán, José del R.; Lu, Nanshu

doi:10.1016/j.device.2024.100425

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2024

2025

Publication Types

Select...

Article1

Preprint1

Relationship

Self Cite0

Independent2

Authors

Journals

Cited by 2 publications

References 96 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

Counting on AR: EEG responses to incongruent information with real-world context

Wimmer,

Pepicelli,

Volmer

et al. 2025

Computers in Biology and Medicine

View full text Add to dashboard Cite

Counting on AR: EEG responses to incongruent information with real-world context

Wimmer,

Pepicelli,

Volmer

et al. 2025

Computers in Biology and Medicine

View full text Add to dashboard Cite

Counting on AR: EEG responses to incongruent information with real-world context

Wimmer,

Pepicelli,

Volmer

et al. 2024

Preprint

View full text Add to dashboard Cite

Augmented Reality (AR) technologies enhance the real world by integrating contextual digital information about physical entities. However, inconsistencies between physical reality and digital augmentations, which may arise from errors in the visualized information or the user's mental context, can considerably impact user experience. This study characterizes the brain dynamics associated with processing incongruent information within an AR environment. We designed an interactive paradigm featuring the manipulation of a Rubik's cube serving as a physical referent. Congruent and incongruent information regarding the cube's current status was presented via symbolic (digits) and non-symbolic (graphs) stimuli, thus examining the impact of different means of data representation. The analysis of electroencephalographic (EEG) signals from 19 participants revealed the presence of centro-parietal N400 and P600 components following the processing of incongruent information, with significantly increased latencies for non-symbolic stimuli. Additionally, we explored the feasibility of exploiting incongruency effects for brain-computer interfaces. Hence, we implemented decoders using linear discriminant analysis, support vector machines, and EEGNet, achieving comparable performances with all methods. The successful decoding of incongruency-induced modulations can inform systems about the current mental state of users without making it explicit, aiming for more coherent and contextually appropriate AR interactions.

show abstract

Combining VR with electroencephalography as a frontier of brain-computer interfaces

Cited by 2 publications

References 96 publications

Counting on AR: EEG responses to incongruent information with real-world context

Counting on AR: EEG responses to incongruent information with real-world context

Counting on AR: EEG responses to incongruent information with real-world context

Contact Info

Product

Resources

About