A Literature Review on a Neuro-Psychological Approach to Immersive Technology Research

Wang, Guan; Suh, Ayoung

doi:10.1007/978-3-030-78114-9_8

Cited by 6 publications

(6 citation statements)

References 107 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, as the author pointed out, this survey covered a limited number of previous studies in the review. Wang and Suh (2021) also emphasized the significance of the EEG approach in immersive technology including augmented reality, virtual reality, and mixed reality. Instead of focusing on cybersickness-related brain activity, their survey reviewed a broader range of users' states such as mental load, embodiment, postural control, etc.…”

Section: Related Workmentioning

confidence: 99%

Brain activity during cybersickness: a scoping review

Chang

Billinghurst

2023

Virtual Reality

View full text Add to dashboard Cite

Virtual reality (VR) experiences can cause a range of negative symptoms such as nausea, disorientation, and oculomotor discomfort, which is collectively called cybersickness. Previous studies have attempted to develop a reliable measure for detecting cybersickness instead of using questionnaires, and electroencephalogram (EEG) has been regarded as one of the possible alternatives. However, despite the increasing interest, little is known about which brain activities are consistently associated with cybersickness and what types of methods should be adopted for measuring discomfort through brain activity. We conducted a scoping review of 33 experimental studies in cybersickness and EEG found through database searches and screening. To understand these studies, we organized the pipeline of EEG analysis into four steps (preprocessing, feature extraction, feature selection, classification) and surveyed the characteristics of each step. The results showed that most studies performed frequency or time-frequency analysis for EEG feature extraction. A part of the studies applied a classification model to predict cybersickness indicating an accuracy between 79 and 100%. These studies tended to use HMD-based VR with a portable EEG headset for measuring brain activity. Most VR content shown was scenic views such as driving or navigating a road, and the age of participants was limited to people in their 20 s. This scoping review contributes to presenting an overview of cybersickness-related EEG research and establishing directions for future work.

show abstract

Section: Related Workmentioning

confidence: 99%

Brain activity during cybersickness: a scoping review

Chang

Billinghurst

2023

Virtual Reality

View full text Add to dashboard Cite

show abstract

“…Their ERP-based classification reached an accuracy of 77%, whereas classification based on behavioral data barely exceeded chance level (55%). This illustrates the enormous potential of using EEG for unobtrusive continuous evaluation of VR environments (Wang & Suh, 2021).…”

Section: Discussionmentioning

confidence: 84%

“…A challenge with this approach is that transient changes in psychophysiological indicators on the order of seconds or several hundreds of milliseconds are ambiguous: Instead of breaks in presence, they could be due to more unspecific variations in user state such as amount of physical activity, mental workload, or level of attention. To avoid these interpretational ambiguities, it is desirable to develop a measurement approach that maintains the advantage of an unobtrusive online evaluation with psychophysiological measures while increasing the specificity of the inference (Wang & Suh, 2021).…”

Section: Introductionmentioning

confidence: 99%

Using event-related brain potentials to evaluate motor-auditory latencies in virtual reality

Feder¹,

Miksch²,

Grimm³

et al. 2023

Preprint

View full text Add to dashboard Cite

Actions in the real world have immediate sensory consequences. Mimicking these in digital environments is within reach, but technical constraints usually impose a certain latency (delay) between user actions and system responses. It is important to assess the impact of this latency on the users, ideally with measurement techniques that do not interfere with their digital experience. One such unobtrusive technique is electroencephalography (EEG), which can capture the users’ brain activity associated with motor responses and sensory events by extracting event-related potentials (ERPs) from the continuous EEG recording. Here we exploit the fact that the amplitude of sensory ERP components (specifically, N1 and P2) reflects the degree to which the sensory event was perceived as an expected consequence of an own action (self-generation effect). Participants (N=24) elicit auditory events in a virtual-reality (VR) setting by entering codes on virtual keypads to open doors. In a within-participant design, the delay between user input and sound presentation is manipulated across blocks. Occasionally, the virtual keypad is operated by a simulated robot instead, yielding a control condition with externally generated sounds. Results show that N1 (but not P2) amplitude is reduced for self-generated relative to externally generated sounds, and P2 (but not N1) amplitude is modulated by delay of sound presentation in a graded manner. This dissociation between N1 and P2 effects maps back to basic research on self-generation of sounds. We suggest P2 amplitude as a candidate read-out to assess the quality and immersiveness of digital environments with respect to system latency.

show abstract

“…The electrodes to take EEG are usually placed according to the International 10–20 System, and the continuous signal is decomposed into several frequency bands, including delta waves (1–4 Hz), theta waves (4–8 Hz), alpha waves (8–13 Hz), beta waves (13–30 Hz) and gamma waves (30‐Hz) although definitions slightly vary depending on the source (Abo‐Zahhad et al, 2015; Ameera et al, 2019; Antoniou et al, 2020; Seeling, 2017). Each band is also associated with a certain mental state: delta with deep sleep, theta with meditation, alpha with relaxation and beta with arousal (Wang & Suh, 2021).…”

Section: Resultsmentioning

confidence: 99%

Measuring cognitive load in augmented reality with physiological methods: A systematic review

Suzuki,

Wild,

Scanlon

2023

Computer Assisted Learning

View full text Add to dashboard Cite

BackgroundCognitive load during AR use has been measured conventionally by performance tests and subjective rating. With the growing interest in physiological measurement using non‐invasive biometric sensors, unbiased real‐time detection of cognitive load in AR is expected. However, a range of sensors and parameters are used in various subject fields, and reported results are fragmented.ObjectivesThe aim of this review is to analyse systematically how physiological methods have been used to measure cognitive load and what the implications are for the future research on AR‐based tools.MethodsThis paper took the systematic review approach. Through screening with 10 exclusion criteria, 23 studies, that contain 3 key elements: AR‐based intervention, cognitive state examination and physiological methods, were identified, analysed and synthesised.ResultsPhysiological methods in their current form require reference to provide meaningful interpretations and suggestions. Therefore, they are often combined with conventional methods. Many studies investigate the effect of wearable devices in comparison with non‐AR stimuli, which has been controversial, but detection of different causes of cognitive load are on the horizon. Eye‐tracking is the method most used and most consistent in the use of its parameters.ConclusionsA multi‐method approach combining two or more evaluation instruments is essential for the validation of users' cognitive state. In addition to the AR stimuli in question, having another independent variable such as task difficulty in experiment design is useful. Statistical approaches with more data input could help establish a reliable scale. The future research should attempt to dissociate cognitive load caused by different effects such as device, instruction, and other AR techniques as well as intrinsic and extraneous aspects, in a better experimental setup with multiple parameters.

show abstract

A Literature Review on a Neuro-Psychological Approach to Immersive Technology Research

Cited by 6 publications

References 107 publications

Brain activity during cybersickness: a scoping review

Brain activity during cybersickness: a scoping review

Using event-related brain potentials to evaluate motor-auditory latencies in virtual reality

Measuring cognitive load in augmented reality with physiological methods: A systematic review

Contact Info

Product

Resources

About