A preliminary quantitative EEG study on Augmented Reality Guidance of Manual Tasks

Rho, Gianluca; Callara, Alejandro Luis; Condino, Sara; Ghiasi, Shadi; Nardelli, M.; Carbone, Marina; Ferrari, Vincenzo; Greco, Alberto; Scilingo, Enzo Pasquale

doi:10.1109/memea49120.2020.9137171

Cited by 9 publications

(11 citation statements)

References 26 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Besides, AR supported manual task guidance inside the peripersonal space is associated with vergence-accomodation-conflict (e.g., when the virtual content is inconsistent with the real world) and focus-rivalry (e.g., when simultaneously focusing on real and virtual content). These common perceptual conflicts experienced in artificial environments may impair the performance due to visual fatigue and mental workload, especially with increased task difficulty as recently suggested by preliminary data on EEG recordings during AR use (69).…”

Section: Discussionmentioning

confidence: 91%

Improvement of Apraxia With Augmented Reality: Influencing Pantomime of Tool Use via Holographic Cues

et al. 2021

View full text Add to dashboard Cite

Background: Defective pantomime of tool use is a hall mark of limb apraxia. Contextual information has been demonstrated to improve tool use performance. Further, knowledge about the potential impact of technological aids such as augmented reality for patients with limb apraxia is still scarce.Objective: Since augmented reality offers a new way to provide contextual information, we applied it to pantomime of tool use. We hypothesize that the disturbed movement execution can be mitigated by holographic stimulation. If visual stimuli facilitate the access to the appropriate motor program in patients with apraxia, their performance should improve with increased saliency, i.e., should be better when supported by dynamic and holographic cues vs. static and screen-based cues.Methods: Twenty one stroke patients and 23 healthy control subjects were randomized to mime the use of five objects, presented in two Environments (Screen vs. Head Mounted Display, HMD) and two Modes (Static vs. Dynamic) resulting in four conditions (ScreenStat, ScreenDyn, HMDStat, HMDDyn), followed by a real tool demonstration. Pantomiming was analyzed by a scoring system using video recordings. Additionally, the sense of presence was assessed using a questionnaire.Results: Healthy control participants performed close to ceiling and significantly better than patients. Patients achieved significantly higher scores with holographic or dynamic cues. Remarkably, when their performance was supported by animated holographic cues (e.g., striking hammer), it did not differ significantly from real tool demonstration. As the sense of presence increases with animated holograms, so does the pantomiming.Conclusion: Patients' performance improved with visual stimuli of increasing saliency. Future assistive technology could be implemented upon this knowledge and thus, positively impact the rehabilitation process and a patient's autonomy.

show abstract

Section: Discussionmentioning

confidence: 91%

Improvement of Apraxia With Augmented Reality: Influencing Pantomime of Tool Use via Holographic Cues

et al. 2021

View full text Add to dashboard Cite

show abstract

“…This could include, but is not limited to, the mental work needed to adjust between the virtual and physical images in the same visual frame (Xi et al 2022;Jeffri and Awang Rambli 2021). The additional mental workload would arise from not only processing (in the brain) the additional dynamism in the 3D imagery corresponding to vasculature that is input in the field of vision as the AR imagery for the user as a visual aid, but also fatigue arising from having the physical weight of the AR head-mounted display on the user (Buchner et al 2022;Rho et al 2020). This additional mental workload can be further evaluated to quantify its impact on user task performance in the future.…”

Section: Discussionmentioning

confidence: 99%

A mixed reality system combining augmented reality, 3D bio-printed physical environments and inertial measurement unit sensors for task planning

Kabuye

LeDuc²,

Cagan³

2023

Virtual Reality

View full text Add to dashboard Cite

Successful surgical operations are characterized by preplanning routines to be executed during actual surgical operations. To achieve this, surgeons rely on the experience acquired from the use of cadavers, enabling technologies like virtual reality (VR) and clinical years of practice. However, cadavers, having no dynamism and realism as they lack blood, can exhibit limited tissue degradation and shrinkage, while current VR systems do not provide amplified haptic feedback. This can impact surgical training increasing the likelihood of medical errors. This work proposes a novel Mixed Reality Combination System (MRCS) that pairs Augmented Reality (AR) technology and an inertial measurement unit (IMU) sensor with 3D printed, collagen-based specimens that can enhance task performance like planning and execution. To achieve this, the MRCS charts out a path prior to a user task execution based on a visual, physical, and dynamic environment on the state of a target object by utilizing surgeon-created virtual imagery that, when projected onto a 3D printed biospecimen as AR, reacts visually to user input on its actual physical state. This allows a real-time user reaction of the MRCS by displaying new multi-sensory virtual states of an object prior to performing on the actual physical state of that same object enabling effective task planning. Tracked user actions using an integrated 9-Degree of Freedom IMU demonstrate task execution This demonstrates that a user, with limited knowledge of specific anatomy, can, under guidance, execute a preplanned task. In addition, to surgical planning, this system can be generally applied in areas such as construction, maintenance, and education.

show abstract

“…However, the rationale behind their choice of only two channels is unclear, and the statistical significance is not presented. Rho et al reported that EEG power does not change with or without AR HMD during dot connecting task for none of alpha, beta and theta frequency bands in eight brain regions of their interest (Rho et al, 2020).…”

Section: Eegmentioning

confidence: 97%

Measuring cognitive load in augmented reality with physiological methods: A systematic review

Suzuki,

Wild,

Scanlon

2023

Computer Assisted Learning

View full text Add to dashboard Cite

BackgroundCognitive load during AR use has been measured conventionally by performance tests and subjective rating. With the growing interest in physiological measurement using non‐invasive biometric sensors, unbiased real‐time detection of cognitive load in AR is expected. However, a range of sensors and parameters are used in various subject fields, and reported results are fragmented.ObjectivesThe aim of this review is to analyse systematically how physiological methods have been used to measure cognitive load and what the implications are for the future research on AR‐based tools.MethodsThis paper took the systematic review approach. Through screening with 10 exclusion criteria, 23 studies, that contain 3 key elements: AR‐based intervention, cognitive state examination and physiological methods, were identified, analysed and synthesised.ResultsPhysiological methods in their current form require reference to provide meaningful interpretations and suggestions. Therefore, they are often combined with conventional methods. Many studies investigate the effect of wearable devices in comparison with non‐AR stimuli, which has been controversial, but detection of different causes of cognitive load are on the horizon. Eye‐tracking is the method most used and most consistent in the use of its parameters.ConclusionsA multi‐method approach combining two or more evaluation instruments is essential for the validation of users' cognitive state. In addition to the AR stimuli in question, having another independent variable such as task difficulty in experiment design is useful. Statistical approaches with more data input could help establish a reliable scale. The future research should attempt to dissociate cognitive load caused by different effects such as device, instruction, and other AR techniques as well as intrinsic and extraneous aspects, in a better experimental setup with multiple parameters.

show abstract

A preliminary quantitative EEG study on Augmented Reality Guidance of Manual Tasks

Cited by 9 publications

References 26 publications

Improvement of Apraxia With Augmented Reality: Influencing Pantomime of Tool Use via Holographic Cues

Improvement of Apraxia With Augmented Reality: Influencing Pantomime of Tool Use via Holographic Cues

A mixed reality system combining augmented reality, 3D bio-printed physical environments and inertial measurement unit sensors for task planning

Measuring cognitive load in augmented reality with physiological methods: A systematic review

Contact Info

Product

Resources

About