Augmenting spatial skills with semi-immersive interactive desktop displays

Solovey, Erin Treacy; Okerlund, Johanna; Hoef, Cassie; Davis, J. E.; Shaer, Orit

doi:10.1145/2735711.2735797

Cited by 6 publications

(5 citation statements)

References 36 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…A significant fraction of previous fNIRS work has been dedicated to passive acquisition of user cognitive states [40], which has been used to assess cognitive workload [18], information presentation [32], or level of difficulty [13]. This has been applied to usability studies [17] and the development of adaptive interfaces [14], for instance through dynamic difficulty adjustment [2], recommender systems [31], or new pointing techniques [3].…”

Section: Previous and Related Workmentioning

confidence: 99%

“…The rapid progress of fNIRS applications to user interfaces makes it possible to envision a new generation of Brain-Computer Interfaces (BCI), with improved spatial resolution, better signal stability and greater robustness to motion artefacts [1,40]. One particular interest for the development of BCI is the accessibility of specific prefrontal areas to fNIRS [11,29,43].…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Anger-based BCI Using fNIRS Neurofeedback

Aranyi

Charles

Cavazza

2015

Proceedings of the 28th Annual ACM Symposium on User Interface Software &Amp; Technology

View full text Add to dashboard Cite

Functional near-infrared spectroscopy (fNIRS) holds increasing potential for Brain-Computer Interfaces (BCI) due to its portability, ease of application, robustness to movement artifacts, and relatively low cost. The use of fNIRS to support the development of affective BCI has received comparatively less attention, despite the role played by the prefrontal cortex in affective control, and the appropriateness of fNIRS to measure prefrontal activity. We present an active, fNIRS-based neurofeedback (NF) interface, which uses differential changes in oxygenation between the left and right sides of the dorsolateral prefrontal cortex to operationalize BCI input. The system is activated by users generating a state of anger, which has been previously linked to increased left prefrontal asymmetry. We have incorporated this NF interface into an experimental platform adapted from a virtual 3D narrative, in which users can express anger at a virtual character perceived as evil, causing the character to disappear progressively. Eleven subjects used the system and were able to successfully perform NF despite minimal training. Extensive analysis confirms that success was associated with the intent to express anger. This has positive implications for the design of affective BCI based on prefrontal asymmetry.

show abstract

Section: Previous and Related Workmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Anger-based BCI Using fNIRS Neurofeedback

Aranyi

Charles

Cavazza

2015

Proceedings of the 28th Annual ACM Symposium on User Interface Software &Amp; Technology

View full text Add to dashboard Cite

show abstract

“…Although initial evaluations using the zSpace have been already done [33], future work could include user studies, examining the combination of hybrid-dimensional visualization and navigation techniques.…”

Section: Results and Conclusionmentioning

confidence: 99%

Hybrid-Dimensional Visualization and Interaction - Integrating 2D and 3D Visualization with Semi-Immersive Navigation Techniques

Sommer

Wang

et al. 2015

2015 Big Data Visual Analytics (BDVA)

View full text Add to dashboard Cite

The integration of 2D visualization and navigation techniques has reached a state where the potential for improvements is relatively low. With 3D-stereoscopy-compatible technology now commonplace not only in research but also in many households, the need for better 3D visualization and navigation techniques has increased. Nevertheless, for the representation of many abstract data such as networks, 2D visualization remains the primary choice. However, often such abstract data is associated with spatial data, thereby increasing the need for combining both 2D and 3D visualization and navigation techniques. We discuss a new hybrid-dimensional approach integrating 2D and 3D (stereoscopic) visualization as well as navigation into a semi-immersive virtual environment. This approach is compared to classical 6DOF navigation techniques. Three scientific as well as educational applications are presented: an educational car model, a plant simulation data exploration, and a cellular model with network exploration, each of these combining spatial with associated abstract data.

show abstract

“…During the virtual training both VR training groups reported comparable levels of workload. Previous research showed that multisensory cuing as well the immersive properties of the VR environment can contribute to increased cognitive workload [ 25 , 43 , 61 , 63 ]. As both VR training groups reported high levels of presence during virtual training, with high levels of involvement and immersion, it is therefore plausible that these factors also contributed to their perceived workload levels.…”

Section: Discussionmentioning

confidence: 99%

Transfer of training—Virtual reality training with augmented multisensory cues improves user experience during training and task performance in the real world

et al. 2021

View full text Add to dashboard Cite

Virtual reality (VR) can create safe, cost-effective, and engaging learning environments. It is commonly assumed that improvements in simulation fidelity lead to better learning outcomes. Some aspects of real environments, for example vestibular or haptic cues, are difficult to recreate in VR, but VR offers a wealth of opportunities to provide additional sensory cues in arbitrary modalities that provide task relevant information. The aim of this study was to investigate whether these cues improve user experience and learning outcomes, and, specifically, whether learning using augmented sensory cues translates into performance improvements in real environments. Participants were randomly allocated into three matched groups: Group 1 (control) was asked to perform a real tyre change only. The remaining two groups were trained in VR before performance was evaluated on the same, real tyre change task. Group 2 was trained using a conventional VR system, while Group 3 was trained in VR with augmented, task relevant, multisensory cues. Objective performance, time to completion and error number, subjective ratings of presence, perceived workload, and discomfort were recorded. The results show that both VR training paradigms improved performance for the real task. Providing additional, task-relevant cues during VR training resulted in higher objective performance during the real task. We propose a novel method to quantify the relative performance gains between training paradigms that estimates the relative gain in terms of training time. Systematic differences in subjective ratings that show comparable workload ratings, higher presence ratings and lower discomfort ratings, mirroring objective performance measures, were also observed. These findings further support the use of augmented multisensory cues in VR environments as an efficient method to enhance performance, user experience and, critically, the transfer of training from virtual to real environment scenarios.

show abstract

Augmenting spatial skills with semi-immersive interactive desktop displays

Cited by 6 publications

References 36 publications

Anger-based BCI Using fNIRS Neurofeedback

Anger-based BCI Using fNIRS Neurofeedback

Hybrid-Dimensional Visualization and Interaction - Integrating 2D and 3D Visualization with Semi-Immersive Navigation Techniques

Transfer of training—Virtual reality training with augmented multisensory cues improves user experience during training and task performance in the real world

Contact Info

Product

Resources

About