A comparative study on inter-brain synchrony in real and virtual environments using hyperscanning

Gumilar, Ihshan; Sareen, Ekansh; Bell, Reed; Stone, Augustus; Hayati, Ashkan F.; Mao, Jingwen; Barde, Amit; Gupta, Anubha; Dey, Arindam; Lee, Gun; Billinghurst, Mark

doi:10.1016/j.cag.2020.10.003

Cited by 30 publications

(18 citation statements)

References 54 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…These studies are done under similar yet divergent experimental setups each catering to its objectives. The following studies explore machine mediated neural and behavioral synchronization in real and virtual environments (Hachmeister et al, 2014 ; Gumilar et al, 2021 ). Similarly, the effect of cooperation on neural synchrony (Abe et al, 2019 ), meditation and monastic debates (Fenwick et al, 2019 ; van Vugt et al, 2020 ), emotional association in groups (Nummenmaa et al, 2014 ; Goldstein et al, 2018 ; Santamaria et al, 2019 ) are included in this paradigm.…”

Section: Resultsmentioning

confidence: 99%

“…Over the last decades, researchers experimenting on the social human brain recorded and measured the neural connectivities by adopting hyper-scanning techniques in designing and monitoring several host of tasks, such as prisoners dilemma game (Jahng et al, 2017 ; Hu et al, 2018 ), guitar playing (Sänger et al, 2012 ), interaction in a virtual environment (Gumilar et al, 2021 ), debate (van Vugt et al, 2020 ), video watching (Ding et al, 2018 ; Gao et al, 2020 ), parent-child dyad (Reindl et al, 2018 ; Santamaria et al, 2019 ), playing video games (Liu et al, 2016 ), etc. These studies essentially upgraded and replaced the traditional study of the individual brain in isolation with the study interactive nature of human cognition as an alternative.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Recent Trends in Non-invasive Neural Recording Based Brain-to-Brain Synchrony Analysis on Multidisciplinary Human Interactions for Understanding Brain Dynamics: A Systematic Review

Nazneen

Islam

Sajal

et al. 2022

Front. Comput. Neurosci.

View full text Add to dashboard Cite

The study of brain-to-brain synchrony has a burgeoning application in the brain-computer interface (BCI) research, offering valuable insights into the neural underpinnings of interacting human brains using numerous neural recording technologies. The area allows exploring the commonality of brain dynamics by evaluating the neural synchronization among a group of people performing a specified task. The growing number of publications on brain-to-brain synchrony inspired the authors to conduct a systematic review using the PRISMA protocol so that future researchers can get a comprehensive understanding of the paradigms, methodologies, translational algorithms, and challenges in the area of brain-to-brain synchrony research. This review has gone through a systematic search with a specified search string and selected some articles based on pre-specified eligibility criteria. The findings from the review revealed that most of the articles have followed the social psychology paradigm, while 36% of the selected studies have an application in cognitive neuroscience. The most applied approach to determine neural connectivity is a coherence measure utilizing phase-locking value (PLV) in the EEG studies, followed by wavelet transform coherence (WTC) in all of the fNIRS studies. While most of the experiments have control experiments as a part of their setup, a small number implemented algorithmic control, and only one study had interventional or a stimulus-induced control experiment to limit spurious synchronization. Hence, to the best of the authors' knowledge, this systematic review solely contributes to critically evaluating the scopes and technological advances of brain-to-brain synchrony to allow this discipline to produce more effective research outcomes in the remote future.

show abstract

Section: Resultsmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Recent Trends in Non-invasive Neural Recording Based Brain-to-Brain Synchrony Analysis on Multidisciplinary Human Interactions for Understanding Brain Dynamics: A Systematic Review

Nazneen

Islam

Sajal

et al. 2022

Front. Comput. Neurosci.

View full text Add to dashboard Cite

show abstract

“…The results from such studies can be used to help design VEs that promote inter-brain synchrony and help participants achieve a state of flow in order to complete tasks in a quick and efficient manner. Given that, to the best of our knowledge, there appears to be only one study that use hyperscanning to examine social interactions in VEs [111], we propose to undertake such an experiment as a means to establish a methodological approach to conducting future investigations into the subject. This preliminary experiment will aim to replicate an existing hyperscanning study carried out in the real world.…”

Section: Discussionmentioning

confidence: 99%

“…While EEG has been used in a number of VR studies, there appear to be no studies, barring one [111], that explore employing hyperscanning in VR. Employing this technique in VR could greatly benefit studying interactions among users in a multi-user VE.…”

Section: Practical Implications For Using Hyperscanning In Virtual Environmentsmentioning

confidence: 99%

A Review of Hyperscanning and Its Use in Virtual Environments

et al. 2020

Self Cite

View full text Add to dashboard Cite

Hyperscanning is a technique which simultaneously records the neural activity of two or more people. This is done using one of several neuroimaging methods, such as electroencephalography (EEG), functional magnetic resonance imaging (fMRI), and functional near-infrared spectroscopy (fNIRS). The use of hyperscanning has seen a dramatic rise in recent years to monitor social interactions between two or more people. Similarly, there has been an increase in the use of virtual reality (VR) for collaboration, and an increase in the frequency of social interactions being carried out in virtual environments (VE). In light of this, it is important to understand how interactions function within VEs, and how they can be enhanced to improve their quality in a VE. In this paper, we present some of the work that has been undertaken in the field of social neuroscience, with a special emphasis on hyperscanning. We also cover the literature detailing the work that has been carried out in the human–computer interaction domain that addresses remote collaboration. Finally, we present a way forward where these two research domains can be combined to explore how monitoring the neural activity of a group of participants in VE could enhance collaboration among them.

show abstract

“…The current trend in XR points toward future HMDs with BCI or brain-computer interfaces (Hayden, n.d.a) such as the electroencephalogram (EEG) devices (e.g., the Galea (Hayden, n.d.b; Galea, n.d.)). Recently, more studies emerged sharing new findings by utilising BCI (Dey et al, 2021;Gumilar et al, 2021). Past research had demonstrated that engagement level could be detected using BCI (Hassib et al, 2017).…”

Section: Limitations and Future Workmentioning

confidence: 99%

Ex-Cit XR: Expert-elicitation and validation of Extended Reality visualisation and interaction techniques for disengaging and transitioning users from immersive virtual environments

Piumsomboon¹,

Ong²,

Urban³

et al. 2022

Front. Virtual Real.

View full text Add to dashboard Cite

This research explores visualisation and interaction techniques to disengage users from immersive virtual environments (IVEs) and transition them back to the Augmented Reality mode in the real world. To gain a better understanding and novel ideas, we invited eleven Extended Reality (XR) experts to participate in an elicitation study to design such techniques for disengagement. From the elicitation study, we elicited a total of 132 techniques for four different scenarios of IVEs: Narrative-driven, Social-platform, Adventure Sandbox, and Fast-paced Battle experiences. Through extracted keywords and thematic analysis, we classified the elicited techniques into six categories of Activities, Breaks, Cues, Degradations, Notifications, and Virtual Agents. We shared our analyses on users’ intrinsic motivation to engage in different experiences, subjective ratings of four design attributes in designing the disengagement techniques, Positive and Negative Affect Schedules, and user preference. In addition, we gave the design patterns found and illustrated the exemplary user cases of Ex-Cit XR. Finally, we conducted an online survey to preliminarily validate our design recommendations. We proposed the SPINED behavioural manipulation spectrum for XR disengagement to guide how the systems can strategically escalate to disengage users from an IVE.

show abstract

A comparative study on inter-brain synchrony in real and virtual environments using hyperscanning

Cited by 30 publications

References 54 publications

Recent Trends in Non-invasive Neural Recording Based Brain-to-Brain Synchrony Analysis on Multidisciplinary Human Interactions for Understanding Brain Dynamics: A Systematic Review

Recent Trends in Non-invasive Neural Recording Based Brain-to-Brain Synchrony Analysis on Multidisciplinary Human Interactions for Understanding Brain Dynamics: A Systematic Review

A Review of Hyperscanning and Its Use in Virtual Environments

Ex-Cit XR: Expert-elicitation and validation of Extended Reality visualisation and interaction techniques for disengaging and transitioning users from immersive virtual environments

Contact Info

Product

Resources

About