A Fully Immersive Set-Up for Remote Interaction and Neurorehabilitation Based on Virtual Body Ownership

Pérez-Marcos, Daniel; Solazzi, Massimiliano; Steptoe, William; Oyekoya, Oyewole; Frisoli, Antonio; Weyrich, Tim; Steed, Anthony; Tecchia, Franco; Slater, Mel; Sánchez-Vives, María V.

doi:10.3389/fneur.2012.00110

Cited by 53 publications

(33 citation statements)

References 74 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The concept of 'beaming' is that one person, who we call a 'visitor' is digitally transported to a remote destination to interact with local people there [Steed et al 2012;Perez-Marcos et al 2012]. The visitor typically enters a high quality virtual reality system with full head-tracking and real-time whole body motion capture.…”

Section: Introductionmentioning

confidence: 99%

Persuading people in a remote destination to sing by beaming there

Bourdin

Sanahuja

Moya

et al. 2013

Proceedings of the 19th ACM Symposium on Virtual Reality Software and Technology

Self Cite

View full text Add to dashboard Cite

We built a Collaborative Virtual Environment (CVE) allowing one person, the 'visitor' to be digitally transported to a remote destination to interact with local people there. This included full body tracking, vibrotactile feedback and voice. This allowed interactions in the same CVE between multiple people situated in different physical remote locations. This system was used for an experiment to study whether the conveyance of touch has an impact on the willingness of participants embodied in the CVE to sing in public. In a first experimental condition, the experimenter virtually touched the avatar of the participants on the shoulder, producing vibrotactile feedback. In another condition using the identical physical setup, the vibrotactile displays were not activated, so that they would not feel the touch. Our hypothesis was that the tactile touch condition would produce a greater likelihood of compliance with the request to sing. In a second part we examined the hypothesis that people might be more willing to sing (execute an embarrassing task) in a CVE, because of the anonymity provided by virtual reality. Hence we carried out a similar study in physical reality. The results suggest that the tactile intervention had no effect on the sensations of body ownership, presence or the behaviours of the participants, in spite of the finding that the sensation of touch itself was effectively realised. Moreover we found an overall similarity in responses between the VR and real conditions.

show abstract

Section: Introductionmentioning

confidence: 99%

Persuading people in a remote destination to sing by beaming there

Bourdin

Sanahuja

Moya

et al. 2013

Proceedings of the 19th ACM Symposium on Virtual Reality Software and Technology

Self Cite

View full text Add to dashboard Cite

show abstract

“…Other types of studies have targeted rendering styles [20] and how character appearance influences the perception of actions [11] and bodily emotions [21]. The use of avatars has also been investigated with respect to user embodiment, ownership and behavior [7], [27], [30]. Our work focuses on investigating how different ways of using avatars and animated characters influence the execution of motion-oriented tasks.…”

Section: Related Workmentioning

confidence: 99%

The Effects of Avatars, Stereo Vision and Display Size on Reaching and Motion Reproduction

Camporesi

Kallmann

2016

IEEE Trans. Visual. Comput. Graphics

View full text Add to dashboard Cite

Thanks to recent advances on motion capture devices and stereoscopic consumer displays, animated virtual characters can now realistically interact with users in a variety of applications. We investigate in this paper the effect of avatars, stereo vision and display size on task execution in immersive virtual environments. We report results obtained with three experiments in varied configurations that are commonly used in rehabilitation applications. The first experiment analyzes the accuracy of reaching tasks under different system configurations: with and without an avatar, with and without stereo vision, and employing a 2D desktop monitor versus a large multi-tile visualization display. The second experiment analyzes the use of avatars and user-perspective stereo vision on the ability to perceive and subsequently reproduce motions demonstrated by an autonomous virtual character. The third experiment evaluates the overall user experience with a complete immersive user interface for motion modeling by direct demonstration. Our experiments expose and quantify the benefits of using stereo vision and avatars, and show that the use of avatars improve the quality of produced motions and the resemblance of replicated msotions; however, direct interaction in user-perspective leads to tasks executed in less time and to targets more accurately reached. These and additional tradeoffs are important for the effective design of avatar-based training systems.

show abstract

“…In recent years, the ElectroEncephaloGraphy-based (EEG-based) Brain-Computer Interface (BCI) has become one of the most promising areas of research in computer science and robotics thanks to neurorehabilitation. Neurorehabilitation is a relatively new field and a multi-step system that combines series of therapies from the psychological to occupational, teaching or retraining patients on mobility skills, communication processes and other aspects of that person's daily routine [1]. The main goal of this complex medical process is the recovery of the patient from a nervous system injury and the minimization and/or compensation for related functional alterations or disabilities.…”

Section: Introductionmentioning

confidence: 99%

Classification of Mental Tasks from EEG Signals Using Spectral Analysis, PCA and SVM

Neshov

Manolova

Draganov

et al. 2018

Cybernetics and Information Technologies

View full text Add to dashboard Cite

Signals provided by the ElectroEncephaloGraphy (EEG) are widely used in Brain-Computer Interface (BCI) applications. They can be further analyzed and used for thinking activity recognition. In this paper we proposed an algorithm that is able to recognize five mental tasks using 6 channel EEG data. The main idea is to separate the raw EEG signals into several frames and compute their spectrums. Next, a second-order derivative of Gaussian is applied to extract features and an optimum Gaussian kernel parameters grid search is performed with the help of cross-validation. The extracted features are further reduced by Principal Component Analysis. The processed data is utilized to train SVM classifier which is used for mental tasks recognition afterwards. The performance of the algorithm is estimated on publically available dataset. In terms of 5 folds cross-validation we obtained an average of 82.7% recognition rate (accuracy). Additional experiments were conducted using leave-one-out cross-validation where 67.2% correct classification was reported. Comparison to several state-of-the art methods reveals the advantages of the proposed algorithm.

show abstract

A Fully Immersive Set-Up for Remote Interaction and Neurorehabilitation Based on Virtual Body Ownership

Cited by 53 publications

References 74 publications

Persuading people in a remote destination to sing by beaming there

Persuading people in a remote destination to sing by beaming there

The Effects of Avatars, Stereo Vision and Display Size on Reaching and Motion Reproduction

Classification of Mental Tasks from EEG Signals Using Spectral Analysis, PCA and SVM

Contact Info

Product

Resources

About