A brain-computer interface with gamification in the Metaverse

Abstract

This study contributes to our understanding of the Metaverse by presenting a case study of the implementation of brain-computer interface supported game-based engagement in a Virtual Environment (VE). In VE, individuals can communicate with anyone, anywhere, anytime, without any limits. This situation will increase the barrier-free living standards of disabled people in a more accessible environment. A virtual world of well-being awaits these individuals, primarily through gamified applications thanks to Brain-Computer Interfaces. Virtual environments in the Metaverse can be infinitely large, but the user's movement in a virtual reality (VR) environment is constrained by the natural environment. Locomotion has become a popular motion interface as it allows for full exploration of VE. In this study, the teleport method from locomotion methods was used. To teleport, the user selects the intended location using brain signals before being instantly transported to that location. Brain signals are decomposed into alpha, beta, and gamma bands. The features of each band signal in Time, frequency, and time-frequency domains are extracted. In this proposed method, the highest performance of binary classification was obtained in the frequency domain and the Alpha band. Signals in the alpha band were tested in the domains Time, Frequency, and Time-Frequency. Teleport operations are faster with Time and more stable with the frequency domain. However, the Hilbert-Huang Transform (HHT) method used in the Time-Frequency domain could not respond adequately to real-time applications. All these analyses were experienced in the Erzurum Virtual Tour case study, which was prepared to promote cultural heritage with the gamification method.

MetaChain: A Novel Blockchain-based Framework for Metaverse Applications

“…The user's EEG signals were extracted and processed using a locally deployed SVM classifier to detect the user's commands. In another study [12], the authors developed a gaming platform for teleportation in the Metaverse, where the user's commands were directly translated from their EEG signals. This approach enables users to control tasks in the virtual environment without the use of any gaming tools such as a joystick.…”

“…The results also showed that participants did not experience motion sickness, as the negativities of the locomotion movements were eliminated by using EEG signals instead of a joystick controller. It is worth noting that both studies in [12], [15] were pseudo-online and supported by wired connection between a computer and BCI headsets. The local computer was responsible for both processing and providing VR experiences.…”

“…The mobility, scalability, and computation limitations of [12] and [15] could be addressed by utilizing wireless BCI headsets [17] connecting to a centralized server or an edge computing unit with much more abundant computational power. By this way, the remote server and the users can exchange information with each other through uplink and downlink wireless channels.…”

“…This also means less antennas, sensors can be mounted, thus limiting the communications and sensing capabilities. Furthermore, each conventional sensing technique requires specific type of sensor, e.g., camera [4], finger sensor [6], IMU sensor [5], heart rate sensor [11], and joystick [12], that may hinder the scalability and standardization of the system. For example, in some Metaverse applications such as real-time virtual fighting, fitness, and dance gaming, heart rate tracking information can help to adjust the tempo and intensity of the music, while body movement tracking information can provide more accurate and precise control over the user's dance movements.…”

Mimarlık Öğrencilerinin Sanal Gerçeklik Ortamında Safranbolu Tabakhanesinde Rölöve Alma Deneyimi

“…Literatürde sanal gerçeklik teknolojisi ile yapılmış çalışmalar [6][7][8][9], genellikle restore edilen yapının sadece görselleştirilmesi ve kullanıcılara sanal tur imkanı ile sunulmasını konu edinmiştir. Bununla birlikte, farklı alanlarda uygulamalı ve etkileşimli bir eğitim modeli sunan çalışmalar yer alsa da [10][11][12], mimari rölöve eğitiminde herhangi bir çalışmaya rastlanmamıştır. Bu eksikliği gidermek amacıyla bu çalışmada iki temel işlem gerçekleştirilmiştir:…”