Passthrough Mixed Reality With Oculus Quest 2: A Case Study on Learning Piano

Banquiero, Mariano; Valdeolivas, Gracia; Trincado, Sergio; Garcia, Natasha; Juan, M. Carmen

doi:10.1109/mmul.2022.3232892

Cited by 9 publications

(2 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This HMD system is one of the best sellers currently for its affordable price and the good features it has. In addition, not only are the VR scenarios important, but this study opens the door to new approaches to the device with mixed reality through the passthrough camera that are not yet fully developed, causing several limitations [ 45 ]. It is a reference for the initiation of iVR by which clinicians can use these experiences with patients outside the laboratory because it is easy to use and does not require cables or external sensors like other systems [ 15 ].…”

Section: Discussionmentioning

confidence: 99%

Head-Mounted Display for Clinical Evaluation of Neck Movement Validation with Meta Quest 2

Trinidad-Fernández

Bossavit

Fernández

et al. 2023

Sensors

View full text Add to dashboard Cite

Neck disorders have a significant impact on people because of their high incidence. The head-mounted display (HMD) systems, such as Meta Quest 2, grant access to immersive virtual reality (iRV) experiences. This study aims to validate the Meta Quest 2 HMD system as an alternative for screening neck movement in healthy people. The device provides data about the position and orientation of the head and, thus, the neck mobility around the three anatomical axes. The authors develop a VR application that solicits participants to perform six neck movements (rotation, flexion, and lateralization on both sides), which allows the collection of corresponding angles. An InertiaCube3 inertial measurement unit (IMU) is also attached to the HMD to compare the criterion to a standard. The mean absolute error (MAE), the percentage of error (%MAE), and the criterion validity and agreement are calculated. The study shows that the average absolute errors do not exceed 1° (average = 0.48 ± 0.09°). The rotational movement’s average %MAE is 1.61 ± 0.82%. The head orientations obtain a correlation between 0.70 and 0.96. The Bland–Altman study reveals good agreement between the HMD and IMU systems. Overall, the study shows that the angles provided by the Meta Quest 2 HMD system are valid to calculate the rotational angles of the neck in each of the three axes. The obtained results demonstrate an acceptable error percentage and a very minimal absolute error when measuring the degrees of neck rotation; therefore, the sensor can be used for screening neck disorders in healthy people.

show abstract

Section: Discussionmentioning

confidence: 99%

Head-Mounted Display for Clinical Evaluation of Neck Movement Validation with Meta Quest 2

Trinidad-Fernández

Bossavit

Fernández

et al. 2023

Sensors

View full text Add to dashboard Cite

show abstract

“…VR's Passthrough functionality has recently emerged as a crucial component in VR systems, allowing users to observe their physical surroundings while immersed in a virtual environment. This functionality leverages the headset's built-in cameras to capture a live stereo video feed of the user's physical environment, which is then seamlessly blended with the virtual content [21,22,39]. Passthrough functionality addresses the issue of VR isolating users from their surrounding environment, thereby offering benefits for the use of VR in shared spaces.…”

Section: Passthrough Functionality For Enhanced Player Awareness In Vrmentioning

confidence: 99%

Breaking the Isolation: Exploring the Impact of Passthrough in Shared Spaces on Player Performance and Experience in VR Exergames

Guo,

Wang,

Deng

et al. 2024

IEEE Trans. Visual. Comput. Graphics

View full text Add to dashboard Cite

VR exergames offer an engaging solution to combat sedentary behavior and promote physical activity. However, challenges emerge when playing these games in shared spaces, particularly due to the presence of bystanders. VR's passthrough functionality enables players to maintain awareness of their surrounding environment while immersed in VR gaming, rendering it a promising solution to improve users' awareness of the environment. This study investigates the passthrough's impact on player performance and experiences in shared spaces, involving an experiment with 24 participants that examines Space (Office vs. Corridor) and Passthrough Function (With vs. Without). Results reveal that Passthrough enhances game performance and environmental awareness while reducing immersion. Players prefer an open area to an enclosed room, whether with or without Passthrough, finding it more socially acceptable. Additionally, Passthrough appears to encourage participation among players with higher self-consciousness, potentially alleviating their concerns about being observed by bystanders. Our findings provide valuable insights for designing VR experiences in shared spaces, underscoring the potential of VR's passthrough to enhance user experiences and promote VR adoption in these environments.

show abstract

A color Passthrough mixed reality application for learning piano

Banquiero,

Valdeolivas,

Ramón

et al. 2024

Virtual Reality

View full text Add to dashboard Cite

This work presents the development of a mixed reality (MR) application that uses color Passthrough for learning to play the piano. A study was carried out to compare the interpretation outcomes of the participants and their subjective experience when using the MR application developed to learn to play the piano with a system that used Synthesia (N = 33). The results show that the MR application and Synthesia were effective in learning piano. However, the students played the pieces significantly better when using the MR application. The two applications both provided a satisfying user experience. However, the subjective experience of the students was better when they used the MR application. Other conclusions derived from the study include the following: (1) The outcomes of the students and their subjective opinion about the experience when using the MR application were independent of age and gender; (2) the sense of presence offered by the MR application was high (above 6 on a scale of 1 to 7); (3) the adverse effects induced by wearing the Meta Quest Pro and using our MR application were negligible; and (4) the students showed their preference for the MR application. As a conclusion, the advantage of our MR application compared to other types of applications (e.g., non-projected piano roll notation) is that the user has a direct view of the piano and the help elements appear integrated in the user’s view. The user does not have to take their eyes off the keyboard and is focused on playing the piano.

show abstract

Passthrough Mixed Reality With Oculus Quest 2: A Case Study on Learning Piano

Cited by 9 publications

References 12 publications

Head-Mounted Display for Clinical Evaluation of Neck Movement Validation with Meta Quest 2

Head-Mounted Display for Clinical Evaluation of Neck Movement Validation with Meta Quest 2

Breaking the Isolation: Exploring the Impact of Passthrough in Shared Spaces on Player Performance and Experience in VR Exergames

A color Passthrough mixed reality application for learning piano

Contact Info

Product

Resources

About