Accuracy of Commodity Finger Tracking Systems for Virtual Reality Head-Mounted Displays

Schneider, Daniel; Otte, Alexander; Kublin, Axel Simon; Martschenko, Alexander; Kristensson, Per Ola; Ofek, Eyal; Pahud, Michel; Grubert, Jens

doi:10.1109/vrw50115.2020.00253

Cited by 25 publications

(14 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In a human participants study (n=15) they found the throughput of both the VR and AR condition to be significantly lower than in the 2d touchscreen condition and the throughput of AR to be also significantly lower compared to VR and hypothesized that the difference between AR and VR might be due to the display system (as the same hand tracking technology was used). The closest work to ours is by Schneider et al [Schneider et al 2020], who compared the finger tracking accuracy of the HTC Vive Pro and the leap motion. Specifically, our work complements this prior work by including a larger set of both recent AR and VR displays as well as a more comprehensive evaluation using additional dependent variables such as workload, subjective feedback and usability ratings.…”

Section: Related Workmentioning

confidence: 99%

See 1 more Smart Citation

Accuracy Evaluation of Touch Tasks in Commodity Virtual and Augmented Reality Head-Mounted Displays

Schneider¹,

Biener²,

Otte³

et al. 2021

Preprint

Self Cite

View full text Add to dashboard Cite

An increasing number of consumer-oriented head-mounted displays (HMD) for augmented and virtual reality (AR/VR) are capable of finger and hand tracking. We report on the accuracy of off-theshelf VR and AR HMDs when used for touch-based tasks such as pointing or drawing. Specifically, we report on the finger tracking accuracy of the VR head-mounted displays Oculus Quest, Vive Pro and the Leap Motion controller, when attached to a VR HMD, as well as the finger tracking accuracy of the AR head-mounted displays Microsoft HoloLens 2 and Magic Leap. We present the results of two experiments in which we compare the accuracy for absolute and relative pointing tasks using both human participants and a This is the author's version of the work.robot. The results suggest that HTC Vive has a lower spatial accuracy than the Oculus Quest and Leap Motion and that the Microsoft HoloLens 2 provides higher spatial accuracy than Magic Leap One. These findings can serve as decision support for researchers and practitioners in choosing which systems to use in the future. CCS CONCEPTS• Human-centered computing → Gestural input; Mixed / augmented reality; Virtual reality.

show abstract

Section: Related Workmentioning

confidence: 99%

“…The participants were told to conduct two tasks in all conditions, inspired by prior work [Harrison et al 2011;Schneider et al 2020;Xiao et al 2018]. For each task, the participants started with their index finger on the smartphone in front of them, see Figure 2, left.…”

Section: Tasksmentioning

confidence: 99%

Accuracy Evaluation of Touch Tasks in Commodity Virtual and Augmented Reality Head-Mounted Displays

Schneider¹,

Biener²,

Otte³

et al. 2021

Preprint

Self Cite

View full text Add to dashboard Cite

show abstract

“…We used a HTC Vive Pro Eye as the HMD, which also enables hand tracking 1 as well as access to the camera streams 2 . While we used external OptiTrack outside-in tracking systems due to superior hand tracking accuracy compared to HMD-based inside out tracking [100] for our evaluations, we also implemented a system to track the user's screen using the HMD cameras, see Figure 7, g-h. While it is possible to build a computer vision algorithm to track the specific laptop model used by users, we used a model-independent approach.…”

Section: Mobile Implementationmentioning

confidence: 99%

“…Future work should investigate the effects of layer distance on various task types in more detail, as with increasing layer distance, the association between individual (x, y) coordinates on a layer could become harder for users to track. While we indicated the feasibility of mobile implementations using our prototype, we still opted for using an external tracking system for implementing our interaction techniques due to the limited accuracy of generation HMD-based hand tracking [100] at the time of the study. Newer technologies, such as Oculus Quest hand tracking offer higher accuracy and may enable sufficient performance.…”

Section: Limitationsmentioning

confidence: 99%

Breaking the Screen: Interaction Across Touchscreen Boundaries in Virtual Reality for Mobile Knowledge Workers

Biener

Schneider

Gesslein

et al. 2020

IEEE Trans. Visual. Comput. Graphics

Self Cite

View full text Add to dashboard Cite

Virtual Reality (VR) has the potential to transform knowledge work. One advantage of VR knowledge work is that it allows extending 2D displays into the third dimension, enabling new operations, such as selecting overlapping objects or displaying additional layers of information. On the other hand, mobile knowledge workers often work on established mobile devices, such as tablets, limiting interaction with those devices to a small input space. This challenge of a constrained input space is intensified in situations when VR knowledge work is situated in cramped environments, such as airplanes and touchdown spaces. In this paper, we investigate the feasibility of interacting jointly between an immersive VR head-mounted display and a tablet within the context of knowledge work. Specifically, we 1) design, implement and study how to interact with information that reaches beyond a single physical touchscreen in VR; 2) design and evaluate a set of interaction concepts; and 3) build example applications and gather user feedback on those applications.

show abstract

“…Other related works can be found comparing or analyzing the accuracy of hand tracking in immersive VR systems [35], comparing controllers for HMDs [23] or comparing distance perception between a CAVE and a HMD [1,9], but to the best of our knowledge, no previous works exist performing the kind of experimental research that we propose here.…”

Section: Introductionmentioning

confidence: 99%

A comparative analysis of two immersive virtual reality systems in the integration and visualization of natural hand interaction

Molina

Gimeno

Portalés

et al. 2022

Multimed Tools Appl

View full text Add to dashboard Cite

It is generally accepted that the use of natural interaction provides a positive impact in Virtual Reality (VR) applications. Therefore, it is important to understand what is the best way to integrate and visualize this feature in VR. For this reason, this paper presents a comparative study of the integration of natural hand interaction in two immersive VR systems: a Cave Audio Visual Experience (CAVE) system –where users’ real hands are visible– and a non-see-through Head-Mounted Display (HMD) system –where only a virtual representation of the hands is possible–. In order to test the suitability of using this type of interaction in a CAVE and compare it to an HMD, we raise six research questions related to task performance, usability and perception differences regarding natural hand interaction with these two systems. To answer these questions, we designed an experiment where users have to complete a pick-and-place task with virtual balls and a text-typing task with virtual keyboards. In both systems, the same tracking technology, based on a Leap Motion device, was used. To the best of our knowledge this is the first academic work addressing a comparison of this type. Objective and subjective data were collected during the experiments. The results show that the HMD has a performance, preference and usability advantage over the CAVE with respect to the integration of natural hand interaction. Nevertheless, the results also show that the CAVE system can be, as well, successfully used in combination with an optical hand tracking device.

show abstract

Accuracy of Commodity Finger Tracking Systems for Virtual Reality Head-Mounted Displays

Cited by 25 publications

References 5 publications

Accuracy Evaluation of Touch Tasks in Commodity Virtual and Augmented Reality Head-Mounted Displays

Accuracy Evaluation of Touch Tasks in Commodity Virtual and Augmented Reality Head-Mounted Displays

Breaking the Screen: Interaction Across Touchscreen Boundaries in Virtual Reality for Mobile Knowledge Workers

A comparative analysis of two immersive virtual reality systems in the integration and visualization of natural hand interaction

Contact Info

Product

Resources

About