Selection-based Text Entry in Virtual Reality

Abstract

Figure 1. This figure illustrates our implemented selection-based text entry candidates for VR. From left to right: Head Pointing (HP, red), Controller Pointing (CP, yellow), Controller Tapping (CT, blue), Freehand (FH, green), Discrete (DC, orange) and Continuous Cursor (CC, light blue).

RotoSwype

“…While the above techniques may potentially be useful for AR/VR, most have not been explicitly studied for it. Existing work on typing in VR includes bimanual typing using physical keyboards [39,43,70], augmented VR views [49] or handheld devices and controllers [22,63]. Spiecher et al [64] provide a good overview of VR text-entry methods.…”

“…Existing work on typing in VR includes bimanual typing using physical keyboards [39,43,70], augmented VR views [49] or handheld devices and controllers [22,63]. Spiecher et al [64] provide a good overview of VR text-entry methods. They further compare six letter-entry techniques including bimanual controller raytracing (BCR), controller tapping, freehand raytracing, a directional pad, and headpointing (raytracing from the head).…”

“…Text-entry for head-mounted devices (HMDs) for augmented reality (AR), virtual reality (VR) remains an open problem. Existing approaches introduce solutions that use hand-held controllers [22,63] or swiping on smartglasses [1,25,82]. However, hand-held controllers are not feasible for AR, especially in mobile scenarios.…”

STAT: Subtle Typing Around the Thigh for Head-Mounted Displays

“…Gaze eliminates the need for specialized devices, but is perceived to be "complex, strenuous and slow" [2], and both speech and gaze suffer from issues of social acceptability, especially when compared with on-device interaction [35]. While it is possible to type on a virtually displayed keyboard [38], this requires tracking of finger position and, without a physical surface, it is challenging for users to localize keys-potentially reducing the speed and accuracy of such a technique. Thus, a large amount of research has been dedicated to optimizing text input when using a virtual display-resulting in increased performance via novel interaction techniques [1,12,38,45,46].…”

SlingDrone: Mixed Reality System for Pointing and Interaction Using a Single Drone

“…Pointing during HCI often happens via controllers, such as joysticks or different wearable or handheld devices [Billinghurst and Starner 1999;Howard and Howard [n. d.]]. For instance, authors in [Speicher et al 2018] used HTC Vive controllers to select keys on a virtual keyboard. In [Yuan et al 2019], a human-assisted quadcopter navigation system where the user guides the robot through eye-tracker glasses was proposed.…”