Text Entry in Immersive Head-Mounted Display-Based Virtual Reality Using Standard Keyboards

Grubert, Jens; Witzani, Lukas; Ofek, Eyal; Pahud, Michel; Kranz, Matthias; Kristensson, Per Ola

doi:10.1109/vr.2018.8446059

Cited by 120 publications

(98 citation statements)

References 37 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…They reported mean text-entry rates of 24.3-28.1 WPM and mean total ER of 20%-28%. Grubert et al (2018) investigated the performance of two desktop keyboards and two touchscreen keyboards for VR text entry. The mean text-entry rates achieved with the two desktop keyboard interfaces were 26.3 WPM and 25.5 WPM (and character error rates were 2.1% and 2.4%), separately.…”

Section: Related Workmentioning

confidence: 99%

“…Since the early days of virtual reality (VR), various text-input techniques have been developed and studied to achieve seamless and user-friendly typing in virtual environments. Prior works have investigated many interaction methods for typing in VR, such as wearable gloves, specialised controllers, head and gaze direction, pen and tablet keyboards, virtual keyboards, touchscreen keyboards, augmented virtuality keyboards, speechto-text, and hand and finger gestures (Lepouras, 2018;Lee and Kim, 2017;Grubert et al, 2018;Yu et al, 2017;McGill et al, 2015;Bowman, Rhoton, and Pinho, 2002). and attempts to build on these widely used techniques are ongoing (Lee and Kim, 2017;Oberhauser and Lecon, 2017;George et al, 2017).…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Controller-based Text-input Techniques for Virtual Reality: An Empirical Comparison

Boletsis

Kongsvik

2019

IJVR

View full text Add to dashboard Cite

Existing consumer VR systems support text input using handheld controllers in combination with virtual keyboards and many designers have attempted to build on these widely used techniques. However, information on current and well-established VR text-input techniques is lacking. In this work, we conduct a comparative empirical evaluation of four controller-based VR text-input techniques, namely, raycasting, drum-like keyboard, head-directed input, and split keyboard. We focus on their text-entry rate and accuracy, usability, and user experience. Twenty-two participants evaluated the techniques by completing a typing session, answering usability and user-experience questionnaires, and participating in a semi-structured interview. The drum-like keyboard and the raycasting techniques stood out, achieving good usability scores, positive experiential feedback, satisfactory text-entry rates, and moderate error rates that can be reduced in future studies. The specific documented usability and experiential characteristics of the techniques are presented and discussed herein.

show abstract

Section: Related Workmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Controller-based Text-input Techniques for Virtual Reality: An Empirical Comparison

Boletsis

Kongsvik

2019

IJVR

View full text Add to dashboard Cite

show abstract

“…VR is not compelled to follow the physical rules of our real world. Recent research has indicated that the location of the virtual and physical keyboard can differ without affecting text entry performance [31]. However, apart from changing the location of the virtual keyboard, further modifications of its visual representation or functionality has not been thoroughly investigated within VR.…”

Section: Introductionmentioning

confidence: 99%

ReconViguRation: Reconfiguring Physical Keyboards in Virtual Reality

Schneider

Otte

Gesslein

et al. 2019

IEEE Trans. Visual. Comput. Graphics

Self Cite

View full text Add to dashboard Cite

Figure 1: Example for reconfiguring the input and output space of individual keys of a physical keyboard in virtual reality. Top row from left to right: emoji entry, special characters, secure password entry using randomized keys. Bottom row from left to right: foreign languages, browser shortcuts, text processing macros. ABSTRACTPhysical keyboards are common peripherals for personal computers and are efficient standard text entry devices. Recent research has investigated how physical keyboards can be used in immersive headmounted display-based Virtual Reality (VR). So far, the physical layout of keyboards has typically been transplanted into VR for replicating typing experiences in a standard desktop environment. In this paper, we explore how to fully leverage the immersiveness of VR to change the input and output characteristics of physical keyboard interaction within a VR environment. This allows individual physical keys to be reconfigured to the same or different actions and visual output to be distributed in various ways across the VR representation of the keyboard. We explore a set of input and output mappings for reconfiguring the virtual presentation of physical keyboards and probe the resulting design space by specifically designing, implementing and evaluating nine VR-relevant applications: emojis, languages and special characters, application shortcuts, vir-* tual text processing macros, a window manager, a photo browser, a whack-a-mole game, secure password entry and a virtual touch bar. We investigate the feasibility of the applications in a user study with 20 participants and find that, among other things, they are usable in VR. We discuss the limitations and possibilities of remapping the input and output characteristics of physical keyboards in VR based on empirical findings and analysis and suggest future research directions in this area.

show abstract

“…Grubert et al [7] investigated the performance of physical and touch keyboards and physical/virtual co-location for VR text entry.…”

Section: Keyboards For Vrmentioning

confidence: 99%

“…However, while direct transplantation of standard keyboards to VR is viable, there are critical design parameters that should be investigated since it is plausible they affect performance. In a companion paper [7] we investigate the performance of physical and touch keyboards and physical/virtual co-location for VR text entry.…”

Section: Introductionmentioning

confidence: 99%

Effects of Hand Representations for Typing in Virtual Reality

Grubert

Witzani

Ofek

et al. 2018

2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)

Self Cite

View full text Add to dashboard Cite

Figure 1: Views on the conditions studied in the experiment on effects of hand representations for typing in VR. From left to right: NoHand, IKHand, Fingertip and VideoHand. AbstractAlphanumeric text entry is a challenge for Virtual Reality (VR) applications. VR enables new capabilities, impossible in the real world, such as an unobstructed view of the keyboard, without occlusion by the user's physical hands. Several hand representations have been proposed for typing in VR on standard physical keyboards. However, to date, these hand representations have not been compared regarding their performance and effects on presence for VR text entry. Our work addresses this gap by comparing existing hand representations with minimalistic fingertip visualization. We study the effects of four hand representations (no hand representation, inverse kinematic model, fingertip visualization using spheres and video inlay) on typing in VR using a standard physical keyboard with 24 participants. We found that the fingertip visualization and video inlay both resulted in statistically significant lower text entry error rates compared to no hand or inverse kinematic model representations. We found no statistical differences in text entry speed.

show abstract

Text Entry in Immersive Head-Mounted Display-Based Virtual Reality Using Standard Keyboards

Cited by 120 publications

References 37 publications

Controller-based Text-input Techniques for Virtual Reality: An Empirical Comparison

Controller-based Text-input Techniques for Virtual Reality: An Empirical Comparison

ReconViguRation: Reconfiguring Physical Keyboards in Virtual Reality

Effects of Hand Representations for Typing in Virtual Reality

Contact Info

Product

Resources

About