Text Input for Non-Stationary XR Workspaces: Investigating Tap and Word-Gesture Keyboards in Virtual and Augmented Reality

Abstract

Fig. 1: The virtual keyboard layout is based on the traditional layout of physical keyboards. (A) Shows the tap keyboard in video see-through augmented reality (VST AR) and (B) the swipe keyboard in virtual reality (VR) with a black tail following the user's controller. For the VR condition, we created an accurate digital twin of the real physical room. In the VST AR condition, the real world was captured by the video see-through capabilities of the XR device. To enable precise interaction, the user holds the controller upside down in a pen-like posture and presses/swipes the virtual keyboard keys with the bottom tip of the controller. Three word suggestions are displayed in the upper left. The arrow keys to move the cursor and the backspace key are located in the upper right. The cursor can also be positioned directly in the input field. The shift keys and the space bar are hidden on the swipe keyboard because they are not required for text entry. Rectangular 3D keys provide visual feedback, and when pressed, the controllers vibrate.

Stress Assessment for Augmented Reality Applications Based on Head Movement Features

“…This work focuses on analyzing the relationship between stress and head movements while using an AR application. Due to the foreseen spreading of AR solutions for working [52] and learning activities [53], we considered a static task (e.g., reading, informative training, tutorial watching, data analysis [54]) and analyzed several head movement features to determine whether they show a significant difference during a stress situation. The most significant features have been used to define a Machine Learning (ML) classifier able to detect the presence of stress.…”

Assessing Depth Perception in VR and Video See-Through AR: A Comparison on Distance Judgment, Performance, and Preference

“…Furthermore, they measured more head movement in the AR condition, which could be an indicator of absent or conflicting depth cues that participants then counteracted with motion parallaxes. Kern et al [23] investigated different keyboard input modalities in VR and VST AR. Contrary to Krichenbauer et al's findings [26], Kern et al found a significantly higher completion time in VST AR than in VR, i.e., participants typed faster in VR.…”

“…Text input might require more cognitive resources. Kern et al [23] explain their results with the Congruence and Plausibility (CaP) model by Latoschik and Wienrich [28] which defines a manipulation space with three layers: the sensation, the perception, and the cognition layer (i.e., bottom-up to top-down). On each layer, (in)congruence can be manipulated, resulting in a condition of plausibility.…”

“…Furthermore, we hypothesize a difference in task performance (i.e., time and error rate) between the two display technologies [23,26]:…”

A Comparative Study of the Typing Performance of Two Mid-Air Text Input Methods in Virtual Environments

“…The input speed of physical keyboards could reach 30 words per minute (WPM), with an accuracy rate of around 80% [ 11 ]. Touch screens and controllers offer better portability and typing speeds exceeding 8 WPM, but they are heavy and can detract from the user’s sense of immersion in the VR environment [ 12 , 13 , 14 , 15 , 16 , 17 , 18 , 19 , 20 , 21 ]. Additionally, some text input methods based on controllers involve a substantial learning cost.…”