qVRty: Virtual Keyboard with a Haptic, Real-World Representation

Hoppe, Adrian H.; Otto, Leonard; Camp, Florian van de; Stiefelhagen, Rainer; Unmüßig, Gabriel

doi:10.1007/978-3-319-92279-9_36

Cited by 14 publications

(7 citation statements)

References 33 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Due to their widespread use, familiarity, and efficiency, physical keyboards have also been successfully integrated into VR and VST AR. The most common approaches are based on the alignment of a virtual representative with the physical keyboard [9,28,29,34,36,43,59,68,71,72,79,89], the segmentation of the physical keyboard and/or the user's hands [36,59,68,72], or a video camera stream of the real world [28,59,72]. However, for non-stationary XR workspaces like presented in [25,48,50,62], the physical table may not be available and alternatives are required [10].…”

Section: Physical Keyboardsmentioning

confidence: 99%

Text Input for Non-Stationary XR Workspaces: Investigating Tap and Word-Gesture Keyboards in Virtual and Augmented Reality

Kern¹,

Niebling

Latoschik³

2023

IEEE Trans. Visual. Comput. Graphics

View full text Add to dashboard Cite

Fig. 1: The virtual keyboard layout is based on the traditional layout of physical keyboards. (A) Shows the tap keyboard in video see-through augmented reality (VST AR) and (B) the swipe keyboard in virtual reality (VR) with a black tail following the user's controller. For the VR condition, we created an accurate digital twin of the real physical room. In the VST AR condition, the real world was captured by the video see-through capabilities of the XR device. To enable precise interaction, the user holds the controller upside down in a pen-like posture and presses/swipes the virtual keyboard keys with the bottom tip of the controller. Three word suggestions are displayed in the upper left. The arrow keys to move the cursor and the backspace key are located in the upper right. The cursor can also be positioned directly in the input field. The shift keys and the space bar are hidden on the swipe keyboard because they are not required for text entry. Rectangular 3D keys provide visual feedback, and when pressed, the controllers vibrate.

show abstract

Section: Physical Keyboardsmentioning

confidence: 99%

Text Input for Non-Stationary XR Workspaces: Investigating Tap and Word-Gesture Keyboards in Virtual and Augmented Reality

Kern¹,

Niebling

Latoschik³

2023

IEEE Trans. Visual. Comput. Graphics

View full text Add to dashboard Cite

show abstract

“…Subsequently, similar studies have investigated further hand representations, such as semi-transparent hand models [40]. Besides, optical outside-in tracking systems with sub-millimeter accuracy such as Optitrack Prime series (e.g., in [30,31,40]), also commodity tracking devices such as the Leap Motion have been utilized [35] for hand tracking on physical keyboards. Our work extends these previous works by investigating how different input and output mapping on physical keyboards can be utilized in VR for tasks beyond text entry.…”

Section: Physical Keyboards For Vrmentioning

confidence: 99%

ReconViguRation: Reconfiguring Physical Keyboards in Virtual Reality

Schneider

Otte

Gesslein

et al. 2019

IEEE Trans. Visual. Comput. Graphics

View full text Add to dashboard Cite

Figure 1: Example for reconfiguring the input and output space of individual keys of a physical keyboard in virtual reality. Top row from left to right: emoji entry, special characters, secure password entry using randomized keys. Bottom row from left to right: foreign languages, browser shortcuts, text processing macros. ABSTRACTPhysical keyboards are common peripherals for personal computers and are efficient standard text entry devices. Recent research has investigated how physical keyboards can be used in immersive headmounted display-based Virtual Reality (VR). So far, the physical layout of keyboards has typically been transplanted into VR for replicating typing experiences in a standard desktop environment. In this paper, we explore how to fully leverage the immersiveness of VR to change the input and output characteristics of physical keyboard interaction within a VR environment. This allows individual physical keys to be reconfigured to the same or different actions and visual output to be distributed in various ways across the VR representation of the keyboard. We explore a set of input and output mappings for reconfiguring the virtual presentation of physical keyboards and probe the resulting design space by specifically designing, implementing and evaluating nine VR-relevant applications: emojis, languages and special characters, application shortcuts, vir-* tual text processing macros, a window manager, a photo browser, a whack-a-mole game, secure password entry and a virtual touch bar. We investigate the feasibility of the applications in a user study with 20 participants and find that, among other things, they are usable in VR. We discuss the limitations and possibilities of remapping the input and output characteristics of physical keyboards in VR based on empirical findings and analysis and suggest future research directions in this area.

show abstract

“…Chroma‐key‐based segmentation methods use such algorithms as video matting, color threshold segmentation, and pixel clustering to extract target information from physical space. Video matting methods are commonly used, and researchers often use blue, 10 green, 11,12 or black 13 as the background color to extract the physical information. These methods can extract high‐quality information, but they may not match the PEs naturally.…”

Section: Related Workmentioning

confidence: 99%

“…Merging the physical keyboard into VEs to improve typing efficiency is a research point 31,49,50 . Hoppe 12 and Schneider 51 used a physical keyboard with haptics to improve typing efficiency. Strandholt 52 merged physical props (hammer, screwdriver, and saw) into VEs for skill training.…”

Section: Related Workmentioning

confidence: 99%

Synchronous mixed reality (SMR): A personalized virtual‐real fusion framework with high immersion and effective interaction

Guo,

Ma,

Weng

2023

J Soc Info Display

View full text Add to dashboard Cite

Virtual‐real fusion (VRF) technology plays a crucial role in the meta‐universe by bridging the gap between virtual environments (VEs) and physical environments (PEs). However, the current VRF system has the problem of single function and fixed integration, limiting the popularization and application of VRF technology. Therefore, this paper proposes a framework named synchronous mixed reality (SMR) to personalize the VRF system and maintain the balance between interaction efficiency and environmental immersion. We combine an instance segmentation algorithm with an interaction prediction algorithm to achieve this balance. To evaluate the effectiveness of the SMR framework, we design three scenarios based on the interaction properties of physical objects and measure environmental immersion, systematic interaction efficiency, and user experience. Our results demonstrate that the SMR framework meets diverse needs in various PEs while balancing immersion and interaction efficiency. Additionally, our framework significantly reduces collisions and negative emotions experienced by users in VEs. We anticipate that this framework will serve as a guide for constructing virtual‐real fusion systems in the future.

show abstract

qVRty: Virtual Keyboard with a Haptic, Real-World Representation

Cited by 14 publications

References 33 publications

Text Input for Non-Stationary XR Workspaces: Investigating Tap and Word-Gesture Keyboards in Virtual and Augmented Reality

Text Input for Non-Stationary XR Workspaces: Investigating Tap and Word-Gesture Keyboards in Virtual and Augmented Reality

ReconViguRation: Reconfiguring Physical Keyboards in Virtual Reality

Synchronous mixed reality (SMR): A personalized virtual‐real fusion framework with high immersion and effective interaction

Contact Info

Product

Resources

About