A tablet-based 3D interaction tool for virtual engineering environments

Medeiros, Daniel; Teixeira, Lucas; Carvalho, Felipe; Santos, Ismael; Raposo, Alberto

doi:10.1145/2534329.2534349

Cited by 17 publications

(7 citation statements)

References 21 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Some resent research explores the use of touch screens on mobile devices as an input device for Virtual Environments (VE). For example, Medeiros et al [40] developed a system that use a tracked tablet as an all-in-one controller for immersive VR applications. They implemented a touch screen interface that supports selection, manipulation and navigation in 3D scenes.…”

Section: Human Computer Interaction (Hci) In Vr 231 Input Hardwarementioning

confidence: 99%

A CAVE based 3D immersive interactive city with gesture interface

Zhang¹

2022

Preprint

View full text Add to dashboard Cite

This thesis presents a system that visualizes 3D city data and supports gesture interactions in a fully immersive Cave Automatic Virtual Environment (CAVE). To facilitate more natural interactions in this immersive virtual city, novel techniques are proposed for operations such as object selection, object manipulation, navigation and menu control. These operations form a basis of interactions for most Virtual Reality (VR) applications. The proposed techniques are predominantly controlled using gestures. We also propose the use of pattern recognition methods, specifically a Hidden Markov Model, to support real time dynamic gesture recognition and demonstrate its use for menu control in VR applications. Qualitative and quantitative user studies are conducted to evaluate the proposed techniques. The results of the user studies demonstrate that the interaction techniques for object selection and manipulation are measurably better than traditional techniques. The results also show that the proposed gesture based navigation and menu control techniques are preferred by experienced users. These findings can guide future user interface design in immersive environments.

show abstract

Section: Human Computer Interaction (Hci) In Vr 231 Input Hardwarementioning

confidence: 99%

A CAVE based 3D immersive interactive city with gesture interface

Zhang¹

2022

Preprint

View full text Add to dashboard Cite

show abstract

“…Navigation is a prerequisite of selection in large-scale environment and some techniques combine both navigation and selection on the tablet. For instance, Madeiros et al [44] mapped finger gestures on tablet to enable selection and manipulation actions. Kim et al [37] introduced a "finger walking in place" technique for navigation in VR using a tablet touch input.…”

Section: Visualization and Explorationmentioning

confidence: 99%

“…In summary, most of the previously mentioned selection techniques that employ hybrid metaphors (i.e., combine both midair and tablet) do not support fluent multimodal interaction. That is, they constrain the selection to only one modality at a time, either in mid-air or on the physical tablet surface [1,10,11,26,44,61,62]. Furthermore, several mid-air techniques in VR/AR only focus on menu navigation or single object selection [6,13,18,66,67], not adapting well to highly dense unstructured VEs.…”

Section: Haptic Feedback and Stabilitymentioning

confidence: 99%

Slicing-Volume: Hybrid 3D/2D Multi-target Selection Technique for Dense Virtual Environments

Montano-Murillo

Nguyen

Kazi

et al. 2020

2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)

View full text Add to dashboard Cite

3D selection in dense VR environments (e.g., point clouds) is extremely challenging due to occlusion and imprecise mid-air input modalities (e.g., 3D controllers and hand gestures). In this paper, we propose "Slicing-Volume", a hybrid selection technique that enables simultaneous 3D interaction in mid-air, and a 2D penand-tablet metaphor in VR. Inspired by well-known slicing plane techniques in data visualization, our technique consists of a 3D volume that encloses target objects in mid-air, which are then projected to a 2D tablet view for precise selection on a tangible physical surface. While slicing techniques and tablets-in-VR have been previously explored, in this paper, we evaluated the potential of this hybrid approach to improve accuracy in highly occluded selection tasks, comparing different multimodal interactions (e.g., Mid-air, Virtual Tablet and Real Tablet). Our results showed that our hybrid technique significantly improved overall accuracy of selection compared to Mid-air selection only, thanks to the added haptic feedback given by the physical tablet surface, rather than the added visualization given by the tablet view.

show abstract

“…The presented systems above all give a haptic feeling to the user, but have limited input capabilities. To overcome this, Medeiros et al [11] use a tracked tablet in a CAVE environment. Depending on the orientation of the tablet, the respective view into the virtual world is rendered on the touch screen.…”

Section: Related Workmentioning

confidence: 99%

Extending Movable Surfaces with Touch Interaction Using the VirtualTablet: An Extended View

Hoppe¹,

Marek²,

Camp³

et al. 2020

Adv. sci. technol. eng. syst. j.

View full text Add to dashboard Cite

Immersive output and natural input are two core aspects of a virtual reality experience. Current systems are frequently operated by a controller or gesture-based approach. However, these techniques are either very accurate but require an effort to learn, or very natural but miss haptic feedback for optimal precision. We transfer ubiquitous touch interaction with haptic feedback into a virtual environment. To validate the performance of our implementation, we performed a user study with 28 participants. As the results show, the movable and cheap real world object supplies an accurate touch detection that is equal to a laserpointer-based interaction with a controller. Moreover, the virtual tablet can extend the functionality of a real world tablet. Additional information can be displayed in mid-air around the touchable area and the tablet can be turned over to interact with both sides. Therefore, touch interaction in virtual environments allows easy to learn and precise system interaction and can even augment the established touch metaphor with new paradigms.

show abstract

A tablet-based 3D interaction tool for virtual engineering environments

Cited by 17 publications

References 21 publications

A CAVE based 3D immersive interactive city with gesture interface

A CAVE based 3D immersive interactive city with gesture interface

Slicing-Volume: Hybrid 3D/2D Multi-target Selection Technique for Dense Virtual Environments

Extending Movable Surfaces with Touch Interaction Using the VirtualTablet: An Extended View

Contact Info

Product

Resources

About