A Systematic Collection of Natural Interactions for Immersive Modeling From Building Blocks

Abstract

The increased availability of affordable virtual reality hardware in the last years boosted research and development of such systems for many fields of application. While extended reality systems are well established for visualization of product data, immersive authoring tools that can create and modify that data are yet to see widespread productive use. Making use of building blocks, we see the possibility that such tools allow quick expression of spatial concepts, even for non-expert users. Optical hand-tracking technology allows the implementation of this immersive modeling using natural user interfaces. Here the users manipulated the virtual objects with their bare hands. In this work, we present a systematic collection of natural interactions suited for immersive building-block-based modeling systems. The interactions are conceptually described and categorized by the task they fulfil.

Use Cases for a Hybrid Augmented Reality Computer Workstation in Cad Workflows

“…This way the users used the software the way they are used to without long thinking pauses. Using screen capture videos, the modelling process was split into CAD activity categories based on (Harlan et al, 2021) and (Lee and Yan, 2016). Because the users were used to their CAD tool and the task was quite simple, no thinking or idle time was noted.…”

“…Commercial virtual reality modelling tools such as GravitySketch provide the functionality. Researchers have developed bimanual natural interfaces (Fechter et al, 2020) and proposed a collection of natural interactions for the necessary modelling operations (Harlan et al, 2021). A natural modelling interface could be directly adopted for the hybrid workstation to enable holographic CAD drafting, as shown in Figure 4, right.…”

A concept for a novel hybrid augmented reality computer workstation for virtual product development

“…An immersive alternative would allow for natural manipulation of the control points [31] or even the elements themselves [20]. For a more creative workload, the hologram can be used for threedimensional sketching and ideation with simple mid-air line drawings [39] or by creating basic geometric shapes [40]. Those tools should be beneficial for annotation in design reviews as well.…”