Slicing techniques for handheld augmented reality

Abstract

Manipulating slice planes is an important task for exploring volumetric datasets. Since this task is inherently 3D, it is difficult to accomplish with standard 2D input devices. Alternative interaction techniques have been proposed for direct and natural 3D manipulation of slice planes. However, they also require bulky and dedicated hardware, making them inconvenient for everyday work. To address this issue, we adapted two of these techniques for use in a portable and self-contained handheld AR environment. The first is based on a tangible slicing tool, and the other is based on a spatially aware display. In this paper, we describe our design choices and the technical challenges encountered in this implementation. We then present the results, both objective and subjective, from an evaluation of the two slicing techniques. Our study provides new insight into the usability of these techniques in a handheld AR setting.

Hybrid Tactile/Tangible Interaction for 3D Data Exploration

“…While many TUIs use tangible props as both physical representation and means of interaction, several TUIs focus more on the input aspect [26,[34][35][36][37]67] by considering the tangible props as handles. Tangible input inherently offers 6 integrated DOF per prop.…”

“…A more lightweight tracking approach is used by Jackson et al [37] whose tangible interface consists of a printed 2D barcode that can be rolled into a pen-like object whose location and orientation can be easily captured using a camera-to be used, for example, for fibertract exploration. While Issartel et al's [35] data exploration system also relies on simple fiducial tracking to control the cutting plane with a tangible pen, they integrate this approach in a portable and affordable augmented reality setup that uses a tablet computer to view the dataset and track the interaction props. As an alternative to pen-based control, they also investigate the use of a cutting plane that is sightly offset from the tablet toward the data.…”

“…Research has shown that these tactile and tangible input paradigms have many benefits for effective and efficient interaction, in particular for 3D data exploration (e. g., [19,26,35,87]). Yet, they are quite different from each other: tactile input benefits from its directness and a resulting perception of control and precision of interaction [81,87], while tangible input offers an integrated, multi-sensory, and intuitive 6 DOF control due to its similarity to day-to-day interaction with real objects [17,33,48].…”

A State-of-the-Art Review of Augmented Reality in Engineering Analysis and Simulation

“…These modifications can be performed virtually, or physically. In the systems reported by Huang et al [41,42] and Issartel et al [71], the users can use a stylus to perform various interactions, such as add virtual loads on a 3D structure. Similarly, Valentini and Pezzuti [50] implemented a mechatronic tracker to manipulate virtual beam deformation in the AR environment.…”

“…Clothier et al [63] Assist on-site operation Underkoffler et al [64] Malkawi et al [65,66] Intuitive analysis environment Carmo et al [33,34] Heuveline et al [35,36] Golparvar-Fard et al [67,68] Graf et al [69] Intuitive design environment Broll et al [37] Fukuda et al [38,39] Mechanical engineering & Manufacturing Weidlich et al [70] Intuitive analysis environment NUS AR group, [27,41,42] Paulus, et al [43] Uva et al [44,45,47,48] Issartel et al [71] Bernasconi et al [40] Valentini et al [49,50] Naets et al [72] Moreland et al [73] Regenbrecht et al [74] Intuitive design environment Niebling et al [46] Weidenhausen et al [75] Electromagnetism Buchau et al [76] Training and education Ibáñez et al [51] Silva et al [77] Intuitive analysis environment Mannuß et al [52] Matsutomo et al [53,54] Table 6 summarizes the features and limitations of most of the AR-based engineering analysis and simulation systems. Selected studies use different visualization methods, such as image overlay, OpenGL programming, and special software kit, to visualize volumetric data and numerical simulation results.…”