A Lightweight Tangible 3D Interface for Interactive Visualization of Thin Fiber Structures

Abstract

We present a prop-based, tangible interface for 3D interactive visualization of thin fiber structures. These data are commonly found in current bioimaging datasets, for example second-harmonic generation microscopy of collagen fibers in tissue. Our approach uses commodity visualization technologies such as a depth sensing camera and low-cost 3D display. Unlike most current uses of these emerging technologies in the games and graphics communities, we employ the depth sensing camera to create a fish-tank stereoscopic virtual reality system at the scientist's desk that supports tracking of small-scale gestures with objects already found in the work space. We apply the new interface to the problem of interactive exploratory visualization of three-dimensional thin fiber data. A critical task for the visual analysis of these data is understanding patterns in fiber orientation throughout a volume.The interface enables a new, fluid style of data exploration and fiber orientation analysis by using props to provide needed passive-haptic feedback, making 3D interactions with these fiber structures more controlled. We also contribute a low-level algorithm for extracting fiber centerlines from volumetric imaging. The system was designed and evaluated with two biophotonic experts who currently use it in their lab. As compared to typical practice within their field, the new visualization system provides a more effective way to examine and understand the 3D bioimaging datasets they collect.

Mouse, Tactile, and Tangible Input for 3D Manipulation

“…All these are likely to favor mouse-and touch-based input, as tangible interaction will likely be more difficult to use for generic interaction unless multiple tangible input devices are used. Tangible input, however, may have some benefits for specialized input (e. g., [24,55]), while touch input may be better for integrated approaches (e. g., [9,32,55]). A final aspect to consider for realistic application scenarios is that in these, unlike the participant population we tested, we would be faced with experts in 3D interaction as they carry out such tasks on an everyday basis.…”

Hybrid Tactile/Tangible Interaction for 3D Data Exploration

“…While many TUIs use tangible props as both physical representation and means of interaction, several TUIs focus more on the input aspect [26,[34][35][36][37]67] by considering the tangible props as handles. Tangible input inherently offers 6 integrated DOF per prop.…”

“…Like Guzman et al, Mulder et al's [52] approach relies on a fixed tracking system and a fixed display setup and maps the orientation of a tracked pen to that of a virtual slicing plane, while Schkolne et al [60] use tracked props to position elements in 3D space for molecular visualization. A more lightweight tracking approach is used by Jackson et al [37] whose tangible interface consists of a printed 2D barcode that can be rolled into a pen-like object whose location and orientation can be easily captured using a camera-to be used, for example, for fibertract exploration. While Issartel et al's [35] data exploration system also relies on simple fiducial tracking to control the cutting plane with a tangible pen, they integrate this approach in a portable and affordable augmented reality setup that uses a tablet computer to view the dataset and track the interaction props.…”

Hybrid Touch/Tangible Spatial 3D Data Selection

“…A similar setup is used by Nystrom et al [NMVB09]. Finally, Jackson et al [JLS∗13] use a rolled paper as a tangible prop to facilitate selection of thin fiber structures. We also allow users to provide 3D tangible input but we combine it with an initial touch input.…”