A multimodal virtual reality interface for 3D interaction with VTK

Abstract

The object-oriented visualization Toolkit (VTK) is widely used for scientific visualization. VTK is a visualization library that provides a large number of functions for presenting three-dimensional data. Interaction with the visualized data is controlled with two-dimensional input devices, such as mouse and keyboard. Support for real three-dimensional and multimodal input is non-existent. This paper describes VR-VTK: a multimodal interface to VTK on a virtual environment. Six degree of freedom input devices are used for spatial 3D interaction. They control the 3D widgets that are used to interact with the visualized data. Head tracking is used for camera control. Pedals are used for clutching. Speech input is used for application commands and system control. To address several problems specific for spatial 3D interaction, a number of additional features, such as more complex interaction methods and enhanced depth perception, are discussed. Furthermore, the need for multimodal input to support interaction with the visualization is shown. Two existing VTK applications are ported using VR-VTK to run in a desktop virtual reality system. Informal user experiences are presented.

Region of interest three-dimensional visualization in clinical human CT images sequence

“…It is provided as a C++ library with interfaces to the interpreted languages Tcl, Python and Java. Object oriented design, high level interface and possibility to write scripted components make it an excellent tool for a wide range of applications, from few lines throw-away scripts, to complex visualization systems [9][10][11]. It has been widely applied in 3D reconstruction of medical images.…”

Real-Time Gray and Coordinate Statistics Methods of Medical CT Image

“…The Visualization Toolkit is an open source, freely available software system for 3D computer graphics, image processing, and visualization used by thousands of researchers and developers around the world. VTK consists of a C++ class library, and several interpreted interface layers including Tcl/Tk, Java, and Python [21][22][23]. Professional support and products for VTK are provided by Kitware, Inc. VTK supports a wide variety of visualization algorithms including scalar, vector, tensor, texture, and volumetric methods; and advanced modeling techniques such as implicit modeling, polygon reduction, mesh smoothing, cutting, contouring, and Delaunay triangulation.…”

Performance Comparison of User Interface Devices for Controlling Mining Software in Virtual Reality Environments

“…Most of the VR content in the mining industry requires precise control for equipment operation or accident response. In other industries, studies have been conducted on the development of user interface devices that can enhance user immersion and effectively control software in a VR environment [22][23][24][25][26][27]. For example, Kaiser et al [24] developed 3D multimodal interaction in immersive virtual reality environments using gesture, language, and gaze.…”