Cubic-Mouse-based interaction in virtual environments

Fröhlich, Bernd; Plate, John; Wind, Jürgen; Wesche, Gerold; Göbel, Martin

doi:10.1109/38.851743

Cited by 28 publications

(17 citation statements)

References 2 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Interactions that allow people to place and manipulate cutting planes have been employed for the exploration of scientific datasets for a long time (e. g., [8,17,36]). This interaction is also important to understand the extracted DTI fiber tracts in relation to the brain's structure in our examples.…”

Section: Manipulation Of Cutting Planesmentioning

confidence: 99%

FI3D: Direct-Touch Interaction for the Exploration of 3D Scientific Visualization Spaces

Svetachov

Isenberg

et al. 2010

IEEE Trans. Visual. Comput. Graphics

View full text Add to dashboard Cite

Abstract-We present the design and evaluation of FI3D, a direct-touch data exploration technique for 3D visualization spaces. The exploration of three-dimensional data is core to many tasks and domains involving scientific visualizations. Thus, effective data navigation techniques are essential to enable comprehension, understanding, and analysis of the information space. While evidence exists that touch can provide higher-bandwidth input, somesthetic information that is valuable when interacting with virtual worlds, and awareness when working in collaboration, scientific data exploration in 3D poses unique challenges to the development of effective data manipulations. We present a technique that provides touch interaction with 3D scientific data spaces in 7 DOF. This interaction does not require the presence of dedicated objects to constrain the mapping, a design decision important for many scientific datasets such as particle simulations in astronomy or physics. We report on an evaluation that compares the technique to conventional mouse-based interaction. Our results show that touch interaction is competitive in interaction speed for translation and integrated interaction, is easy to learn and use, and is preferred for exploration and wayfinding tasks. To further explore the applicability of our basic technique for other types of scientific visualizations we present a second case study, adjusting the interaction to the illustrative visualization of fiber tracts of the brain and the manipulation of cutting planes in this context.

show abstract

Section: Manipulation Of Cutting Planesmentioning

confidence: 99%

FI3D: Direct-Touch Interaction for the Exploration of 3D Scientific Visualization Spaces

Svetachov

Isenberg

et al. 2010

IEEE Trans. Visual. Comput. Graphics

View full text Add to dashboard Cite

show abstract

“…Most game engines provide support for standard input devices such as, joysticks, gamepads, keyboard. Technological improvements and cost reduction in computing power, display and sensor technology have resulted in a widespread use of 3D Input Devices [24][25][26]. Such devices such as the Nintendo Wii and Playstation sixaxis controller provide 6 Degrees Of Freedom interaction that could enhance the user interaction with the environment and increase the immersion of the user.…”

Section: B Overview Of Modern Game Enginesmentioning

confidence: 99%

An Engine Selection Methodology for High Fidelity Serious Games

Petridis

Dunwell

Freitas

et al. 2010

2010 Second International Conference on Games and Virtual Worlds for Serious Applications

View full text Add to dashboard Cite

Abstract-Serious games represent the state-of-the-art in the convergence of electronic gaming technologies with instructional design principles and pedagogies. Whilst the selection criteria for entertainment game engines are often transparent, due to the range of available platforms and engines an emerging challenge is the choice of platform for serious games, whose selection often has substantially different objectives and technical requirements depending upon context and usage. Additionally, the convergence of training simulations with serious gaming, made possible by increasing hardware rendering capacity, is enabling the creation of high-fidelity serious games which challenge existing design and instructional approaches. This paper highlights some of the differences between the technical requisites of high-fidelity serious and leisure games, and proposes a selection methodology based upon these emergent characteristics. The case study of part of a high-fidelity model of Ancient Rome is used to compare aspects of the four different game engines according to elements defined in the proposed methodology.

show abstract

“…Unfortunately, 3D interaction often breaks all these rules-^the objects of interest may be xinknown and may reside far away in the 3D envirormient, and there may be far more possible actions that can be perJFormed than GUI fimction buttons or menu items can realistically provide. To cope with these problems, some researchers have taken the direct manipulation style of interaction to extremes, creating devices with many buttons and modes [Frohlich et al 2000], arbitrarily stretchable "arms" [Poupyrev et al 1996], and 3D menus [Liang and Green 1994]. We contend that sometimes too much fimctionality has been forced on too impoverished a communications channel (3D arm/hand motions), and that by incorporating muitimodal interaction, the burden of various interactive fimctions can be off-loaded to appropriate modalities, such as speech and gesture, in a synergistic fashion.…”

Section: Introductionmentioning

confidence: 99%

Multimodal Interaction for Wearable Augmented Reality Environments

Cohen¹

2003

View full text Add to dashboard Cite

Public reporting burden for this collection of Information Is estimated to average 1 hour per response, Including the time for reviewing Instructions, searching data sources, gathering and maintaining the data needed, and completing and reviewing the collection of Infomnation. We describe an approach to natural 3D multimodal interaction in immersive environments. Our approach fuses symbolic and statistical information from a set of 3D gesture and speech agents, building in part on prior research on disambiguating the user's intent in 2D and 2.5D user interfaces. We present an experimental system architecture that embodies this approach, and provide examples from a preliminary 3D multimodal testbed to explore our ideas in augmented and virtual reality. Accomplishments:This project accomplished ground-breaking work in the integration of multiple modalities and knowledge sources into 3D augmented reality environments. Working with Columbia University, we extended the basic 2D architecture developed at OGI by incorporating 3D gesture recognition and information from reasoning about a scene into a full 3D multimodal augmented reality system. The system uses a detailed 3D model of the Columbia University Graphics Laboratory, including the physical objects within the lab, such as tables, chairs, walls, etc. The user's body is tracked using either a Flock of Birds magnetic tracker, or an Ascension IS900 wireless tracker. Extensions were made to the AAA multiagent architecture to enable it to support high-volume point-to-point communication. This work is detailed in the attached draft paper, which is being revised for publication.Among the other accomplishments of this project were:-Development of a 3-level recognition architecture (Members-Teams-Committee), which supports statistical and symbolic fusion for multimodal systems. This recognition architectiire was shown to offer superior error handling (reducing error rates approx. 30%) over the existing symbolic-integration-only system. This recognition architecture was also deployed as a pen-based gesture recognizer for military symbols.-Integration of the gesture recognizer into the first tangible multimodal system (Rasa). Rasa enables a military user to continue to employ his highly trained work style (using paper maps and Post-It notes), while the user's multimodal input is digitized simultaneously. Often, warfighters ignore the computers in their environment, preferring to employ paper-based tools. The Rasa system provides both the benefits of paper and digital systems. The system has been tested with members of the USMC and the US Army National Guard, and foimd to be preferred to paper alone, and to be robust to power and computer failures. Publications:Cohen We describe an approach to natural 3D muitimodal interaction in immersive environments. Our approach fuses symbolic and statistical information from a set of 3D gesture and speech agents, building in part on prior research on disambiguating the user's intent in 2D and 2.5D user interfaces. We present an experi...

show abstract

Cubic-Mouse-based interaction in virtual environments

Cited by 28 publications

References 2 publications

FI3D: Direct-Touch Interaction for the Exploration of 3D Scientific Visualization Spaces

FI3D: Direct-Touch Interaction for the Exploration of 3D Scientific Visualization Spaces

An Engine Selection Methodology for High Fidelity Serious Games

Multimodal Interaction for Wearable Augmented Reality Environments

Contact Info

Product

Resources

About