Cross-dimensional gestural interaction techniques for hybrid immersive environments

Abstract. The rising popularity of digital table surfaces has spawned considerable interest in new interaction techniques. Most interactions fall into one of two modalities: 1) direct touch and multi-touch (by hand and by tangibles) directly on the surface, and 2) hand gestures above the surface. The limitation is that these two modalities ignore the rich interaction space between them. To move beyond this limitation, we first contribute a unification of these discrete interaction modalities called the continuous interaction space. The idea is that many interaction techniques can be developed that go beyond these two modalities, where they can leverage the space between them. That is, we believe that the underlying system should treat the space on and above the surface as a continuum, where a person can use touch, gestures, and tangibles anywhere in the space and naturally move between them. Our second contribution illustrates this, where we introduce a variety of interaction categories that exploit the space between these modalities. For example, with our Extended Continuous Gestures category, a person can start an interaction with a direct touch and drag, and then naturally lift off the surface and continue their drag with a hand gesture over the surface. For each interaction category, we implement an example (or use prior work) that illustrates how that technique can be applied. In summary, our primary contribution is to broaden the design space of interaction techniques for digital surfaces, where we populate the continuous interaction space both with concepts and examples that emerge from considering this space as a continuum.

Section: Picking and Dropping Gesturesmentioning

confidence: 99%

Section: Picking and Dropping Gesturesmentioning

confidence: 99%

Section: D Gestural and Physics Based Interaction With Tabletopsmentioning

confidence: 99%

See 1 more Smart Citation

The Continuous Interaction Space: Interaction Techniques Unifying Touch and Gesture on and above a Digital Surface

Marquardt

Jota

Greenberg

et al. 2011

“…Although these environments provide a fancy visualization, it has not been investigated in how far they improve the interaction process, since they force the user to perform 3D interactions where 2D interactions are intended. Due to the mentioned shortcomings of virtual reality (VR) interfaces, hybrid approaches have been proposed which combine 2D and 3D interaction using different display or interaction technologies [4,21]. For example, Benko et al have discussed techniques to grab monoscopically displayed objects from a projection screen in order to view them stereoscopically using a head mounted display [4].…”

Section: D User Interfacesmentioning

confidence: 99%

Towards Applicable 3D User Interfaces for Everyday Working Environments

Steinicke

Ropinski

Bruder

et al. 2007

Abstract. Desktop environments represent a powerful user interface and have been used as the de facto standard human-computer interaction paradigm for over 20 years. But the rising demand of 3D applications dealing with complex datasets exceeds the capabilities of traditional interaction devices and two-dimensional displays. Such applications need more immersive and intuitive interfaces. In order to be accepted by the users, technology-driven solutions that require inconvenient instrumentation, e.g., stereo glasses or tracked gloves, should be avoided. Autostereoscopic display environments equipped with tracking systems enable humans to experience virtual 3D environments more naturally, for instance via gestures, without having to use annoying devices. However, currently these approaches are used only for specially designed or adapted applications. In this paper we introduce new 3D user interface concepts for such setups which require minimal instrumentation of the user and can be integrated easily in everyday working environments. We propose an interaction framework which supports simultaneous display of and simultaneous interaction with both monoscopic as well as stereoscopic contents. We identify the challenges for combined mouse-, keyboard-and gesture-based input paradigms in such an environment and introduce novel interaction strategies.

“…and output system (video-projector, individual head mounted displays [3], screen sensitive to the user's position around the table [11], etc.). While finding standard application don't fit well on tabletop systems, the need for new interaction technique bring us to build the DiamondSpin [14] [10] although they tend to exemplify their interaction techniques only on static documents, with tasks like organizing pictures, or use abstract icons to figure documents [1].…”

Section: Related Workmentioning

confidence: 99%

Paper Metaphor for Tabletop Interaction Design

Besacier

Rey

Najm

et al.

Abstract. The aim of this paper is to explore new metaphors for interaction design on tabletop system. Tabletop systems are shared horizontal surface for co-located collaboration, which leads to original problems when designing interactions. We propose two metaphors based on the paper: the peeling metaphor, and the slot metaphor, and then suggest a way of using them to design new interactions for solving some of the problems of tabletop systems: documents organization, documents transmission and documents duplication.