Novel interaction techniques by combining hand and foot gestures on tabletop environments

Sangsuriyachot, Nuttapol; Mi, Haipeng; Sugimoto, Masanori

doi:10.1145/2076354.2076409

Cited by 12 publications

(12 citation statements)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…For instance, Papadopoulos et al (2012) use defined body poses recognition in order to allow navigation in 3D environments. Additionally, gestural interaction is widely studied in the literature, but also one of the most popular approaches due to its intuitiveness, as gesture constitute a typical way of interaction among humans and their environment (Nickel and Stiefelhagen 2003;Sangsuriyachot et al 2011;Yoo et al 2010). Furthermore, hand gestures can be used to augment systems and allow supplementary interactions (Hilliges et al 2009) when combined with other means of interaction, such as single-or multitouch.…”

Section: Background and Related Workmentioning

confidence: 99%

“…Apart from single-hand gestures both users' hands may be used in combination to enrich the set of available gestures (Fikkert et al 2010). Finally, the use of feet gesturing (Sangsuriyachot et al 2011;Valkov et al 2010) and foot tapping (Crossan et al 2010;Ronkainen et al 2007) are occasionally conceded as supplementary helpful interaction tools.…”

Section: Background and Related Workmentioning

confidence: 99%

See 1 more Smart Citation

Public Systems Supporting Noninstrumented Body-Based Interaction

Grammenos

Drossis

Zabulis

2014

Gaming Media and Social Effects

View full text Add to dashboard Cite

Body-based interaction constitutes a very intuitive way for humans to communicate with their environment but also among themselves. Nowadays, various technological solutions allow for fast and robust, noninstrumented body tracking at various levels of granularity and sophistication. This chapter studies three distinct cases showcasing different representative approaches of employing body-based interaction for the creation of public systems, in two application domains: culture and marketing. The first case is a room-sized exhibit at an archeological museum, where multiple visitors concurrently interact with a large wall projection through their position in space, as well as through the path they follow. The second example is an ''advergame'' used as a means of enhancing the outdoor advertising campaign of a food company. In this case, players interact with the wall-projected game world through a virtual, two-dimensional shadow of their body. Finally, the third case presents a public system for exploring timelines in both two and three dimensions that supports detailed body tracking in combination with single-hand, two-hands, and leg gestures. Design considerations are provided for each case, including related benefits and shortcomings. Additionally, findings stemming from user-based evaluations and field observations on the actual use of these systems are presented, along with pointers to potential improvements and upcoming challenges.

show abstract

Section: Background and Related Workmentioning

confidence: 99%

Section: Background and Related Workmentioning

confidence: 99%

Public Systems Supporting Noninstrumented Body-Based Interaction

Grammenos

Drossis

Zabulis

2014

Gaming Media and Social Effects

View full text Add to dashboard Cite

show abstract

“…Gestures can be defined as a form of non-verbal communication in which visible body actions communicate particular messages; gestural interaction is not only widely studied in the literature, but is actually one of the most popular approaches that users prefer due to its intuitiveness [13,18,24]. Furthermore, hand gestures can be used to augment systems and allow supplementary interactions [7] when combined with other means of interaction, such as single-or multi-touch.…”

Section: Multimodal / Natural Interactionmentioning

confidence: 99%

“…Apart from single-hand gestures, both users' hands may be used in combination to enrich the set of available gestures [5]. Finally, the use of feet gesturing [18,22] and foot tapping [4,17] are occasionally conceded as supplementary helpful interaction tools.…”

Section: Multimodal / Natural Interactionmentioning

confidence: 99%

3D Visualization and Multimodal Interaction with Temporal Information Using Timelines

Drossis¹,

Grammenos²,

Adami³

et al. 2013

Human-Computer Interaction – INTERACT 2013

View full text Add to dashboard Cite

Abstract. This paper reports on the design, development and evaluation of TimeViewer, a system allowing the storing, visualization and multimodal interaction with temporal and semantic information using timelines in 3D environments. We focus on the appliance of 3D interactive timelines for temporal information visualization, extending their capabilities with the novel concept of a time-tunnel. Our work is intended to investigate beyond the current state of the art interaction with 3D environments using a variety of input modes, such as touch and full-body kinesthetic interaction. Qualitative results were elicited through an evaluation with 16 users in order to assess the users' opinion of the system, the efficiency of the offered interactions and direct future research in the area.

show abstract

“…It is possible to find different work in literature that exploit such device for the interaction: a virtual reality controller [53], in combination with hand gestures for table tops [118] or 3D touch devices [70]. In addition, there are many example in literatures that use such devices for medical purposes (e.g.…”

Section: Floor Devicesmentioning

confidence: 99%

A model-based approach for gesture interfaces

Spano

2011

Proceedings of the 3rd ACM SIGCHI Symposium on Engineering Interactive Computing Systems

View full text Add to dashboard Cite

This one goes out to the one I love "People shouldn't have to read a manual to open a door, even if it is only one word long (push/pull AbstractThe description of a gesture requires temporal analysis of values generated by input sensors, and it does not fit well the observer pattern traditionally used by frameworks to handle the user's input. The current solution is to embed particular gesture-based interactions into frameworks by notifying when a gesture is detected completely. This approach suffers from a lack of flexibility, unless the programmer performs explicit temporal analysis of raw sensors data. This thesis proposes a compositional, declarative meta-model for gestures definition based on Petri Nets. Basic traits are used as building blocks for defining gestures; each one notifies the change of a feature value. A complex gesture is defined by the composition of other sub-gestures using a set of operators. The user interface behaviour can be associated to the recognition of the whole gesture or to any other sub-component, addressing the problem of granularity for the notification of events.The meta-model can be instantiated for different gesture recognition supports and its definition has been validated through a proof of concept library. Sample applications have been developed for supporting multi-touch gestures in iOS and full body gestures with Microsoft Kinect.In addition to the solution for the event granularity problem, this thesis discusses how to separate the definition of the gesture from the user interface behaviour using the proposed compositional approach.The gesture description meta-model has been integrated into MARIA, a model-based user interface description language, extending it with the description of full-body gesture interfaces.

show abstract

Novel interaction techniques by combining hand and foot gestures on tabletop environments

Cited by 12 publications

References 4 publications

Public Systems Supporting Noninstrumented Body-Based Interaction

Public Systems Supporting Noninstrumented Body-Based Interaction

3D Visualization and Multimodal Interaction with Temporal Information Using Timelines

A model-based approach for gesture interfaces

Contact Info

Product

Resources

About