On free-hand TV control: experimental results on user-elicited gestures with Leap Motion

Zaiți, Ionuț-Alexandru; Pentiuc, Štefan Gheorghe; Vatavu, Radu-Daniel

doi:10.1007/s00779-015-0863-y

Cited by 95 publications

(36 citation statements)

References 46 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Towards this end, the present study aimed to understand the type of conceptual representations users deployed to form their mid-air gestures. compared user agreement rates between hands-free interaction and augmented remote control interaction [2], [11], [12]. Further research on mid-air gesturebased TV control examined the possibilities of handsfree text entry for Interactive TVs and preferences for mid-air gesture control among older adults' [13], [14].…”

Section: Structural and Ontological Metaphors Show Similaritiesmentioning

confidence: 99%

See 1 more Smart Citation

Individual Mid-Air Gesture Sets Informed by Conceptual Metaphors: A Case Study on How Users Generate Mid-Air Gesture Sets to Control Video Streaming

2019

DeSForM19 Proceedings

View full text Add to dashboard Cite

Recent research on mid-air gesture interaction for TV control aimed to standardize them. To this end, researchers developed a design approach that relies on the agreement rates among the elicited end-user gestures. Contrasting with the agreement based approach; a recent study have shown that the most common mid-air gestures might not be the most favored ones. In addition to this, researchers claimed that the agreement studies ignore users' cultural and conceptual bias. Thus, it can be postulated that the mid-air gesture interaction research can benefit from a qualitative analysis of the users' mid-gesture set design processes. Towards this end, this study investigated users' task conceptualizations and mental models. For this purpose, a mid-air gesture-based video streaming experiment was simulated with 10 participants, 4 females and 6 males. Through the lens of Conceptual Metaphor Theory, the study investigated the similarities between the participants' conceptual representations.The study findings demonstrated that the participants' conceptualizations had clear references to their bodies and prior physical experiences with the objects, which reflected as linguistic representations of orientational and ontological metaphors in participants' explanations.Further findings of the study addressed intersections between participants' mental models. KeywordsMid-air gesture interaction, conceptual metaphors, The Wizard of Oz method, video streaming experienceResearch on novel TV control systems projects a future interaction experience that surpasses the limits of graphical interfaces. Research in the Human-Computer Interaction field has highlighted that mid-air gesture interaction may deliver the desired "natural" interaction experience. However, researchers have found that the standardization of the mid-air gesture interaction was problematic. In pursuit of a standardized mid-air gesture vocabulary, several elicitation studies were conducted. These studies aimed to find the most recurring mid-air gestures to design the gesture sets. In this way, the produced mid-air gestures could become the archetypes of their category. However, in a recent

show abstract

Section: Structural and Ontological Metaphors Show Similaritiesmentioning

confidence: 99%

“…The number of streaming platform use per household has surpassed that of cable TV use in some countries [1]. The evolution in content accessibility has reinforced the idea of redesigning our interaction with TV [2].…”

Section: Introductionmentioning

confidence: 99%

Individual Mid-Air Gesture Sets Informed by Conceptual Metaphors: A Case Study on How Users Generate Mid-Air Gesture Sets to Control Video Streaming

2019

DeSForM19 Proceedings

View full text Add to dashboard Cite

show abstract

“…Several studies employ mid-air interaction to improve the UX of (smart) TVs (6 out of 47, 12.8%), which have evolved beyond the passive TV-watching paradigm into interactive multimedia devices with features like web browsing, content manipulation, media playback and so forth. Notably, in Reference [28] freehand gesture vocabularies for controlling the TV have been proposed, while in Reference [37] the gesture vocabulary is for blind users.…”

Section: Application Domainsmentioning

confidence: 99%

“…Referents can be presented to the participants in various ways. Depending on the type and maturity of the prototype used, referents were either demonstrated through GUI animations [41,54], described as a text message on the screen, or verbally [4,28,37,61], presented as a video [51,61] or still images [19,24,34,55], or presented by manipulating the actual artefact [7,45].…”

Section: Referent Presentationmentioning

confidence: 99%

“…The Level of agreement was initially introduced by Wobbrock in 2005 [62] and was refined by Vatavu and Wobbrock in 2015 [74] which is called "Agreement Rate". Even though Agreement rate was claimed as an improved version of the Level of agreement, only half of the papers that were published after 2015 (8 out of 15, 53.3%) have utilized it [24,28,30,31,[38][39][40]44].…”

Section: Metricsmentioning

confidence: 99%

See 1 more Smart Citation

Gesture Elicitation Studies for Mid-Air Interaction: A Review

Vogiatzidakis

Koutsabasis

2018

MTI

View full text Add to dashboard Cite

Mid-air interaction involves touchless manipulations of digital content or remote devices, based on sensor tracking of body movements and gestures. There are no established, universal gesture vocabularies for mid-air interactions with digital content or remote devices based on sensor tracking of body movements and gestures. On the contrary, it is widely acknowledged that the identification of appropriate gestures depends on the context of use, thus the identification of mid-air gestures is an important design decision. The method of gesture elicitation is increasingly applied by designers to help them identify appropriate gesture sets for mid-air applications. This paper presents a review of elicitation studies in mid-air interaction based on a selected set of 47 papers published within 2011-2018. It reports on: (1) the application domains of mid-air interactions examined; (2) the level of technological maturity of systems at hand; (3) the gesture elicitation procedure and its variations; (4) the appropriateness criteria for a gesture; (5) participants number and profile; (6) user evaluation methods (of the gesture vocabulary); (7) data analysis and related metrics. This paper confirms that the elicitation method has been applied extensively but with variability and some ambiguity and discusses under-explored research questions and potential improvements of related research.Multimodal Technologies and Interact. 2018, 2, 65 2 of 21 such thing as a universal gesture vocabulary for every application" [15]. Thus, the identification of appropriate gestures for mid-air user interactions in terms of criteria like discoverability, memorability, performance, reliability and comfort, is an important design decision. This must be made at the early stages of system development and it severely affects the development course of every mid-air application project as well as the user experience (UX) of intended users.Emerging from the field of participatory design, gesture elicitation studies have been widely applied to help designers select the most appropriate gesture set for a given application. Although the method does not have a strict procedure, the main approach is to first define what operations (called "referents") have to be executed through gestures, then ask the end users to propose at least one gesture that they find preferable for each referent and finally to extract the gesture vocabulary after analysing the collected data [16]. The goal of a gesture elicitation study is to extract "good" gestures, which according to Morris et al. [17] are "gestures that meet certain design criteria such as discoverability, ease-of-performance, memorability, or reliability."Over the last few years, several elicitation studies have been conducted to identify mid-air gesture vocabularies for many different application domains and contexts, devices, types of digital content and tracking technologies subsumed. A survey of elicitation studies of mid-air interaction is useful to HCI researchers and interaction designers for deepening th...

show abstract

Exploration of Ideal Interaction Scheme on Smart TV: Based on User Experience Research of Far-Field Speech and Mid-air Gesture Interaction

Guan

Zhang

et al. 2019

Lecture Notes in Computer Science

View full text Add to dashboard Cite

On free-hand TV control: experimental results on user-elicited gestures with Leap Motion

Cited by 95 publications

References 46 publications

Individual Mid-Air Gesture Sets Informed by Conceptual Metaphors: A Case Study on How Users Generate Mid-Air Gesture Sets to Control Video Streaming

Individual Mid-Air Gesture Sets Informed by Conceptual Metaphors: A Case Study on How Users Generate Mid-Air Gesture Sets to Control Video Streaming

Gesture Elicitation Studies for Mid-Air Interaction: A Review

Exploration of Ideal Interaction Scheme on Smart TV: Based on User Experience Research of Far-Field Speech and Mid-air Gesture Interaction

Contact Info

Product

Resources

About