It Made More Sense: Comparison of User-Elicited On-skin Touch and Freehand Gesture Sets

Havlucu, Hayati; Ergin, Mehmet Yarkın; Bostan, İdil; Buruk, Oğuz; Göksun, Tilbe; Özcan, Oğuzhan

doi:10.1007/978-3-319-58697-7_11

Cited by 12 publications

(6 citation statements)

References 33 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Villarreal et al [ 39 ] reported that GES were performed on almost all human limbs: the most frequent cover hand gestures [ 40 ] and their fingers [ 2 , 41 ], on-skin freehand gestures [ 42 ], arms gestures [ 43 ], head gestures[ 44 , 45 ], while the least frequent investigate limbs with less mobility, such as the mouth [ 33 ], the head and shoulders [ 46 ], the torso [ 47 ], and the belly [ 48 ]. GES can be the object of study in contexts where it is required to understand any particular physical capacity or human ability or the deficiency thereof.…”

Section: Related Workmentioning

confidence: 99%

A Gesture Elicitation Study of Nose-Based Gestures

Pérez-Medina

Villarreal

Vanderdonckt

2020

Sensors

View full text Add to dashboard Cite

Presently, miniaturized sensors can be embedded in any small-size wearable to recognize movements on some parts of the human body. For example, an electrooculography-based sensor in smart glasses recognizes finger movements on the nose. To explore the interaction capabilities, this paper conducts a gesture elicitation study as a between-subjects experiment involving one group of 12 females and one group of 12 males, expressing their preferred nose-based gestures on 19 Internet-of-Things tasks. Based on classification criteria, the 912 elicited gestures are clustered into 53 unique gestures resulting in 23 categories, to form a taxonomy and a consensus set of 38 final gestures, providing researchers and practitioners with a larger base with six design guidelines. To test whether the measurement method impacts these results, the agreement scores and rates, computed for determining the most agreed gestures upon participants, are compared with the Condorcet and the de Borda count methods to observe that the results remain consistent, sometimes with a slightly different order. To test whether the results are sensitive to gender, inferential statistics suggest that no significant difference exists between males and females for agreement scores and rates.

show abstract

Section: Related Workmentioning

confidence: 99%

A Gesture Elicitation Study of Nose-Based Gestures

Pérez-Medina

Villarreal

Vanderdonckt

2020

Sensors

View full text Add to dashboard Cite

show abstract

“…Different types of users may play different roles, which are also influenced by their culture [36]. [37] studied hand gestures, while [38] compared freehand gestures with gestures that are issued on the skin. Any limb, physical capability or deficiency thereof may also become the subject of a GES.…”

Section: ) For Multiple Usersmentioning

confidence: 99%

Eliciting Contact-Based and Contactless Gestures With Radar-Based Sensors

et al. 2019

View full text Add to dashboard Cite

Radar sensing technologies now offer new opportunities for gesturally interacting with a smart environment by capturing microgestures via a chip that is embedded in a wearable device, such as a smartwatch, a finger or a ring. Such microgestures are issued at a very small distance from the device, regardless of whether they are contact-based, such as on the skin, or contactless. As this category of microgestures remains largely unexplored, this paper reports the results of a gesture elicitation study that was conducted with twenty-five participants who expressed their preferred user-defined gestures for interacting with a radar-based sensor on nineteen referents that represented frequent Internet-of-things tasks. This study clustered the 25 × 19 = 475 initially elicited gestures into four categories of microgestures, namely, micro, motion, combined, and hybrid, and thirty-one classes of distinct gesture types and produced a consensus set of the nineteen most preferred microgestures. In a confirmatory study, twenty new participants selected gestures from this classification for thirty referents that represented tasks of various orders; they reached a high rate of agreement and did not identify any new gestures. This classification of radar-based gestures provides researchers and practitioners with a larger basis for exploring gestural interactions with radar-based sensors, such as for hand gesture recognition.

show abstract

“…Generally, there are many other interesting domains of application for which elicitation studies have been conducted ( Table 3) like mid-air manipulations in Virtual Reality [20,35,48,59], Smart Home environments [7,25,38,46] Mobile Devices [4,43,47,49] for Human-Robot/Drone manipulation [45,57,58], Augmented Reality [33,39], Desktop computer [30,50], In-Vehicle secondary driving task [52,56] Smartwatches [11,32], Gaming [19], CAD [53], Text readers [31], Operating rooms [23] and Digital exhibition [21].…”

Section: Application Domainsmentioning

confidence: 99%

“…Many other dimensions of the appropriateness of a mid-air gesture were examined, such as comfort [11,23,27,36,44,60], perceived fatigue [24,36,40,50], discoverability [34,55,58] learnability (how easy gestures can be learned) [24,27,50], gesture simplicity [26,45,61], body parts suitability [19,73], concurrent gestures during intense gameplay [19] and unimanual or bimanual gestures [48,53]. Finally, a few studies (7 out of 47, 14.9%) did not mentioned any specific focus of the gestures proposed.…”

Section: On Gesture "Appropriateness"mentioning

confidence: 99%

Gesture Elicitation Studies for Mid-Air Interaction: A Review

Vogiatzidakis

Koutsabasis

2018

MTI

View full text Add to dashboard Cite

Mid-air interaction involves touchless manipulations of digital content or remote devices, based on sensor tracking of body movements and gestures. There are no established, universal gesture vocabularies for mid-air interactions with digital content or remote devices based on sensor tracking of body movements and gestures. On the contrary, it is widely acknowledged that the identification of appropriate gestures depends on the context of use, thus the identification of mid-air gestures is an important design decision. The method of gesture elicitation is increasingly applied by designers to help them identify appropriate gesture sets for mid-air applications. This paper presents a review of elicitation studies in mid-air interaction based on a selected set of 47 papers published within 2011-2018. It reports on: (1) the application domains of mid-air interactions examined; (2) the level of technological maturity of systems at hand; (3) the gesture elicitation procedure and its variations; (4) the appropriateness criteria for a gesture; (5) participants number and profile; (6) user evaluation methods (of the gesture vocabulary); (7) data analysis and related metrics. This paper confirms that the elicitation method has been applied extensively but with variability and some ambiguity and discusses under-explored research questions and potential improvements of related research.Multimodal Technologies and Interact. 2018, 2, 65 2 of 21 such thing as a universal gesture vocabulary for every application" [15]. Thus, the identification of appropriate gestures for mid-air user interactions in terms of criteria like discoverability, memorability, performance, reliability and comfort, is an important design decision. This must be made at the early stages of system development and it severely affects the development course of every mid-air application project as well as the user experience (UX) of intended users.Emerging from the field of participatory design, gesture elicitation studies have been widely applied to help designers select the most appropriate gesture set for a given application. Although the method does not have a strict procedure, the main approach is to first define what operations (called "referents") have to be executed through gestures, then ask the end users to propose at least one gesture that they find preferable for each referent and finally to extract the gesture vocabulary after analysing the collected data [16]. The goal of a gesture elicitation study is to extract "good" gestures, which according to Morris et al. [17] are "gestures that meet certain design criteria such as discoverability, ease-of-performance, memorability, or reliability."Over the last few years, several elicitation studies have been conducted to identify mid-air gesture vocabularies for many different application domains and contexts, devices, types of digital content and tracking technologies subsumed. A survey of elicitation studies of mid-air interaction is useful to HCI researchers and interaction designers for deepening th...

show abstract

It Made More Sense: Comparison of User-Elicited On-skin Touch and Freehand Gesture Sets

Cited by 12 publications

References 33 publications

A Gesture Elicitation Study of Nose-Based Gestures

A Gesture Elicitation Study of Nose-Based Gestures

Eliciting Contact-Based and Contactless Gestures With Radar-Based Sensors

Gesture Elicitation Studies for Mid-Air Interaction: A Review

Contact Info

Product

Resources

About