Exploring At-Your-Side Gestural Interaction for Ubiquitous Environments

Abstract

International audienceFree-space gestural systems are faced with two major issues: a lack of subtlety due to explicit mid-air arm movements, and the highly effortful nature of such interactions. With an ever-growing ubiquity of interactive devices, displays, and appliances with non-standard interfaces, lower-effort and more socially acceptable interaction paradigms are essential. To address these issues, we explore at-one's-side gestural input. Within this space, we present the results of two studies that investigate the use of side-gesture input for interaction. First, we investigate end-user preference through a gesture elicitation study, present a gesture set, and validate the need for dynamic, diverse, and variable-length gestures. We then explore the feasibility of designing such a gesture recognition system, dubbed WatchTrace, which supports alphanumeric gestures of up to length three with an average accuracy of up to 82%, providing a rich, dynamic, and feasible gestural vocabulary

Frame-Based Elicitation of Mid-Air Gestures for a Smart Home Device Ecosystem

“…Chan et al [3], have conducted an elicitation study for single-hand microgestures, which can be tracked with wearable sensors like the Myo Armband. Another interesting approach of microgestures is proposed by Siddhpuria et al [23], which assumes a smartwatch as a wearable sensor and actuator. These studies employ simple commands as referents which, to some extent, are similar to those required in a smart home environment.…”

Gesture Elicitation Studies for Mid-Air Interaction: A Review

“…The control of various types of media, like music, videos, (types of) image collections and so forth, in the mid-air is a challenging design issue. A considerable number of elicitation studies (7/47, 14.9%) focus on mid-air media control, like the work of Ruiz et al [34] who elicit a gesture set for controlling 360 degrees videos or the work of Siddhpuria et al [40] who explore the use of discrete micro-gestures through a smartwatch for control of remote media.…”

“…Many other dimensions of the appropriateness of a mid-air gesture were examined, such as comfort [11,23,27,36,44,60], perceived fatigue [24,36,40,50], discoverability [34,55,58] learnability (how easy gestures can be learned) [24,27,50], gesture simplicity [26,45,61], body parts suitability [19,73], concurrent gestures during intense gameplay [19] and unimanual or bimanual gestures [48,53]. Finally, a few studies (7 out of 47, 14.9%) did not mentioned any specific focus of the gestures proposed.…”

“…The Level of agreement was initially introduced by Wobbrock in 2005 [62] and was refined by Vatavu and Wobbrock in 2015 [74] which is called "Agreement Rate". Even though Agreement rate was claimed as an improved version of the Level of agreement, only half of the papers that were published after 2015 (8 out of 15, 53.3%) have utilized it [24,28,30,31,[38][39][40]44].…”

“…Almost half of the papers reviewed (22 out of 47, 46.8%), analysed various characteristics of the proposed gestures by classifying them into different categories, called taxonomies. Taxonomies help researchers to gain some insights about the mental model of users [65] and guide designers to understand the type of gestures that are appropriate for various referents [40].…”