A novel taxonomy for gestural interaction techniques based on accelerometers

Abstract

A large variety of gestural interaction techniques based on accelerometers is now available. In this article, we propose a new taxonomic space as a systematic structure for supporting the comparative analysis of these techniques as well as for designing new ones. An interaction technique is plotted as a point in a space where the vertical axis denotes the semantic coverage of the techniques, and the horizontal axis expresses the physical actions users are engaged in, i.e. the lexicon. In addition, syntactic modifiers are used to express the interpretation process of input tokens into semantics, as well as pragmatic modifiers to make explicit the level of indirection between users' actions and system responses. To demonstrate the coverage of the taxonomy, we have classified 25 interaction techniques based on accelerometers. The analysis of the design space per se reveals directions for future research.

Orientation-Based Interaction on Mobile Devices and Desktops - An Evaluation

“…Tilting and turning as interaction metaphor of mobile devices finds relevance in the work of [2,15,8,12,10]. Baglioni et al [2] analyzed device tilting interaction using accelerometer.…”

Designing for movement

“…Accelerometers have been mostly used for tasks such as navigation [1], pointing [31], gesture-based authentication [10], or text input [13]. These single-accelerometer systems usually include movement properties such as its contours [1], orientation, tilt and direction [6], but only few of them take into consideration the dynamical or temporal component of movement by including for instance variation of speed and acceleration (which are crucial to the notion of MQs) [27]. However, some accelerometer-based systems have explored aspects of MQs for example, when recognizing semaphoric signals such as shakes, whacks, or bumps [6], which all have Direct and Sudden qualities.…”

“…Laban considers the Effort qualities as expressive attributes of movement produced by dynamics. Although MQs are a central notion that conveys movement expressiveness, they haven't been explored in designing and evaluating Human-Computer Interactions until lately [9,11,17,27]. We believe that because MQs reveals movement expressiveness, their use has strong potential for movement-based interaction with applications in the arts, digital media, entertainment, education, or rehabilitation.…”

A Compositional Model for Gesture Definition

“…For instance, in [14] the authors characterized the physical actions that users need to perform to enter a command through accelerometer-based devices. While such categorization is useful to define how and why the user should perform an action rather than another, the following step is to ease the development of such kind of interfaces.…”