Impact of semantic aids on command memorization for on-body interaction and directional gestures

Fruchard, Bruno; Lecolinet, Éric; Chapuis, Olivier

doi:10.1145/3206505.3206524

Cited by 17 publications

(19 citation statements)

References 47 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…We observed that 66.6% of the subjects formed groups of commands to facilitate memorization. This type of strategy has also been observed in other studies [7,13,24]. It is interesting to note that the majority of participants used this method without being instructed to do so.…”

Section: Research Leads and Suggestionssupporting

confidence: 76%

“…Once the user has learned a set of gestures, he can perform them quickly without being guided. Several studies showed that such gestures could be efficiently memorized (e.g., [3,13,26]) and that they provide advantages over keyboard shortcuts [1]. User customization can also improve memorization [22], as well as the degree of effort needed for performing gestures [10].…”

Section: Related Workmentioning

confidence: 99%

“…They proved to be efficient to trigger many commands, and users seemed able to memorize them efficiently [38]. However, few studies have considered comparing them so far [13,24]. This last study [24] showed superior performance for positional gestures but in a specific context (3D environment using the method of loci [35] ), which combined various factors and did not evaluate the respective effect of each of them.…”

Section: Related Workmentioning

confidence: 99%

“…As they already know the action to perform, and do not need to search for the desired command and move the pointer to its location, they can generally go faster. Gestural shortcuts can rely on positions when spatially-stable arrangements of items are used [18,28], or directions [20,36], and are assumed to favor memorization [13,25]. One might wonder, however, how these two approaches affect gesture learning and whether one performs better than the other.…”

Section: Introductionmentioning

confidence: 99%

“…Yet, it is unclear how much time users spend to learn with the novice mode and the strategies they use to do so. As a recent study showed, participants are able to elaborate strategies to memorize efficiently without being instructed [13].…”

Section: Introductionmentioning

confidence: 99%

See 4 more Smart Citations

How Memorizing Positions or Directions Affects Gesture Learning?

Fruchard

Lecolinet

Chapuis

2018

Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces

Self Cite

View full text Add to dashboard Cite

Various techniques have been proposed to faster command selection. Many of them either rely on directional gestures (e.g. Marking menus) or pointing gestures using a spatiallystable arrangement of items (e.g. FastTap). Both types of techniques are known to leverage memorization, but not necessarily for the same reasons. In this paper, we investigate whether using directions or positions affects gesture learning. Our study shows that, while recall rates are not significantly different, participants used the novice mode more often and spent more time while learning commands with directional gestures, and they also reported more physical and mental efforts. Moreover, this study also highlights the importance of semantic relationships between gestural commands and reports on the memorization strategies that were elaborated by the participants.

show abstract

Section: Research Leads and Suggestionssupporting

confidence: 76%

Section: Related Workmentioning

confidence: 99%

Section: Related Workmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

How Memorizing Positions or Directions Affects Gesture Learning?

Fruchard

Lecolinet

Chapuis

2018

Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces

Self Cite

View full text Add to dashboard Cite

show abstract

On-Body Tangible Interaction: Using the Body to Support Tangible Manipulations for Immersive Environments

Saidi¹,

Serrano²,

Irani³

et al. 2019

Human-Computer Interaction – INTERACT 2019

View full text Add to dashboard Cite

Recent technological advances in immersive devices open up many opportunities for users to visualize data in their environments. However, current interactive solutions fail at providing a convenient approach to manipulate such complex immersive visualizations. In this article, we present a new approach to interact in these environments, that we call On-Body Tangible interaction (OBT): using the body to physically support the manipulation of an input device. The use of the body to support the interaction allows the user to move in his environment and avoid the inherent fatigue of mid-air interactions. In this paper, we explore the use of a rolling device, which fits well on-body interaction thanks to its form factor and offers enough degrees of freedom (DoF) for data manipulation. We first propose a new design space for OBT interactions, and specifically on the forearm. Then we validate the feasibility of such an approach through an experiment aimed at establishing the range, stability and comfort of gestures performed with the device on the forearm. Our results reveal that on-body tangible interaction on the forearm is stable and offers multiple DoFs with little fatigue. We illustrate the benefits of our approach through sample applications where OBT interactions are used to select and execute space-time cube operations.

show abstract

Command Selection

Bailly

Malacria

2022

Handbook of Human Computer Interaction

View full text Add to dashboard Cite

HAL is a multi-disciplinary open access archive for the deposit and dissemination of scientific research documents, whether they are published or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers. L'archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d'enseignement et de recherche français ou étrangers, des laboratoires publics ou privés.

show abstract

Impact of semantic aids on command memorization for on-body interaction and directional gestures

Cited by 17 publications

References 47 publications

How Memorizing Positions or Directions Affects Gesture Learning?

How Memorizing Positions or Directions Affects Gesture Learning?

On-Body Tangible Interaction: Using the Body to Support Tangible Manipulations for Immersive Environments

Command Selection

Contact Info

Product

Resources

About