Exploring user-defined gestures for lingual and palatal interaction

Villarreal-Narvaez, Santiago; Perez-Medina, Jorge Luis; Vanderdonckt, Jean

doi:10.1007/s12193-023-00408-7

Cited by 3 publications

(1 citation statement)

References 32 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…(1) Assigning gestures of the same dynamic characteristics to the tasks of the same category [57]. Some visual analytics tasks involve multi-step operations such as selecting multiple objects and conditional filtering.…”

Section: B Design Suggestionsmentioning

confidence: 99%

User-Defined Interactions for Visual Data Exploration With the Combination of Smartwatch and Large Display

Xiao,

Liu

2024

IEEE Access

View full text Add to dashboard Cite

The process of visual analytics is composed of the visual data exploration tasks supporting analytical reasoning. When performing analytical tasks with the interactive visual interfaces displayed by the large screen, physical discomforts such as gorilla-arm effect can be easily caused. To enrich the input space for analysts, there has been some researches concerning the cross-device analysis combining mobile devices with the large display. Although the effectiveness of expert-level designs has been demonstrated, little is known of the ordinary users' preferences for using a mobile device to issue commands, especially the small one like smartwatch. We implement a three-stage study to investigate and validate these preferences. A total of 181 distinctive gestural inputs and 52 interface designs for 21 tasks were collected from analysts. Expert designers selected the best practices from these user-defined interactions. A performance test was subsequently developed to assess the selected interactions in terms of quantitative statistics and subjective ratings. Our work provides empirical support and proposes a set of design guidelines for optimizing watch-based interactions aimed at remote control of visual data on the large display. Through this research, we hope to advance the development of smartwatches as visual analytics tools and provide visual analysts with a better usage experience.INDEX TERMS User-defined interaction, visual analytics, smartwatch, large display.

show abstract

Section: B Design Suggestionsmentioning

confidence: 99%

User-Defined Interactions for Visual Data Exploration With the Combination of Smartwatch and Large Display

Xiao,

Liu

2024

IEEE Access

View full text Add to dashboard Cite

show abstract

Exploring Methods to Optimize Gesture Elicitation Studies: A Systematic Literature Review

Cheng,

Wu,

Xiao

2024

IEEE Access

View full text Add to dashboard Cite

Gesture elicitation is a fundamental method for constructing gesture-based interactive systems. Existing research has shown that this method allows users' knowledge to serve as a design basis, minimizing biases that may occur from relying excessively on an expert's preference. However, how to conduct effective gesture elicitation studies remains an uncertain and open-ended issue. Through a thorough literature review, this study aims to identify important aspects that have significant impacts on the implementation of the elicitation study. The main findings of this paper are as follows: (1) Factors such as the choice of participants, referents, elicitation techniques, elicitation environments, and tasks can have a significant impact on the results of gesture elicitation; (2) Researchers have proposed various metrics for selecting gesture sets and evaluating their effects, but there is still debate over the sufficiency of these metrics; (3) Various methods have been proposed to improve gesture elicitation research, but there is still a lack of broad consensus on the best practices for gesture elicitation research, how to evaluate and report results, and how to compare results across studies. These findings indicate that gesture elicitation has become a valuable research and practical tool, but further study is needed to utilize it better.

show abstract

Brave New GES World: A Systematic Literature Review of Gestures and Referents in Gesture Elicitation Studies

Villarreal-Narvaez,

Sluÿters,

Vanderdonckt

et al. 2024

ACM Comput. Surv.

View full text Add to dashboard Cite

How to determine highly effective and intuitive gesture sets for interactive systems tailored to end users’ preferences? A substantial body of knowledge is available on this topic, among which gesture elicitation studies stand out distinctively. In these studies, end users are invited to propose gestures for specific referents, which are the functions to control for an interactive system. The vast majority of gesture elicitation studies conclude with a consensus gesture set identified following a process of consensus or agreement analysis. However, the information about specific gesture sets determined for specific applications is scattered across a wide landscape of disconnected scientific publications, which poses challenges to researchers and practitioners to effectively harness this body of knowledge. To address this challenge, we conducted a systematic literature review and examined a corpus of N = 267 studies encompassing a total of 187,265 gestures elicited from 6,659 participants for 4,106 referents. To understand similarities in users’ gesture preferences within this extensive dataset, we analyzed a sample of 2,304 gestures extracted from the studies identified in our literature review. Our approach consisted of (i) identifying the context of use represented by end users, devices, platforms, and gesture sensing technology, (ii) categorizing the referents, (iii) classifying the gestures elicited for those referents, and (iv) cataloging the gestures based on their representation and implementation modalities. Drawing from the findings of this review, we propose guidelines for conducting future end-user gesture elicitation studies.

show abstract

Exploring user-defined gestures for lingual and palatal interaction

Cited by 3 publications

References 32 publications

User-Defined Interactions for Visual Data Exploration With the Combination of Smartwatch and Large Display

User-Defined Interactions for Visual Data Exploration With the Combination of Smartwatch and Large Display

Exploring Methods to Optimize Gesture Elicitation Studies: A Systematic Literature Review

Brave New GES World: A Systematic Literature Review of Gestures and Referents in Gesture Elicitation Studies

Contact Info

Product

Resources

About