A User-based Mid-air Hand Gesture Set for Spreadsheets

Takayama, Yuta; Ichikawa, Yuu; Shizuki, Buntarou; Kawaguchi, Ikkaku; Takahashi, Shin

doi:10.1145/3429360.3468193

Cited by 3 publications

(1 citation statement)

References 21 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Moreover, to fill this gap Dai et al [7] presented a training system, called CAPG-MYO, for userdefined hand gesture interaction. Takayama et al [22] perform two user studies to derive a user-defined gesture set allowing 13 types of table manipulation.…”

Section: User Interfaces For User-defined Hand Gesturementioning

confidence: 99%

User-Defined Hand Gesture Interface to Improve User Experience of Learning American Sign Language

Wang

Ivrissimtzis

et al. 2023

Lecture Notes in Computer Science

View full text Add to dashboard Cite

Sign language can make possible effective communication between hearing and deaf-mute people. Despite years of extensive pedagogical research, learning sign language remains a formidable task, with the majority of the current systems relying extensively on online learning resources, presuming that users would regularly access them; yet, this approach can feel monotonous and repetitious. Recently, gamification has been proposed as a solution to the problem, however, the research focus is on game design, rather than user experience design. In this work, we present a system for user-defined interaction for learning static American Sign Language (ASL), supporting gesture recognition for user experience design, and enabling users to actively learn through involvement with user-defined gestures, rather than just passively absorbing knowledge. Early findings from a questionnaire-based survey show that users are more motivated to learn static ASL through user-defined interactions.

show abstract

Section: User Interfaces For User-defined Hand Gesturementioning

confidence: 99%

User-Defined Hand Gesture Interface to Improve User Experience of Learning American Sign Language

Wang

Ivrissimtzis

et al. 2023

Lecture Notes in Computer Science

View full text Add to dashboard Cite

show abstract

Intuitiveness Level: Frustration-Based Methodology for Human–Robot Interaction Gesture Elicitation

et al. 2022

View full text Add to dashboard Cite

For robotics to become more accessible to people not specialized in the area, it is of fundamental importance to improve and simplify the way people interact with robots. Despite human-robot interaction (HRI) being an effervescent research area, most of the works published so far on the use of gesture interfaces for human-robot communication do not clearly describe how the used gestures were elicited, thus hindering the reproducibility of those works. Considering this, we propose a new and reproducible Frustration-Based Approach (FBA), scientifically established on previous research, which can be used to obtain an intuitive and robust gesture vocabulary for HRI. To accomplish this, we propose Intuitiveness Level (IL), a score to rank gestures according with its intuitiveness. Using IL, it is possible to conceive a complex vocabulary, allowing an increasing of robustness, since more than one gesture can be associated to a task. In a general sense, the proposed methodology is not limited only for HRI, and it can also be used for human-machine interaction in general. In short, the contributions of this work are: (i) A complete methodology to elicit gestures to be used as intuitive communication interface between humans and robots. (ii) A metric of intuitiveness which takes into account at least three different characteristics about the elicited gestures.

show abstract

Spreadsheets on Interactive Surfaces: Breaking through the Grid with the Pen

Cavez,

Appert,

Pietriga

2024

ACM Trans. Comput.-Hum. Interact.

View full text Add to dashboard Cite

Spreadsheet programs for interactive surfaces have limited manipulations capabilities and are often frustrating to use. One key reason is that the spreadsheet grid creates a layer that intercepts most user input events, making it difficult to reach the cell values that lie underneath. We conduct an analysis of commercial spreadsheet programs and an elicitation study to understand what users can do and what they would like to do with spreadsheets on interactive surfaces. Informed by these, we design interaction techniques that leverage the precision of the pen to mitigate friction between the different layers. These enable more operations by direct manipulation on and through the grid, targeting not only cells and groups of cells, but values and substrings within and across cells as well. We prototype these interaction techniques and conduct a qualitative study with information workers who perform a variety of spreadsheet operations on their own data.

show abstract

A User-based Mid-air Hand Gesture Set for Spreadsheets

Cited by 3 publications

References 21 publications

User-Defined Hand Gesture Interface to Improve User Experience of Learning American Sign Language

User-Defined Hand Gesture Interface to Improve User Experience of Learning American Sign Language

Intuitiveness Level: Frustration-Based Methodology for Human–Robot Interaction Gesture Elicitation

Spreadsheets on Interactive Surfaces: Breaking through the Grid with the Pen

Contact Info

Product

Resources

About