Foundational Issues in Touch-Surface Stroke Gesture Design — An Integrative Review

Zhai, Shumin

doi:10.1561/9781601986078

Cited by 7 publications

(1 citation statement)

References 123 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…While we are not aware of other works utilizing sketching as a command mechanism, performing gestures on touch screens [20] certainly is a related interaction modality. Gestures however differ from sketches in some important ways: In most mainstream software tools, the primary uses of gestures that can be performed on trackpads or touchscreens (swipes, pivots, pinches, and zooms) seem to be for navigation purposes (e.g.…”

Section: Related Workmentioning

confidence: 99%

Towards Sketch-based User Interaction with Integrated Software Development Environments

Samúelsson

Book

2020

Proceedings of the IEEE/ACM 42nd International Conference on Software Engineering Workshops

View full text Add to dashboard Cite

Powerful software tools, such as software development environments, often have complex graphical user interfaces (GUIs) that are not intuitive to handle, especially when performing complex, multistep operations. We hypothesize that sketching could be a more intuitive way of expressing user intentions than navigating nested menus or memorizing keyboard shortcuts to accomplish complex operations. Enabling this vision requires software capable of both allowing the user to sketch anywhere on a GUI, and interpreting those sketches as specific commands to be performed within the integrated development environment (IDE). In this paper, we report on preliminary results of an elicitation study performed to gather insights into how developers would use a sketch-based interface. CCS CONCEPTS• Human-centered computing → Interaction techniques; Empirical studies in interaction design; Touch screens; • Software and its engineering → Integrated and visual development environments.

show abstract

Section: Related Workmentioning

confidence: 99%

Towards Sketch-based User Interaction with Integrated Software Development Environments

Samúelsson

Book

2020

Proceedings of the IEEE/ACM 42nd International Conference on Software Engineering Workshops

View full text Add to dashboard Cite

show abstract

The impacts of situational impairment on touch gestures in public spaces: Walking in sunlight

Hosseini

Hamidi

Kermanshahani

2020

Computers & Electrical Engineering

View full text Add to dashboard Cite

Attentive Sequence-to-Sequence Modeling of Stroke Gestures Articulation Performance

Kumar

Leiva

2021

IEEE Trans. Human-Mach. Syst.

View full text Add to dashboard Cite

Production time of stroke gestures is a fundamental measure of user performance with Graphical User Interfaces. However, production time represents an overall quantification of the user's gesture articulation process and therefore provides an incomplete picture of such process. Moreover, previous approaches assumed stroke gestures as synchronous point sequences, when most gesture-driven applications have to deal with asynchronous point sequences. Furthermore, deep generative models of human handwriting ignore the temporal information, thereby missing a key component of the user's gesture articulation process. To solve these issues, we introduce DITTO, a sequence-to-sequence deep learning model that estimates the velocity profile of any stroke gesture using spatial information only, providing thus a fine-grained estimation of the moment-bymoment behavior of the user's articulation performance. We show that this unique capability makes DITTO remarkably accurate while handling gestures of any type: unistrokes, multistrokes, and multitouch gestures. Our model, code, and associated web application are available as open source software.

show abstract

Foundational Issues in Touch-Surface Stroke Gesture Design — An Integrative Review

Cited by 7 publications

References 123 publications

Towards Sketch-based User Interaction with Integrated Software Development Environments

Towards Sketch-based User Interaction with Integrated Software Development Environments

The impacts of situational impairment on touch gestures in public spaces: Walking in sunlight

Attentive Sequence-to-Sequence Modeling of Stroke Gestures Articulation Performance

Contact Info

Product

Resources

About