Shortcut Gestures for Mobile Text Editing on Fully Touch Sensitive Smartphones

Abstract

While advances in mobile text entry enable smartphone users to type almost as fast as on hardware keyboards, text-heavy activities are still not widely adopted. One reason is the lack of shortcut mechanisms. In this article, we determine shortcuts for text-heavy activities, elicit shortcut gestures, implement them for a fully touch-sensitive smartphone, and conduct an evaluation with potential users. We found that experts perform around 800 keyboard shortcuts per day, which are not available on smartphones. Interviews revealed the lack of shortcuts as a major limitation that prevents mobile text editing. Therefore, we elicited gestures for the 22 most important shortcuts for smartphones that are touch-sensitive on the whole device surface. We implemented the gestures for a fully touch-sensitive smartphone using deep learning and evaluated them in realistic scenarios to gather feedback. We show that the developed prototype is perceived as intuitive and faster than recent commercial approaches.

Towards a Unified and Efficient Command Selection Mechanism for Touch-Based Devices Using Soft Keyboard Hotkeys

“…With the increasing need to support large commands sets in feature-rich applications, it is equally important to identify which and how commands are to be mapped. For instance, Le et al [43] recently elicited gestures for the 22 most important commands currently unavailable on smartphones. It would be interesting to conduct direct comparisons between the performance of keyboard-based (SoftCuts) and gesture-based shortcuts in selecting each of these commands.…”

A technique to improve text editing on smartphones

“…They proposed and evaluated BezelCopy, a copy-paste technique based on bezel-swipe gestures, and showed that it outperforms other methods for some common copy-paste tasks. In [10] the authors implement a shortcut mechanism for text editing using gestures on smartphones that are touch-sensitive on the whole device surface, that is perceived as intuitive and faster than traditional approaches. Gedit [11] is instead a system of on-keyboard gestures that is 17-24% faster than the default interaction.…”