Pen + touch = new tools

Hinckley, Ken; Yatani, Koji; Pahud, Michel; Coddington, Nicole; Rodenhouse, Jenny; Wilson, Andy; Benko, Hrvoje; Buxton, Bill

doi:10.1145/1866029.1866036

Cited by 212 publications

(151 citation statements)

References 32 publications

Supporting

Mentioning

148

Contrasting

Unclassified

Order By: Relevance

“…Because on digital devices pen and touch are not restricted to their inherent functionality, it is necessary to define an easy to understand way to differentiate between interactions which can be performed by the pen and interactions which are performed using touch. This is a controversially discussed topic in research with different approaches to handle it (Frisch, Heydekorn, & Dachselt, 2010;Hinckley et al, 2010). As recommended by Hinckley et al, we take the behaviors that people already exhibit when working with pen and paper as foundation for our pen and touch gestures: using the pen to write or draw and touch to manipulate.…”

Section: Individual Interactionmentioning

confidence: 99%

Employing Blended Interaction to Blend the Qualities of Digital and Physical Books

Gebhardt¹,

Rädle²,

Reiterer³

2014

Mensch Und Computer 2014 - Tagungsband

View full text Add to dashboard Cite

This paper presents Integrative Workplace, a system which blends the qualities of digital and physical sources by augmenting physical books with properties of digital books and vice versa. On the base of Blended Interaction, we designed a system which helps users to interact with the new and unfamiliar functionality of augmented documents and apply it to accomplish a real world task. In a user study, law students employed Integrative Workplace to work on a legal case. The positive feedback of participants indicated that we managed to design a system which is usable in a professional context. Furthermore, the study revealed evidence that participants apply Conceptual Blending to understand user interfaces and that digitally well-established concepts are a part of users' reality. These findings resonate with the theoretical foundation of Blended Interaction. The results of this user study encourage us to continue to use Blended Interaction in the design process of novel user interfaces with an unfamiliar functionality.

show abstract

Section: Individual Interactionmentioning

confidence: 99%

Employing Blended Interaction to Blend the Qualities of Digital and Physical Books

Gebhardt¹,

Rädle²,

Reiterer³

2014

Mensch Und Computer 2014 - Tagungsband

View full text Add to dashboard Cite

show abstract

“…A number of approaches [7,15,27] explore forms of bimanual interaction for pen and touch and propose techniques of bimanual interaction that conform to Guiard's model: select an object with the non-dominant hand and bring it under the pen, use the non-dominant hand to define a command mode or context that constrains the interaction with the pen, or make a rough selection with the dominant hand that is then refined by the pen. The pen is always held by the dominant hand, while touch is assigned to any hand.…”

Section: Pen + Touch and Bimanual Coordinationmentioning

confidence: 99%

“…Our design approach is driven by phrasing [8] principles proposed by Hinckey et al [15] for pen + touch interaction. Our goal was to avoid the use of persistent modes.…”

Section: Bimanual Interpretation Of Handwrittingmentioning

confidence: 99%

See 1 more Smart Citation

Interpreting strokes on paper with a mobile assistant

Tsandilas

2012

Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology

View full text Add to dashboard Cite

Digital pen technology has allowed for the easy transfer of pen data from paper to the computer. However, linking handwritten content with the digital world remains a hard problem as it requires the translation of unstructured and highly personal vocabularies into structured ones that computers can easily understand and process. Automatic recognition can help to this direction, but as it is not always reliable, solutions require the active cooperation between users and recognition algorithms. This work examines the use of portable touch-screen devices in connection with pen and paper to help users direct and refine the interpretation of their strokes on paper. We explore four techniques of bimanual interaction that combine touch and pen-writing, where user attention is divided between the original strokes on paper and their interpretation by the electronic device. We demonstrate the techniques through a mobile interface for writing music that complements the automatic recognition with interactive user-driven interpretation. An experiment evaluates the four techniques and provides insights about their strengths and limitations.

show abstract

“…In the modern context of multi-touch tablets, pen input has received renewed interest, particularly when used as a distinct modality in tandem with touch [21,34,55]. However, many problems and ambiguities arise because the system can't easily determine whether the user intends to interact with the pen, with touch, or with the two in combination.…”

Section: Introductionmentioning

confidence: 99%

Sensing techniques for tablet+stylus interaction

Hinckley

Pahud

Benko

et al. 2014

Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology

Self Cite

View full text Add to dashboard Cite

We explore grip and motion sensing to afford new techniques that leverage how users naturally manipulate tablet and stylus devices during pen + touch interaction. We can detect whether the user holds the pen in a writing grip or tucked between his fingers. We can distinguish bare-handed inputs, such as drag and pinch gestures produced by the nonpreferred hand, from touch gestures produced by the hand holding the pen, which necessarily impart a detectable motion signal to the stylus. We can sense which hand grips the tablet, and determine the screen's relative orientation to the pen. By selectively combining these signals and using them to complement one another, we can tailor interaction to the context, such as by ignoring unintentional touch inputs while writing, or supporting contextually-appropriate tools such as a magnifier for detailed stroke work that appears when the user pinches with the pen tucked between his fingers. These and other techniques can be used to impart new, previously unanticipated subtleties to pen + touch interaction on tablets.

show abstract

Pen + touch = new tools

Cited by 212 publications

References 32 publications

Employing Blended Interaction to Blend the Qualities of Digital and Physical Books

Employing Blended Interaction to Blend the Qualities of Digital and Physical Books

Interpreting strokes on paper with a mobile assistant

Sensing techniques for tablet+stylus interaction

Contact Info

Product

Resources

About