Enhancing naturalness of pen-and-tablet drawing through context sensing

Sun, Minghui; Cao, Xiang; Song, Hyunyoung; Izadi, Shahram; Benko, Hrvoje; Guimbretière, François; Ren, Xiangshi; Hinckley, Ken

doi:10.1145/2076354.2076371

Cited by 20 publications

(15 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Pens can be augmented with motion [17,48], grip [46,47], and near-surface range sensing [28]. MTPen [46] uses grip sensing to detect a tripod writing grip, or to invoke different brushes.…”

Section: Sensor-augmented and Multi-dof Stylus Inputmentioning

confidence: 99%

“…MTPen [46] uses grip sensing to detect a tripod writing grip, or to invoke different brushes. Sun et al [47] use an integrated IMU on the pen to assist grip recognition, an approach which we adopt here, and also sense the orientation of the tablet (e.g. horizontal vs. drafting table).…”

Section: Sensor-augmented and Multi-dof Stylus Inputmentioning

confidence: 99%

“…Several papers identify distinct grips for tasks such as writing and brushing [46,47], or holding tablets [8,52]. But the literature still lacks an inventory of pen grips and postures while interacting on a tablet with pen + touch.…”

Section: Observations Of Pen and Tablet Behaviorsmentioning

confidence: 99%

“…The user can hold the pen well above the tablet screen, making it easy to angle the pen as desired, unlike a previous exploration of an airbrush-like tool [47] which did not employ the stylus tilt angles, likely because it is difficult to reorient the pen while also keeping it within the limited ~15mm proximity sensing range of the tablet.…”

Section: Input Techniquesmentioning

confidence: 99%

See 3 more Smart Citations

Sensing techniques for tablet+stylus interaction

Hinckley

Pahud

Benko

et al. 2014

Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology

Self Cite

View full text Add to dashboard Cite

We explore grip and motion sensing to afford new techniques that leverage how users naturally manipulate tablet and stylus devices during pen + touch interaction. We can detect whether the user holds the pen in a writing grip or tucked between his fingers. We can distinguish bare-handed inputs, such as drag and pinch gestures produced by the nonpreferred hand, from touch gestures produced by the hand holding the pen, which necessarily impart a detectable motion signal to the stylus. We can sense which hand grips the tablet, and determine the screen's relative orientation to the pen. By selectively combining these signals and using them to complement one another, we can tailor interaction to the context, such as by ignoring unintentional touch inputs while writing, or supporting contextually-appropriate tools such as a magnifier for detailed stroke work that appears when the user pinches with the pen tucked between his fingers. These and other techniques can be used to impart new, previously unanticipated subtleties to pen + touch interaction on tablets.

show abstract

“…Pens can be augmented with motion [17,48], grip [46,47], and near-surface range sensing [28]. MTPen [46] uses grip sensing to detect a tripod writing grip, or to invoke different brushes.…”

Section: Sensor-augmented and Multi-dof Stylus Inputmentioning

confidence: 99%

Section: Sensor-augmented and Multi-dof Stylus Inputmentioning

confidence: 99%

Section: Observations Of Pen and Tablet Behaviorsmentioning

confidence: 99%

Section: Input Techniquesmentioning

confidence: 99%

See 2 more Smart Citations

Sensing techniques for tablet+stylus interaction

Hinckley

Pahud

Benko

et al. 2014

Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology

Self Cite

View full text Add to dashboard Cite

show abstract

“…Such displacements of the line of sight may impair work efficiency [9]. To minimize searching, the current pen status can be shown utilizing a large box and distinctive color coding [22]. However, such an emphasis cannot account for the problem of displacement of the line of sight.…”

Section: Hidden Pen Informationmentioning

confidence: 99%

PhantomPen

Lee

Son

Lee

et al. 2012

Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology

View full text Add to dashboard Cite

Figure 1: Problems of direct pen input: (a) pen occlusion that covers portions of drawing, (b) visual parallax between a physical pen tip and mouse cursor due to display glass thickness, and (c) hidden pen information such as pen type, color, and thickness, which is not intuitively perceived on the digital canvas. PhantomPen solves these problems by replacing the physical pen head with a virtual pen displayed as if connected to the pen barrel from the user's perspective (d), while an actual pen tip, hidden by the pen barrel, delivers tactile feedback (e). ABSTRACTWe present PhantomPen, a direct pen input device whose pen head is virtualized onto the tablet display surface and visually connected to a graspable pen barrel in order to achieve digital drawing free from pen occlusion and visual parallax. As the pen barrel approaches the display, the virtual pen head smoothly appears as if the rendered virtual pen head and the physical pen barrel are in unity. The virtual pen head provides visual feedback by changing its virtual form according to pen type, color, and thickness while the physical pen tip, hidden in the user's sight, provides tactile feedback. Three experiments were carefully designed based on an analysis of drawings by design professionals and observations of design drawing classes.With these experiments that simulate natural drawing we proved significant performance advantages of Phan-tomPen. PhantomPen was at least as usable as the normal stylus in basic line drawing, and was 17 % faster in focus region drawing (26 % faster in extreme focus region drawing). PhantomPen also reduced error rate by 40 % in a typical drawing setup where users have to manage a complex combination of pen and stroke properties.

show abstract