Embodied user interfaces for
            <i>really</i>
            direct manipulation

Fishkin, Kenneth P.; Gujar, Anuj; Harrison, Beverly L.; Moran, Thomas P.; Want, Roy

doi:10.1145/348941.348998

Cited by 65 publications

(30 citation statements)

References 7 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This result is fairly intuitive since a direct manipulation task such as a drag-and-drop requires a high concentration of visual attention on a display (Fishkin et al 2000). Therefore visual-only feedback does not add much value compared to other forms of feedback.…”

Section: Visual Effectmentioning

confidence: 98%

The effects of multimodal feedback on older adults' task performance given varying levels of computer experience

Jacko¹,

Emery²,

Edwards³

et al. 2004

Behaviour & Information Technology

View full text Add to dashboard Cite

This experiment examines the effect that computer experience and various combinations of feedback (auditory, haptic, and/or visual) have on the performance of older adults completing a drag-and-drop task on a computer. Participants were divided into three computer experience groups, based on their frequency of use and breadth of computer knowledge. Each participant completed a series of drag-and-drop tasks under each of seven feedback conditions (three unimodal, three bimodal, one trimodal). Performance was assessed using measures of efficiency and accuracy. Experienced users responded well to all multimodal feedback while users without experience responded well to auditory-haptic bimodal, but poorly to haptic-visual bimodal feedback. Based on performance benefits for older adults seen in this experiment, future research should extend investigations to effectively integrate multimodal feedback into GUI interfaces in order to improve usability for this growing and diverse user group.

show abstract

Section: Visual Effectmentioning

confidence: 98%

The effects of multimodal feedback on older adults' task performance given varying levels of computer experience

Jacko¹,

Emery²,

Edwards³

et al. 2004

Behaviour & Information Technology

View full text Add to dashboard Cite

show abstract

“…When integrated sensors enable devices to react to physical manipulation, designers can make use of the 'physical effects principle' (Fishkin et al, 2000), where system effects are analogous to the real-world effects of similar actions and adhere to naïve physics. For example, a handheld calendar can scroll to the next day if tilted.…”

Section: Motivation and Backgroundmentioning

confidence: 99%

“…Given that the system provides users with a 3D input tool, this three-dimensionality should be acknowledged to some extent. Some researchers have successfully developed interfaces based on the 'physical effects principle', where system effects are analogous to the real-world effect of similar actions (Fishkin et al, 2000). But a more cautionary lesson is also recommended.…”

Section: Physical Input and Intuitive Usementioning

confidence: 99%

Of pages and paddles: Children’s expectations and mistaken interactions with physical–digital tools

Hornecker

Dünser

2009

Interacting with Computers

View full text Add to dashboard Cite

An assumption behind new interface approaches that employ physical means of interaction is that these can leverage users' prior knowledge from the real world, making them intuitive or 'natural' to use. This paper presents a user study of tangible augmented reality, which shows that physical input tools can invite a wide variety of interaction behaviours and raise unmatched expectations about how to interact. Children played with interactive sequences in an augmented book using physical paddles to control the main characters. Our analysis focuses on how knowledge and skills that children have from the physical world succeed or fail to apply in the interaction with this application. We found that children expected the digital augmentations to behave and react analogous to physical 3D objects, encouraged by the ability to act in 3D space and the (digital) visual feedback. The affordances of the paddles as physical interaction devices invited actions that the system could not detect or interpret. In effect, children often struggled to understand what it was in their actions that made the system react.

show abstract

“…As one's viewing angle changes, one sequentially sees different strips of the image underneath the lenses, showing an animation. We used this effect to design a user-friendly technique that helps users to perform gestures (as advised in embodied user interface [4]). By analyzing the data provided by a Gsensor (i.e.…”

Section: Timetilt Techniquementioning

confidence: 99%

TimeTilt: Using Sensor-Based Gestures to Travel through Multiple Applications on a Mobile Device

Roudaut

Baglioni

Lecolinet

2009

Human-Computer Interaction – INTERACT 2009

View full text Add to dashboard Cite

Abstract. We present TimeTilt, a sensor-based technique that allows multiple windows switching on mobile devices, and which overcomes the limitations of mobile devices, i.e. their impoverished input bandwidth (often no keyboard, a small tactile screen and the drawbacks of one-handed interaction). TimeTilt, which is based on a lenticular metaphor, aims at both reducing the activation time when switching between views, and supporting a natural mapping between the gestures and the navigation. We draw a brief classification of sensor-based gestures that could be used in mobile conditions, and we present an experiment.

show abstract

Embodied user interfaces for really direct manipulation

Cited by 65 publications

References 7 publications

The effects of multimodal feedback on older adults' task performance given varying levels of computer experience

The effects of multimodal feedback on older adults' task performance given varying levels of computer experience

Of pages and paddles: Children’s expectations and mistaken interactions with physical–digital tools

TimeTilt: Using Sensor-Based Gestures to Travel through Multiple Applications on a Mobile Device

Contact Info

Product

Resources

About