Gestural and audio metaphors as a means of control for mobile devices

Pirhonen, Antti; Brewster, Stephen; Holguin, Christopher

doi:10.1145/503425.503428

Cited by 107 publications

(146 citation statements)

References 8 publications

Supporting

Mentioning

141

Contrasting

Unclassified

Order By: Relevance

“…229 Non-visual interfaces, particularly audio display 230 interfaces have been shown to be effective in improv-231 ing interaction and integration within existing physical 232 contexts. For example, Brewster and Pirhonen [21,22] 233 have explored the combination of gesture and audio 234 display that allows for complicated interaction with 235 mobile devices while people are in motion. The Audio 236 Aura project [23] explores how to better connect hu-237 man activity in the physical world with virtual infor-238 mation through use of audio display.…”

Section: U N C O R R E C T E D P R O O Fmentioning

confidence: 99%

Situated play in a tangible interface and adaptive audio museum guide

Wakkary

Hatala

2006

Pers Ubiquit Comput

View full text Add to dashboard Cite

68 Abstract This paper explores the design issues of 9 situated play within a museum through the study of a 10 museum guide prototype that integrates a tangible 11 interface, audio display, and adaptive modeling. We 12 discuss our use of design ethnography in order to sit-13 uate our interaction and to investigate the liminal and 14 engagement qualities of a museum visit. The paper 15 provides an overview of our case study and analysis of 16 our user evaluation. We discuss the implications 17 including degrees of balance in the experience design 18 of play in interaction; the challenge in developing a 19 discovery-based information model, and the need for a 20 better understanding of the contextual aspects of tan-21 gible user interfaces (TUIs). We conclude that learning 22 effectiveness and functionality can be balanced pro-23 ductively with playful interaction through an adaptive 24 audio and TUI if designers balance the engagement 25 between play and the environment, and the space be-26 tween imagination and interpretation that links the 27 audio content to the artifacts.

show abstract

Section: U N C O R R E C T E D P R O O Fmentioning

confidence: 99%

Situated play in a tangible interface and adaptive audio museum guide

Wakkary

Hatala

2006

Pers Ubiquit Comput

View full text Add to dashboard Cite

show abstract

“…to keep the experimental conditions consistent and not introduce noise in the results. As an alternative, researchers have replicated real world settings by creating walking routes indoors [3,14,25] and outdoors [5,12,13] for users to navigate. Some studies [3,14,15] have also added obstacles to the walking path to increase the user's cognitive workload.…”

Section: The Effects Of Mobilitymentioning

confidence: 99%

“…In previous studies, two broad methods have been used to examine the effects of mobility on input performance with handheld devices: 1) walking on a treadmill [3,4] and 2) walking around a predefined route [3,13,25]. Barnard et al [3] compared both methods and reported the advantages and limitations of each to examine the impact of walking on interactions with mobile devices.…”

Section: Introductionmentioning

confidence: 99%

Comparing evaluation methods for encumbrance and walking on interaction with touchscreen mobile devices

Williamson

Brewster

2014

Proceedings of the 16th International Conference on Human-Computer Interaction With Mobile Devices &Amp; Services

View full text Add to dashboard Cite

In this paper, two walking evaluation methods were compared to evaluate the effects of encumbrance while the preferred walking speed (PWS) is controlled. Users frequently carry cumbersome objects (e.g. shopping bags) and use mobile devices at the same time which can cause interaction difficulties and erroneous input. The two methods used to control the PWS were: walking on a treadmill and walking around a predefined route on the ground while following a pacesetter. The results from our target acquisition experiment showed that for ground walking at 100% of PWS, accuracy dropped to 36% when carrying a bag in the dominant hand while accuracy reduced to 34% for holding a box under the dominant arm. We also discuss the advantages and limitations of each evaluation method when examining encumbrance and suggest treadmill walking is not the most suitable approach to use if walking speed is an important factor in future mobile studies.

show abstract

“…Touch: On mobile touch-based devices, sweeping and tapping the screen can let the user control a music player without looking at the UI [27]. Döring et al [12] adapted this interaction style for cars on a touch-sensitive steering wheel and reduced visual demand during interaction.…”

Section: User Interfaces For Audio Player Controlmentioning

confidence: 99%

Comparing Input Modalities for Peripheral Interaction: A Case Study on Peripheral Music Control

Hausen¹,

Richter²,

Hemme³

et al. 2013

Lecture Notes in Computer Science

View full text Add to dashboard Cite

Abstract. In graphical user interfaces, every application usually asks for the user's full attention during interaction with it. Even marginal side activities often force the user to switch windows, which results in attention shifts and increased cognitive load. Peripheral interaction addresses this problem by providing input facilities in the periphery of the user's attention by relying on divided attention and human capabilities such as proprioception and spatial memory. Recent work shows promising results by shifting tasks to the periphery for parallel task execution. Up to now, most of these interfaces rely on tag-based objects, tokens or wearable devices, which need to be grasped and manipulated, e.g., by turning, moving or pressing the device.To explore this design space further, we implemented three modalities for peripheral interaction with a desktop audio player application -graspable interaction, touch and freehand gestures. In an eight-week in-situ deployment, we compared the three modalities to each other and to media keys (as the state-ofthe-art approach). We found that all modalities can be successfully used in the (visual and attentional) periphery and reduce the amount of cognitive load when interacting with an audio player.With this work we intend to (1) illustrate the variety of possible modalities beyond graspable interfaces, (2) give insights on manual peripheral interaction in general and the respective modalities in particular and (3) elaborate on paper based prototypes for the evaluation of peripheral interaction.

show abstract

Gestural and audio metaphors as a means of control for mobile devices

Cited by 107 publications

References 8 publications

Situated play in a tangible interface and adaptive audio museum guide

Situated play in a tangible interface and adaptive audio museum guide

Comparing evaluation methods for encumbrance and walking on interaction with touchscreen mobile devices

Comparing Input Modalities for Peripheral Interaction: A Case Study on Peripheral Music Control

Contact Info

Product

Resources

About