Speech augmented multitouch interaction patterns

Schnelle-Walka, Dirk; Döweling, Sebastian

doi:10.1145/2396716.2396724

Cited by 7 publications

(4 citation statements)

References 31 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The most commonly discussed potentials include input speed, hands-free interaction, and ability to interact using natural language as input (Kumar et al 2012, Sivaraman et al 2016. Other potentials explored include specific advantages, such as understanding how the elderly and disabled can benefit from VUIs (Pradhan et al 2018, Wulf et al 2014, how hands-free speech interaction can be used while driving a car (Goulati & Szostak 2011, Lee et al 2014, Pfleging et al 2012, and how VUIs can be combined with other modalities such as gesture, multi-touch interaction and eye gaze (Anastasiou et al 2012, Schnelle-Walka & Döweling 2012, Vieira et al 2015.…”

Section: Voice User Interfacesmentioning

confidence: 99%

Digital ethnography of home use of digital personal assistants

Paay

Kjeldskov

Hansen

et al. 2020

Behaviour & Information Technology

View full text Add to dashboard Cite

Commercialised voice user interface devices for the home, like Amazon Echo, Google Home, and Apple HomePod, with integrated digital personal assistants have rapidly grown in popularity. These devices embody intelligent software agents that support users in their everyday life through easy and intuitive conversational interactions. While their use in everyday activities is largely unexplored, the proliferation in home use presents a valuable opportunity to add to understanding around the use of in-home digital personal assistants. In this paper, we investigate their home use in a broad context to learn more about people's experiences, attitudes, interactions and expectations with these devices contributing new insights to current knowledge around this use. Applying the digital ethnography method, we collected 3,542 reviews and comments about Amazon Echo, Google Home, and Apple HomePod on Amazon, eBay, and Reddit. Six main themes and 29 categories were derived through filtering, thematic analysis and affinity diagramming. These findings constitute a conceptual framework characterising the current landscape of home use of digital personal assistants. Additionally, we identify and discuss unique issues discovered around the invisible interface, interactive freedom, and creative appropriation. We use our findings to propose implications for interaction design of DPAs for home use.

show abstract

Section: Voice User Interfacesmentioning

confidence: 99%

Digital ethnography of home use of digital personal assistants

Paay

Kjeldskov

Hansen

et al. 2020

Behaviour & Information Technology

View full text Add to dashboard Cite

show abstract

“…The Output Design MUIDPs can transmit information through graphical interfaces (e.g., Expanding List, Notifications Popovers, Pop-up), light signaling (e.g., Led), sound communication (e.g., Voice Notifications, Voice Readback), or can even provide output handling (e.g., Audio Output Volume Increasing, Empty State, Redundant Output). Voice Readback [38,43,56] Category: Shopping-9…”

Section: Category: Output Design-13mentioning

confidence: 99%

Mobile User Interaction Design Patterns: A Systematic Mapping Study

2022

View full text Add to dashboard Cite

Interaction design patterns have evolved as a resource that facilitates documentation and the reuse of proven solutions. They provide a structured and understandable mechanism for what to do in the design. Mobile devices have characteristics, configurations, and restrictions that make the construction of their interfaces full of particularities to this environment, and problems that are often common to designers and developers. This study presented a systematic mapping of the state-of-the-art regarding interaction design patterns for mobile devices. A total of 23 studies that include articles and books met the selection criteria in this mapping, examining relevant scientific databases and books that were cited in relevant articles. As a main result, 336 patterns were compiled, with 261 of these problems and solutions being dissimilar from each other. The paper describes patterns in 18 categories covering different interaction aspects. Pattern structural elements with mentions in more than five papers included: Name, Solution, Problem, Context, Examples, Related Patterns, Forces, Consequences and Figure. Four studies reported empirical evaluation of the patterns with a limited number of users. The paper contributed with a categorization of existing patterns and the challenges for uniformization of structure and empirical evidence with user evaluation.

show abstract

“…Speech-based dictation systems are becoming more practical [32]. A voice-augmented multi-touch interaction technique has also recently been proposed [31].…”

Section: Speech/voice-based Operation Techniquesmentioning

confidence: 99%

Voice augmented manipulation

Sakamoto

Komatsu

Igarashi

2013

Proceedings of the 15th International Conference on Human-Computer Interaction With Mobile Devices and Services

View full text Add to dashboard Cite

We propose a technique called voice augmented manipulation (VAM) for augmenting user operations in a mobile environment. This technique augments user interactions on mobile devices, such as finger gestures and button pressing, with voice. For example, when a user makes a finger gesture on a mobile phone and voices a sound into it, the operation will continue until stops making the sound or makes another finger gesture. The VAM interface also provides a button-based interface, and the function connected to the button is augmented by voiced sounds. Two experiments verified the effectiveness of the VAM technique and showed that repeated finger gestures significantly decreased compared to current touch-input techniques, suggesting that VAM is useful in supporting user control in a mobile environment. Figure 1: Voice augmented manipulation (VAM) accepts users' paralinguistic information to operate (zooming, panning, scrolling, etc.) mobile devices. The technique augments scrolling with user's scrolling gestures and voice (left), and augments zooming with a button press and user's breath (right).

show abstract

Speech augmented multitouch interaction patterns

Cited by 7 publications

References 31 publications

Digital ethnography of home use of digital personal assistants

Digital ethnography of home use of digital personal assistants

Mobile User Interaction Design Patterns: A Systematic Mapping Study

Voice augmented manipulation

Contact Info

Product

Resources

About