The sense of agency is the experience of controlling both one’s body and the external environment. Although the sense of agency has been studied extensively, there is a paucity of studies in applied “real-life” situations. One applied domain that seems highly relevant is human-computer-interaction (HCI), as an increasing number of our everyday agentive interactions involve technology. Indeed, HCI has long recognized the feeling of control as a key factor in how people experience interactions with technology. The aim of this review is to summarize and examine the possible links between sense of agency and understanding control in HCI. We explore the overlap between HCI and sense of agency for computer input modalities and system feedback, computer assistance, and joint actions between humans and computers. An overarching consideration is how agency research can inform HCI and vice versa. Finally, we discuss the potential ethical implications of personal responsibility in an ever-increasing society of technology users and intelligent machine interfaces.

No abstract

While the technology underlying speech interfaces has improved in recent years, our understanding of the human side of speech interactions remains limited. This paper provides new insight on one important human aspect of speech interactions: the sense of agency -defined as the experience of controlling one's own actions and their outcomes. Two experiments are described. In each case a voice command is compared with keyboard input. Agency is measured using an implicit metric: intentional binding. In both experiments we find that participants' sense of agency is significantly reduced for voice commands as compared to keyboard input. This finding presents a fundamental challenge for the design of effective speech interfaces. We reflect on this finding and, based on current theory in HCI and cognitive neuroscience, offer possible explanations for the reduced sense of agency observed in speech interfaces.

Ultrasonic mid-air tactile displays offer a unique combination of high spatial and temporal resolution and can stimulate a wide range of tactile frequencies. Leveraging those features, a new modulation technique producing spatially distributed tactile sensations has recently been introduced. This new approach, referred to as Spatiotemporal Modulation (STM), draws lines, curves and shapes on users' palm by moving a midair tactile point rapidly and repeatedly along the path. STM parameters and their impact on tactile perception are yet to be studied systematically. In this work, we first study how varying the draw frequency and the size of a simple shape affects the participants perception of texture and their emotional responses. In the second part of our study, we used the most salient tactile patterns of the first study to extend the results within a multimodal context. We found that tactile patterns' perception was consistent within both studies. We also found instances when the tactile patterns could alter the perception of the audio and visual stimuli. Finally, we discuss the benefits of our findings and conclude with implications for future work.

This demo presents the concept of Interactive Digital Signage with Haptics, where users can interact with public digital screens with their bare hands, utilizing tracking technology and ultrasonic mid-air haptic feedback. Using these three main components: a digital screen, a tracking device, and Ultrahaptics technology for tactile feedback in mid-air, users are offered a multi-sensory experience that can potentially dramatically improve the advertising experience, increasing brand engagement, dwell time and brand recall. To this end, we present an example of a movie poster that transforms into an interactive mini game.