Head-mounted Displays, Smartphones, or Smartwatches? -- Augmenting Conversations with Digital Representation of Self

Abstract

Technologies that augment face-to-face interactions with a digital sense of self have been used to support conversations. That work has employed one homogenous technology, either 'off-the-shelf' or with a bespoke prototype, across all participants. Beyond speculative instances, it is unclear what technology individuals themselves would choose, if any, to augment their social interactions; what influence it may exert; or how use of heterogeneous devices may affect the value of this augmentation. This is important, as the devices that we use directly affect our behaviour, influencing affordances and how we engage in social interactions. Through a study of 28 participants, we compared head-mounted display, smartphones, and smartwatches to support digital augmentation of self during face-to-face interactions within a group. We identified a preference among participants for head-mounted displays to support privacy, while smartwatches and smartphones better supported conversational events (such as grounding and repair), along with group use through screensharing. Accordingly, we present software and hardware design recommendations and user interface guidelines for integrating a digital form of self into face-to-face conversations.

Grand Challenges in Immersive Analytics

“…Further design considerations will need to be developed for users of situated visualisation applications to keep them safe from potential dangers that may arise due to distraction. Social considerations also may also arise from how application use affects others in the user's vicinity [64]. Supporting safe and social applications will require integration of contextual awareness [57] with adaptive systems [85].…”

Augmenting Human Appearance Through Technological Design Layers

“…Digital technologies have enabled adding a virtual layer around the human body, creating a digital aura. Using augmented reality (AR) techniques, the aura can be visible to others using digital viewers, such as head-mounted displays (HMD), smartphones, and smartwatches or projected into the physical world (Hirskyj-Douglas et al, 2019). Genç et al (2018) highlighted "extending the expression of the garments to the environment" as a design opportunity for augmenting human appearances.…”

Social Augmented Reality: A Multiperspective Survey

“…The user takes a turn with a partner that is invisible to his human partners. A comparative study [30] on making profile information available on a smartphone, a smartwatch, or smart glasses concluded that for support of conversations, participants preferred a smartphone or a smartwatch that could be used for screen sharing, while from a privacy point of view the preference was given to the glasses. It should be noted, however, that this study concerned profile information only.…”