"Megereality": Leveraging Physical Affordances for Multi-Device Gestural Interaction in Augmented Reality

Wu, Shengzhi; Byrne, Daragh; Steenson, Molly Wright

doi:10.1145/3334480.3383170

Cited by 13 publications

(5 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Desktop displays have also been extended with AR content by Prouzeau et al (2019), who also consider potential real world objects which might collide with the extension of the display. Extrusion of 2D and 3D data from mobile and desktop displays has also been demonstrated by Wu et al (2020).…”

Section: Extending Displaysmentioning

confidence: 98%

“…The fundamental idea is to move the graph data from its initial layout out of the 2D display into 3D space. We use for this process the term "transformation" because the graph visualisation is not only extruded out of the display as in similar works (Reipschläger and Dachselt, 2019;Wu et al, 2020), but also deformed into a new 3D layout.…”

Section: General Process and Transformation Sequencementioning

confidence: 99%

See 1 more Smart Citation

Transforming graph data visualisations from 2D displays into augmented reality 3D space: A quantitative study

Schwajda

Friedl

Pointecker

et al. 2023

Front. Virtual Real.

View full text Add to dashboard Cite

Modern video-based head-mounted displays allow users to operate along Milgram’s entire reality-virtuality continuum. This opens up the field for novel cross-reality applications that distribute data analytics tasks along this continuum to combine benefits of established 2D information visualisation in the real environment with immersive analytics. In this publication, we explore this potential by transforming 2D graph data from a planar, large-scale display in the real environment into a spherical layout in augmented reality 3D space, letting it appear as if the graph is moving out of the display. We focus on design aspects of this transformation that potentially help users to form a joint mental model of both visualisations and to continue their tasks seamlessly in augmented reality. For this purpose, we implemented a framework of transformation parameters that can be categorised as follows: transformation methods, node transformation order (groupings) and different ways of visual interconnection. Variants in each of these areas were investigated in three quantitative user studies in which users had to solve a simple cluster search task. We confirmed that a visual transformation from 2D to 3D helps users to continue their tasks in augmented reality with less interruptions, and that node transformation order should be adjusted to data and task context. We further identified that users can perform tasks more efficiently when a user-controlled transformation is used, while a constant transformation with fixed duration can contribute to lower error rates.

show abstract

Section: Extending Displaysmentioning

confidence: 98%

Section: General Process and Transformation Sequencementioning

confidence: 99%

Transforming graph data visualisations from 2D displays into augmented reality 3D space: A quantitative study

Schwajda

Friedl

Pointecker

et al. 2023

Front. Virtual Real.

View full text Add to dashboard Cite

show abstract

“…MergeReality [WBS20] (left, © S. Wu, D. Byrne and M.W. Steenson, used with permission) and DesignAR (right, republished with permission of ACM, from [RD19]; permission conveyed through Copyright Clearance Center, Inc.) augmenting screens and tablets.…”

Section: Different Levels Of XVmentioning

confidence: 99%

“…Extrusion from desktop displays has also been shown by Wu et al . [WBS20]. In their MergeReality system shown in Figure 3(left), they use an optical see‐through HMD with a traditional screen and a tablet.…”

Section: Different Levels Of XVmentioning

confidence: 99%

A Survey on Cross‐Virtuality Analytics

Fröhler

Anthes

Pointecker

et al. 2022

Computer Graphics Forum

View full text Add to dashboard Cite

Cross‐virtuality analytics (XVA) is a novel field of research within immersive analytics and visual analytics. A broad range of heterogeneous devices across the reality–virtuality continuum, along with respective visual metaphors and analysis techniques, are currently becoming available. The goal of XVA is to enable visual analytics that use transitional and collaborative interfaces to seamlessly integrate different devices and support multiple users. In this work, we take a closer look at XVA and analyse the existing body of work for an overview of its current state. We classify the related literature regarding ways of establishing cross‐virtuality by interconnecting different stages in the reality–virtuality continuum, as well as techniques for transitioning and collaborating between the different stages. We provide insights into visualization and interaction techniques employed in current XVA systems. We report on ways of evaluating such systems, and analyse the domains where such systems are becoming available. Finally, we discuss open challenges in XVA, giving directions for future research.

show abstract

“…Finally, as an augmented environment becomes more complex, in the number of cross-device interactions supported and/or the number of content manipulations and interactions that can be performed, gesture-based controls become cumbersome and require additional forms of feedback and support. In this, metaphors and naive physics help conceptually align aspects of the real and virtual worlds, thereby ofering a potent strategy to better communicate interaction strategies to users [6,33,36,70].…”

Section: Re-presencing Original Work Experimentationmentioning

confidence: 99%

“Slurp” Revisited: Using ‘system re-presencing’ to look back on, encounter, and design with the history of spatial interactivity and locative media

Byrne

et al. 2022

Designing Interactive Systems Conference

Self Cite

View full text Add to dashboard Cite

Hand-based gestural interaction in augmented reality (AR) is an increasingly popular mechanism for spatial interactions. However, it presents many challenges. For example, most hand gesture interactions work well for interactions with virtual content and interfaces, but seldom work with physical devices and users' environment. To explore this, and rather than inventing new paradigms for AR interactions, this paper revisits Zigelbaum, Kumpf, Vazquez, and Ishii's 2008 project 'Slurp' [72] -a physical eyedropper to interact with digital content from IoT devices. We revive this historical work in a new modality of AR through a fve step process: re-presecencing, design experimentation, scenario making, expansion through generative engagements with designers, and refection. For the designers we engaged, looking back and designing with a restored prototype helped increased understanding of interactive strategies, intentions and rationales of original work. By revisiting Slurp, we also found many new potentials of its metaphorical interactions that could be applied in the context of emerging spatial computing platforms (e.g., smart home devices). In doing so, we discuss the value of mining past works in new domains and demonstrate a new way of thinking about designing interactions in emerging platforms. CCS CONCEPTS• Human-centered computing → User centered design; Interaction design process and methods; Gestural input; Mixed / augmented reality.

show abstract

"Megereality": Leveraging Physical Affordances for Multi-Device Gestural Interaction in Augmented Reality

Cited by 13 publications

References 8 publications

Transforming graph data visualisations from 2D displays into augmented reality 3D space: A quantitative study

Transforming graph data visualisations from 2D displays into augmented reality 3D space: A quantitative study

A Survey on Cross‐Virtuality Analytics

“Slurp” Revisited: Using ‘system re-presencing’ to look back on, encounter, and design with the history of spatial interactivity and locative media

Contact Info

Product

Resources

About