STREAM: Exploring the Combination of Spatially-Aware Tablets with Augmented Reality Head-Mounted Displays for Immersive Analytics

Hubenschmid, Sebastian; Zagermann, Johannes; Butscher, Simon; Reiterer, Harald

doi:10.1145/3411764.3445298

Cited by 60 publications

(26 citation statements)

References 68 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Visualisations in 3D are typically derived from the previous 2D media, but there is a trend towards exploring new possibilities. For example, multiple 2D visualisations can be arranged to use the third dimension to filter information and visualise this filtration [102]. We observe the difference between non-situated AR (top row) and situated AR (bottom row) for anchoring content at the body of the user, an object, or the immediate environment.…”

Section: Situated Analyticsmentioning

confidence: 98%

The Hitchhiker’s Guide to Fused Twins: A Review of Access to Digital Twins In Situ in Smart Cities

et al. 2022

View full text Add to dashboard Cite

Smart Cities already surround us, and yet they are still incomprehensibly far from directly impacting everyday life. While current Smart Cities are often inaccessible, the experience of everyday citizens may be enhanced with a combination of the emerging technologies Digital Twins (DTs) and Situated Analytics. DTs represent their Physical Twin (PT) in the real world via models, simulations, (remotely) sensed data, context awareness, and interactions. However, interaction requires appropriate interfaces to address the complexity of the city. Ultimately, leveraging the potential of Smart Cities requires going beyond assembling the DT to be comprehensive and accessible. Situated Analytics allows for the anchoring of city information in its spatial context. We advance the concept of embedding the DT into the PT through Situated Analytics to form Fused Twins (FTs). This fusion allows access to data in the location that it is generated in in an embodied context that can make the data more understandable. Prototypes of FTs are rapidly emerging from different domains, but Smart Cities represent the context with the most potential for FTs in the future. This paper reviews DTs, Situated Analytics, and Smart Cities as the foundations of FTs. Regarding DTs, we define five components (physical, data, analytical, virtual, and Connection Environments) that we relate to several cognates (i.e., similar but different terms) from existing literature. Regarding Situated Analytics, we review the effects of user embodiment on cognition and cognitive load. Finally, we classify existing partial examples of FTs from the literature and address their construction from Augmented Reality, Geographic Information Systems, Building/City Information Models, and DTs and provide an overview of future directions.

show abstract

Section: Situated Analyticsmentioning

confidence: 98%

The Hitchhiker’s Guide to Fused Twins: A Review of Access to Digital Twins In Situ in Smart Cities

et al. 2022

View full text Add to dashboard Cite

show abstract

“…Xiao et al [81] further proposed turning every flat surface into a touch screen for head-mounted mixed reality systems. Furthermore, researchers started to utilize gaze and speech interfaces for data visualization interaction [42,48,56] because AR HMDs natively support these interactions (e.g., Microsoft HoloLens 2 and Magic Leap 1). Lastly, spatial user interfaces are also increasingly used for data navigation and placement.…”

Section: Related Workmentioning

confidence: 99%

“…Lastly, spatial user interfaces are also increasingly used for data navigation and placement. For example, researchers extended mobile devices as spatial devices to facilitate 3D data navigation [18] and visualization placement in the 3D environment [42].…”

Section: Related Workmentioning

confidence: 99%

Exploring Interactions with Printed Data Visualizations in Augmented Reality

Tong

Chen

Xia

et al. 2023

IEEE Trans. Visual. Comput. Graphics

View full text Add to dashboard Cite

Fig. 1. We investigate the possibility of interacting with printed visualizations in Augmented Reality. Suppose a student receives (a) a leaflet about university ranking and wants to analyze three universities' ranking history of interest. Examples of interactions with (b) digital content overlaid: (c) tilt the paper to rescale the y-axis, (d) move (translate) to zoom (e) unfold to show two charts side by side and link them, (f) point to select elements and highlight them in the other chart.

show abstract

“…AR data visualization has attracted considerable attention in recent research area [2,21,22]. Research has concentrated on examining the advantages of AR visualization in comparison to traditional means.…”

Section: Related Work 21 Augmented Reality Data Visualizationmentioning

confidence: 99%

“…Their case studies demonstrated the benefit of combining multiple mobile devices with AR headsets for data visualization and data analysis. Hubenschmid et al [21] also presented a spatially-aware tablets combined with AR headsets for immersive data visualization and revealed that the novel interaction concept was appreciated by users. They also provided various design insights to foster the development of spatially-aware touch devices in AR settings.…”

Section: Related Work 21 Augmented Reality Data Visualizationmentioning

confidence: 99%

An Interactive Augmented Reality Graph Visualization for Chinese Painters

Wang

2022

Electronics

View full text Add to dashboard Cite

Recent research in the area of immersive analytics demonstrated the utility of augmented reality for data analysis. However, there is a lack of research on how to facilitate engaging, embodied, and interactive AR graph visualization. In this paper, we explored the design space for combining the capabilities of AR with node-link diagrams to create immersive data visualization. We first systematically described the design rationale and the design process of the mobile based AR graph including the layout, interactions, and aesthetics. Then, we validated the AR concept by conducting a user study with 36 participants to examine users’ behaviors with an AR graph and a 2D graph. The results of our study showed the feasibility of using an AR graph to present data relations and also introduced interaction challenges in terms of the effectiveness and usability with mobile devices. Third, we iterated the AR graph by implementing embodied interactions with hand gestures and addressing the connection between the physical objects and the digital graph. This study is the first step in our research, aiming to guide the design of the application of immersive AR data visualization in the future.

show abstract

STREAM: Exploring the Combination of Spatially-Aware Tablets with Augmented Reality Head-Mounted Displays for Immersive Analytics

Cited by 60 publications

References 68 publications

The Hitchhiker’s Guide to Fused Twins: A Review of Access to Digital Twins In Situ in Smart Cities

The Hitchhiker’s Guide to Fused Twins: A Review of Access to Digital Twins In Situ in Smart Cities

Exploring Interactions with Printed Data Visualizations in Augmented Reality

An Interactive Augmented Reality Graph Visualization for Chinese Painters

Contact Info

Product

Resources

About