How Does Representation Modality Affect User-Experience of Data Artifacts?

Hogan, Trevor; Hornecker, Eva

doi:10.1007/978-3-642-32796-4_15

Cited by 23 publications

(21 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Regarding the strategies that participants employed to interpret the data, our findings confirm previous research [20]: participants tried to find analogies between the readings from the data probes and familiar sounds or sensations that they had previously experienced to make sense of the data. However, the micro-phenomenological interviews indicate that participants subconciously made use of mental images to make sense of the data (e.g., translating sounds into points on a horizontal line, revealing higher and lower values), which parallels previous research on children solving math problems [39] and how people experience simple graphs and charts on a personal level [19].…”

Section: Data Interpretation and Processsupporting

confidence: 82%

“…[20]), not much research has compared haptic with visual and auditory representation modalities. Hogan and Hornecker [20] found that people appear to rely more on intuition and realworld experiences when making sense of haptic and sonic, compared to visual representations, and tend to engage in more personal, emotionally-driven interpretations. In contrast, a visual representation (a bar graph) was experienced more as a pragmatic tool.…”

Section: Physical Representationsmentioning

confidence: 99%

See 1 more Smart Citation

The Visual and Beyond

Hogan

Hinrichs

Hornecker

2017

Proceedings of the 2017 Conference on Designing Interactive Systems

Self Cite

View full text Add to dashboard Cite

Research in sonification and physicalization have expanded data representation techniques to include senses beyond the visual. Yet, little is known of how people interpret and make sense of haptic and sonic compared to visual representations. We have conducted two phenomenologically oriented comparative studies (applying the Repertory Grid and the Microphenomenological interview technique) to gather in-depth accounts of people's interpretation and experience of different representational modalities that included auditory, haptic and visual variations . Our findings show a rich characterization of these different representational modalities: our visually oriented representations engage through their familiarity, accuracy and easy interpretation, while our representations that stimulated auditory and haptic interpretation were experienced as more ambiguous, yet stimulated an engaging interpretation of data that involved the whole body. We describe and discuss in detail participants' processes of making sense and generating meaning using the modalities' unique characteristics, individually and as a group. Our research informs future research in the area of multimodal data representations from both a design and methodological perspective.

show abstract

Section: Data Interpretation and Processsupporting

confidence: 82%

Section: Physical Representationsmentioning

confidence: 99%

The Visual and Beyond

Hogan

Hinrichs

Hornecker

2017

Proceedings of the 2017 Conference on Designing Interactive Systems

Self Cite

View full text Add to dashboard Cite

show abstract

“…Intermodal Perception: The idea of conveying data to several senses has been around (e.g., [26,42,56]) but has typically followed a multimodal approach, where multiple output devices address the senses separately. In contrast, data physicalization follows an intermodal approach [64] that guarantees cohesive and realistic multisensory experiences.…”

Section: Leveraging Our Perceptual Exploration Skillsmentioning

confidence: 99%

“…For example, the benefits of the physicalizations used by Rosling (Figure 2-right) likely lie in their pedagogical and persuasive power. Other criteria relevant to physicalizations include the insights gained from interacting with them [51], the extent to which they promote engagement and behavior change, their memorability [8], and the affective responses they elicit [26]. Taking inspiration from work on visualization evaluation scenarios [37], it also seems important to explore methodologies for understanding how people reason, collaborate and communicate with physicalizations.…”

Section: Evaluation-specific Challengesmentioning

confidence: 99%

Opportunities and Challenges for Data Physicalization

Jansen

Dragicevic

Isenberg

et al. 2015

Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

413

268

View full text Add to dashboard Cite

Figure 1: Examples of data physicalizations: (left) population density map of Mexico City co-created by Richard Burdett and exhibited at the Tate Modern (photo by Stefan Geens), (center) similar data shown on an actuated display from the MIT Media Lab [70], and (right) spherical particles suspended by acoustic levitation [61]. All images are copyright to their respective owners. ABSTRACTPhysical representations of data have existed for thousands of years. Yet it is now that advances in digital fabrication, actuated tangible interfaces, and shape-changing displays are spurring an emerging area of research that we call Data Physicalization. It aims to help people explore, understand, and communicate data using computer-supported physical data representations. We call these representations physicalizations, analogously to visualizations -their purely visual counterpart. In this article, we go beyond the focused research questions addressed so far by delineating the research area, synthesizing its open challenges, and laying out a research agenda.

show abstract

“…Observations of visitors of a space observatory indicate that this kind of representation engaged visitors, and felt more real and less abstract than purely graphical representations. In a previous study, they had found clues that the modality and modality combinations used to represent data can influence the experience [Hogan and Hornecker, 2012]. Roberts and Walker [2010] encouraged the InfoVis community to develop a unified theory that covers all human senses and allows the integration of multiple modalities.…”

Section: Examples For Physicalizationsmentioning

confidence: 99%

Exploring the Potential of Physical Visualizations

Stusak¹

2015

Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction

View full text Add to dashboard Cite

The goal of an external representation of abstract data is to provide insights and convey information about the structure of the underlying data, therefore helping people execute tasks and solve problems more effectively. Apart from the popular and well-studied digital visualization of abstract data there are other scarcely studied perceptual channels to represent data such as taste, sound or haptic. My thesis focuses on the latter and explores in which ways human knowledge and ability to sense and interact with the physical non-digital world can be used to enhance the way in which people analyze and explore abstract data. Emerging technological progress in digital fabrication allow an easy, fast and inexpensive production of physical objects. Machines such as laser cutters and 3D printers enable an accurate fabrication of physical visualizations with different form factors as well as materials. This creates, for the first time, the opportunity to study the potential of physical visualizations in a broad range.The thesis starts with the description of six prototypes of physical visualizations from static examples to digitally augmented variations to interactive artifacts. Based on these explorations, three promising areas of potential for physical visualizations were identified and investigated in more detail: perception & memorability, communication & collaboration, and motivation & self-reflection.The results of two studies in the area of information recall showed that participants who used a physical bar chart retained more information compared to the digital counterpart. Particularly facts about maximum and minimum values were be remembered more efficiently, when they were perceived from a physical visualization.Two explorative studies dealt with the potential of physical visualizations regarding communication and collaboration. The observations revealed the importance on the design and aesthetic of physical visualizations and indicated a great potential for their utilization by audiences with less interest in technology. The results also exposed the current limitations of physical visualizations, especially in contrast to their well-researched digital counterparts.In the area of motivation we present the design and evaluation of the Activity Sculptures project. We conducted a field study, in which we investigated physical visualizations of personal running activity. It was discovered that these sculptures generated curiosity and experimentation regarding the personal running behavior as well as evoked social dynamics such as discussions and competition.Based on the findings of the aforementioned studies this thesis concludes with two theoretical contributions on the design and potential of physical visualizations. On the one hand, it proposes a conceptual framework for material representations of personal data by describing a production and consumption lens. The goal is to encourage artists and designers working in the field of personal informatics to harness the interactive capabilities af...

show abstract

How Does Representation Modality Affect User-Experience of Data Artifacts?

Cited by 23 publications

References 15 publications

The Visual and Beyond

The Visual and Beyond

Opportunities and Challenges for Data Physicalization

Exploring the Potential of Physical Visualizations

Contact Info

Product

Resources

About