Evaluating data visualization : Broadening the measurements of success

Ridley, Arran; Birchall, Christopher

doi:10.5117/9789463722902_ch08

Cited by 3 publications

(3 citation statements)

References 22 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, adopting this attitude requires a recognition of the epistemology of professional practice as being distinct from the epistemology of academic research [82]. Future work can investigate ways of training data visualization designers in relation to studio practices [76,88], such as the use of critique [20,35], and the development of a design identity [39].…”

Section: Limitations and Future Workmentioning

confidence: 99%

Design Judgment in Data Visualization Practice

Parsons

Gray

Baigelenov

et al. 2020

2020 IEEE Visualization Conference (VIS)

View full text Add to dashboard Cite

Professional roles for data visualization designers are growing in popularity, and interest in relationships between the academic research and professional practice communities is gaining traction. However, despite the potential for knowledge sharing between these communities, we have little understanding of the ways in which practitioners design in real-world, professional settings. Inquiry in numerous design disciplines indicates that practitioners approach complex situations in ways that are fundamentally different from those of researchers. In this work, I take a practice-led approach to understanding visualization design practice on its own terms. Twenty data visualization practitioners were interviewed and asked about their design process, including the steps they take, how they make decisions, and the methods they use. Findings suggest that practitioners do not follow highly systematic processes, but instead rely on situated forms of knowing and acting in which they draw from precedent and use methods and principles that are determined appropriate in the moment. These findings have implications for how visualization researchers understand and engage with practitioners, and how educators approach the training of future data visualization designers.

show abstract

Section: Limitations and Future Workmentioning

confidence: 99%

Design Judgment in Data Visualization Practice

Parsons

Gray

Baigelenov

et al. 2020

2020 IEEE Visualization Conference (VIS)

View full text Add to dashboard Cite

show abstract

“…Determination of "success": Participants mentioned that the determination of success among COVID-19 visualizations included traditional metrics, such as the number of web traffic/views, total times of media coverage, number of "embeds" (if applicable), usability (e.g., visualizations work properly throughout the course of the pandemic), and clarity (e.g., less clarification questions). These metrics were similar to those used in academia [50,55].…”

Section: The Termination Phasementioning

confidence: 95%

Visualization Design Practices in a Crisis: Behind the Scenes with COVID-19 Dashboard Creators

Zhang¹,

Gaggiano²,

Kumar³

et al. 2022

Preprint

View full text Add to dashboard Cite

During the COVID-19 pandemic, a number of data visualizations were created to inform the public about the rapidly evolving crisis. Data dashboards, a form of information dissemination used during the pandemic, have facilitated this process by visualizing statistics regarding the number of COVID-19 cases over time. Prior work on COVID-19 visualizations has primarily focused on the design and evaluation of specific visualization systems from technology-centered perspectives. However, little is known about what occurs behind the scenes during the visualization creation processes, given the complex sociotechnical contexts in which they are embedded. Yet, such ecological knowledge is necessary to help characterize the nuances and trajectories of visualization design practices in the wild, as well as generate insights into how creators come to understand and approach visualization design on their own terms and for their own situated purposes. In this research, we conducted a qualitative interview study among dashboard creators from federal agencies, state health departments, mainstream news media outlets, and other organizations that created (often widely-used) COVID-19 dashboards to answer the following questions: how did visualization creators engage in COVID-19 dashboard design, and what tensions, conflicts, and challenges arose during this process? Our findings detail the trajectory of design practices-from creation to expansion, maintenance, and termination-that are shaped by the complex interplay between design goals, tools and technologies, labor, emerging crisis contexts, and public engagement. We particularly examined the tensions between designers and the general public involved in these processes. These conflicts, which often materialized due to a divergence between public demands and standing policies, centered around the type and amount of information to be visualized, how public perceptions shape and are shaped by visualization design, and the strategies utilized to deal with (potential) misinterpretations and misuse of visualizations. Our findings and lessons learned shed light on new ways of thinking in visualization design, focusing on the bundled activities that are invariably involved in human and nonhuman participation throughout the entire trajectory of design practice.

show abstract

“…One limitation of Twitter is the lack of rich data that may otherwise be available in conversations taking place among practitioners. Future work could take an ethnographic approach, collecting much richer data on the negotiations taking place among visualization designers (e.g., in a visualization design studio [18]). Our analysis is preliminary and shows that conversations of different types are indeed taking place.…”

Section: Summary and Future Workmentioning

confidence: 99%

Negotiating visualization minimalism - a preliminary analysis of Twitter conversations

Shukla

Parsons²

2022

Preprint

View full text Add to dashboard Cite

Concepts related to visualization minimalism, such as ‘chartjunk’ and ‘data-ink’, have received significant attention in the visualization literature and have been subject to intense debate and disagreement. Much of the focus has been on determining whether and how non-essential visual elements influence comprehension, and performance of users. Less attention has been placed on the perspectives of visualization practitioners, including the ways in which such concepts are used and understood within the context of a community of practice. In this paper, we investigate conversations on Twitter regarding visualization minimalism, focusing on the ways in which design knowledge is negotiated and applied. Our findings suggest that there is a vibrant community of practice engaged in deliberations on topics relating to visualization minimalism. We suggest more research should focus on visualization practice and the social dimensions of how design knowledge is negotiated and used.

show abstract

Evaluating data visualization : Broadening the measurements of success

Cited by 3 publications

References 22 publications

Design Judgment in Data Visualization Practice

Design Judgment in Data Visualization Practice

Visualization Design Practices in a Crisis: Behind the Scenes with COVID-19 Dashboard Creators

Negotiating visualization minimalism - a preliminary analysis of Twitter conversations

Contact Info

Product

Resources

About