Measuring Effective Data Visualization

Zhu, Ying

doi:10.1007/978-3-540-76856-2_64

Cited by 53 publications

(41 citation statements)

References 29 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Such an approach seems to be needed; Hollingsed and Novick, in a review of 15 years of usability inspection methods [12], state the need to unify the two as a research goal, and Zhu [34], in stating the lack of a universally accepted framework for defining effective visualizations, calls for a method for establishing a correlation between HE and usability studies.…”

Section: Introductionmentioning

confidence: 99%

Evaluating Information Visualization via the Interplay of Heuristic Evaluation and Question-Based Scoring

Hearst

Laskowski

Silva

2016

Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

Figure 1. Three visualizations of the same dataset (from the game show Jeopardy!), designed to be of (a) low, (b) high, and (c) middling usability. ABSTRACTIn an instructional setting it can be difficult to accurately assess the quality of information visualizations of several variables. Instead of a standard design critique, an alternative is to ask potential readers of the chart to answer questions about it. A controlled study with 47 participants shows a good correlation between aggregated novice heuristic evaluation scores and results of answering questions about the data, suggesting that the two forms of assessment can be complementary. Using both metrics in parallel can yield further benefits; discrepancies between them may reveal incorrect application of heuristics or other issues.

show abstract

Section: Introductionmentioning

confidence: 99%

Evaluating Information Visualization via the Interplay of Heuristic Evaluation and Question-Based Scoring

Hearst

Laskowski

Silva

2016

Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

View full text Add to dashboard Cite

show abstract

“…19. This indicates that we cannot conclude with confidence that the scores are drawn from different populations, i.e., there is no significant difference overall in the grades we assigned when all categories are integrated.…”

Section: Assessment Outcomes: Test-driving the Pancurriculum Rubricmentioning

confidence: 76%

“…However, effectiveness has been defined in a variety of ways [19], and recommendations from different sources are sometimes in conflict with one another. We have synthesized the available recommendations into a list of guidelines (see Table 5) for students to use as they work on visualization projects in CPLS 5200.…”

Section: First Steps: Cpls 5200 Project Rubricmentioning

confidence: 99%

See 1 more Smart Citation

Diagnostics and rubrics for assessing learning across the computational science curriculum

Manson

Olsen

2010

Journal of Computational Science

View full text Add to dashboard Cite

“…Zhu proposed a framework for the definition and measurement of effective data visualization [Zhu07], according to three principles: accuracy (i.e., the attributes and structure of a visual element should match the ones of the represented data item), utility (i.e., an effective visualization should help users achieve the goal of specific tasks), and efficiency (i.e., an effective visualization should reduce the cognitive load for a specific task over non-visual representations). However, the great challenge in this context, which is finding concrete means to measure these effectiveness metrics, has unfortunately not been solved by the author with concrete solutions.…”

Section: Guidelines For Information Visualization Evaluationmentioning

confidence: 99%

Software systems as cities

Wettel

Lanza

Robbes

2011

Proceedings of the 33rd International Conference on Software Engineering

148

View full text Add to dashboard Cite

Software understanding takes up a large share of the total cost of a software system. The high costs attributed to software understanding activities are caused by the size and complexity of software systems, by the continuous evolution that these systems are subject to, and by the lack of physical presence which makes software intangible. Reverse engineering helps practitioners deal with the intrinsic complexity of software, by providing a broad range of patterns and techniques. One of these techniques is software visualization, which makes software more tangible, by providing visible representations of software systems.Interpreting a visualization is by no means trivial and requires knowledge about the visual language of the visualization. One means to ease the learning of a new visualization's language are metaphors, which allow the interpretation of new data representations by analogy. Possibly one of the most popular metaphors for software visualization is the city metaphor, which has been explored in the past by a number of researchers. However, in spite of the efforts, the value of this metaphor for reverse engineering has never been taken beyond anecdotical evidence.In this dissertation, we demonstrate the value of the city metaphor for reverse engineering along two directions. On the one hand, we show that the metaphor is versatile enough to allow the representation of different facets of software. On the other hand, we show that the city metaphor enables the creation of software visualizations which efficiently and effectively support reverse engineering activities.Our interpretation of the city metaphor at its core depicts the system as a city, the packages as districts, and the classes as buildings. The resulting "code city" visualization provides a structural overview of the software system, enriched with contextual data. To be able to perform analyses of real systems using our approach, we implemented a tool called CodeCity.We demonstrate the versatility of the metaphor, by using it in three different analysis contexts, i.e., program comprehension, software evolution analysis, and software design quality assessment. For each of the contexts, we describe the visualization techniques we employ to encode the contextual data in the visualization and we illustrate the application by means of case studies. The insights gained in the three analysis contexts are complementary to each other, leading to an increasingly more complete "big picture" of the systems.We then demonstrate how the visualizations built on top of our city metaphor effectively and efficiently support reverse engineering activities, by means of an extensive controlled experiment. The design of our experiment is based on a list of desiderata that we extracted from our survey of the current body of research. We conducted the experiment over a period of six months, in four sites located in three countries, with a heterogeneous sample of subjects composed of fair shares of both academics and industry practitioners. The main result of ...

show abstract

Measuring Effective Data Visualization

Cited by 53 publications

References 29 publications

Evaluating Information Visualization via the Interplay of Heuristic Evaluation and Question-Based Scoring

Evaluating Information Visualization via the Interplay of Heuristic Evaluation and Question-Based Scoring

Diagnostics and rubrics for assessing learning across the computational science curriculum

Software systems as cities

Contact Info

Product

Resources

About