Adapting Heuristic Evaluation to Information Visualization - A Method for Defining a Heuristic Set by Heuristic Grouping

Oliveira, Maurício Rossi; Silva, Celmar Guimarães da

doi:10.5220/0006133202250232

Cited by 5 publications

(11 citation statements)

References 20 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…As we pointed out in the beginning of this paper, the InfoVis area has been developing a list of heuristic sets for itself for at least twenty years (Freitas et al, 2002;Amar and Stasko, 2004;Zuk and Carpendale, 2006;Scapin and Bastien, 1997;Forsell and Johansson, 2010). Oliveira and Silva (2017) summarize the main contributions of these works. Developing such kind of heuristics is relevant, given that using visualization-specific heuristics would provide more effective assessment of visualizations than using usability heuristics (Tarrell et al, 2014).…”

Section: Related Workmentioning

confidence: 99%

“…In a similar way, Santos et al (2018) pointed out that some of the current proposed heuristics may be hard to use, and suggested that some heuristics could be rephrased and perhaps presented as exemplified guidelines. Tarrell et al (2014) and Oliveira and Silva (2017) presented distinct classifications of the approaches for developing heuristics. Tarrell et al (2014) proposed three classes of approaches for creating visualization-specific heuristics: process-based approaches, in which the heuristics embrace all aspects of a visualization process; performance-based approaches, which propose a small set of heuristics that tries to cover most known problems; and framework-based approaches, which organize heuristics into categories.…”

Section: Related Workmentioning

confidence: 99%

“…Many areas have been defining their own heuristics, such as human-robot interaction, software for children, smartphones, mobile devices and games (Oliveira, 2017). In particular, visualization is also part of this list.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Defining Information Visualization Heuristics Based on Heuristic Grouping by Experts

2023

Proceedings of the 17 Th International Conference on Interfaces and Human Computer Interaction 2023 (IHCI 2023), the 17th Inter

View full text Add to dashboard Cite

The visualization community has been done some efforts to construct a set of heuristics focused on the qualitative evaluation of a visualization (including usability issues, but not limited to them), which could be used in Heuristic Evaluations (HE). Despite these efforts, we could not find a consolidated (i.e. solid) set of visualization heuristics in use in our community. In this work, we present initial steps for defining a set of heuristics based on heuristics proposed by our community, aiming that such a set can be used in a visualization-focused Heuristic Evaluation and become consolidated after improvements. To develop this work, we started by collecting visualization heuristics and guidelines proposed by our community in papers related to HE; we also collected guidelines extracted from visualization books. A set of experts grouped these heuristics and guidelines using an online card sorting procedure. We summarized these groups in a set of eight heuristics to be used in a regular HE procedure. We assessed these new heuristics in an experiment with professionals and students with visualization background. These participants pointed out that they were able to use the proposed heuristics to identify problems related to visualization concepts in the systems they evaluated. In addition, most participants indicated that the set is well-defined, appropriate, and pertinent to each case found, which is a positive result towards the definition of a consolidated set of heuristics for visualization.

show abstract

Section: Related Workmentioning

confidence: 99%

Section: Related Workmentioning

confidence: 99%

See 1 more Smart Citation

Defining Information Visualization Heuristics Based on Heuristic Grouping by Experts

2023

Proceedings of the 17 Th International Conference on Interfaces and Human Computer Interaction 2023 (IHCI 2023), the 17th Inter

View full text Add to dashboard Cite

show abstract

“…They have been shown to be effective methods for practitioners compared to user testing, focus groups, or other evaluative methods that require existing expert knowledge or recruitment, moderation, and compensation of participants [MTS21,CSA15,BUSC18,Nie,JLBJ16,Nie94,Ote17,SSD18,SC99,Bou18]. Heuristics are also not new in visualization [FJ10,CC05,OGdS17,Sch11] even among topics related to accessibility (color vision deficiency, specifically) [SSD18,Oli13].…”

Section: Using Heuristics To Break Into Under-addressed Areasmentioning

confidence: 99%

How accessible is my visualization? Evaluating visualization accessibility with Chartability

Elavsky

Bennett

Moritz

2022

Computer Graphics Forum

View full text Add to dashboard Cite

Novices and experts have struggled to evaluate the accessibility of data visualizations because there are no common shared guidelines across environments, platforms, and contexts in which data visualizations are authored. Between non‐specific standards bodies like WCAG, emerging research, and guidelines from specific communities of practice, it is hard to organize knowledge on how to evaluate accessible data visualizations. We present Chartability, a set of heuristics synthesized from these various sources which enables designers, developers, researchers, and auditors to evaluate data‐driven visualizations and interfaces for visual, motor, vestibular, neurological, and cognitive accessibility. In this paper, we outline our process of making a set of heuristics and accessibility principles for Chartability and highlight key features in the auditing process. Working with participants on real projects, we found that data practitioners with a novice level of accessibility skills were more confident and found auditing to be easier after using Chartability. Expert accessibility practitioners were eager to integrate Chartability into their own work. Reflecting on Chartability's development and the preliminary user evaluation, we discuss tradeoffs of open projects, working with high‐risk evaluations like auditing projects in the wild, and challenge future research projects at the intersection of visualization and accessibility to consider the broad intersections of disabilities.

show abstract

“…Our laboratory has also been investigating the definition of heuristics for evaluating visualization software. Our starting work in this research theme [15] surveyed a set of 62 heuristics and guidelines from the InfoVis literature, and grouped these heuristics in order to create a reduced set with 15 heuristics. Later works (to be published) increased the number of heuristics to be grouped and involved visualization experts to collaborate on the task of creating this reduced set of heuristics.…”

Section: Heuristics For Visualizationmentioning

confidence: 99%

Visualization Research at the Software Engineering and Information Systems Laboratory (SEIS)

Silva

2021

Anais Estendidos Da XXXIV Conference on Graphics, Patterns and Images (SIBRAPI Estendido 2021)

View full text Add to dashboard Cite

This paper summarizes twelve years of visualization research at the Software Engineering and Information Systems Laboratory (SEIS), located at the University of Campinas. This research comprises theoretical and applied research in visualization and embraces themes such as the development of matrix reordering algorithms, the creation of heuristics for visualization, and the application of visualization techniques to areas such as oil engineering and educational data mining.

show abstract

Adapting Heuristic Evaluation to Information Visualization - A Method for Defining a Heuristic Set by Heuristic Grouping

Cited by 5 publications

References 20 publications

Defining Information Visualization Heuristics Based on Heuristic Grouping by Experts

Defining Information Visualization Heuristics Based on Heuristic Grouping by Experts

How accessible is my visualization? Evaluating visualization accessibility with Chartability

Visualization Research at the Software Engineering and Information Systems Laboratory (SEIS)

Contact Info

Product

Resources

About