User-Centered Evaluation of Information Visualization Techniques: Making the HCI-InfoVis Connection Explicit

Freitas, Carla Maria Dal Sasso; Pimenta, Marcelo Soares; Scapin, Dominique L.

doi:10.1007/978-1-4614-7485-2_12

Cited by 26 publications

(18 citation statements)

References 50 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Interviews and observations may collect in-depth results from realistic tasks in natural settings, but lack precision and are difficult to generalize when the sample size is too small to minimize bias in individual subjectivity. User studies or user-centered evaluations have become the predominant method in recent years and are well documented in terms of experimental design, data collection and analysis [17,19,52]. Using eye tracking as a method to infer cognitive processes in user-centered evaluation has long been practiced in InfoViz, and early eye movement studies date back many decades in cognitive and perceptual psychology [23].…”

Section: Evaluation Approaches In Infovizmentioning

confidence: 99%

Eye tracking the user experience – An evaluation of ontology visualization techniques

Noy

Storey

2016

View full text Add to dashboard Cite

Abstract. Various ontology visualization techniques have been developed over the years, offering essential interfaces to users for browsing and interacting with ontologies, in an effort to assist with ontology understanding. Yet few studies have focused on evaluating the usability of existing ontology visualization techniques. This paper presents an eye-tracking user study that evaluates two commonly used ontology visualization techniques, namely, indented list and graph. The eye-tracking experiment and analysis presented in this paper complements the set of existing evaluation protocols for ontology visualization. In addition, the results found from this study contribute to a greater understanding of the strengths and weaknesses of the two visualization techniques, and in particular, how and why one is more effective than the other. Based on approximately 500MB of eye movement data containing around 30 million rows of gaze data generated by a Tobii eye tracker, we found evidence suggesting indented lists are more efficient at supporting information searches and graphs are more efficient at supporting information processing.

show abstract

Section: Evaluation Approaches In Infovizmentioning

confidence: 99%

Eye tracking the user experience – An evaluation of ontology visualization techniques

Noy

Storey

2016

View full text Add to dashboard Cite

show abstract

“…She provides her reflection on user studies and a categorization of testing methods, based on major goals such as understanding vs. evaluation as well as common methodological approaches such as quantitative experiment, qualitative observational study, inspection, and usability study. In another recent publication, Freitas et al [17] discuss usability evaluation for information visualizations by particularly looking at it from a user-centered perspective.…”

Section: Related Workmentioning

confidence: 98%

Evaluating visual analytics with eye tracking

Kurzhals

Fisher

Burch

et al. 2014

Proceedings of the Fifth Workshop on Beyond Time and Errors: Novel Evaluation Methods for Visualization

View full text Add to dashboard Cite

The application of eye tracking for the evaluation of humans' viewing behavior is a common approach in psychological research. So far, the use of this technique for the evaluation of visual analytics and visualization is less prominent. We investigate recent scientific publications from the main visualization and visual analytics conferences and journals that include an evaluation by eye tracking. Furthermore, we provide an overview of evaluation goals that can be achieved by eye tracking and state-of-the-art analysis techniques for eye tracking data. Ideally, visual analytics leads to a mixedinitiative cognitive system where the mechanism of distribution is the interaction of the user with visualization environments. Therefore, we also include a discussion of cognitive approaches and models to include the user in the evaluation process. Based on our review of the current use of eye tracking evaluation in our field and the cognitive theory, we propose directions of future research on evaluation methodology, leading to the grand challenge of developing an evaluation approach to the mixed-initiative cognitive system of visual analytics.

show abstract

“…For example, Senay and Ignatius [27] collected a number of guidelines published by earlier visualization researchers, grouping them by area of application and providing them for use in follow-on design and evaluation work. Others, such as Ware [33] and Few [4,5] have published guidelines in textbook format, intending them to be used to increase knowledge and improve design and evaluation.…”

Section: Guideline Distributionmentioning

confidence: 99%

“…Request permissions from Permissions@acm.org. iterative design processes that consider users' feedback and input for the development of usable visualizations also increased over the last years (see, e.g., [5,15,24,28]). There is a pronounced need to test information visualizations and visual analytic systems in realistic conditions.…”

Section: Introductionmentioning

confidence: 99%

Toward visualization-specific heuristic evaluation

Tarrell

Fruhling

Borgo

et al. 2014

Proceedings of the Fifth Workshop on Beyond Time and Errors: Novel Evaluation Methods for Visualization

View full text Add to dashboard Cite

This position paper describes heuristic evaluation as it relates to visualization and visual analytics. We review heuristic evaluation in general, then comment on previous process-based, performance-based, and framework-based efforts to adapt the method to visualization-specific needs. We postulate that the framework-based approach holds the most promise for future progress in development of visualization-specific heuristics, and propose a specific framework as a starting point. We then recommend a method for community involvement and input into the further development of the heuristic framework and more detailed design and evaluation guidelines.

show abstract

User-Centered Evaluation of Information Visualization Techniques: Making the HCI-InfoVis Connection Explicit

Cited by 26 publications

References 50 publications

Eye tracking the user experience – An evaluation of ontology visualization techniques

Eye tracking the user experience – An evaluation of ontology visualization techniques

Evaluating visual analytics with eye tracking

Toward visualization-specific heuristic evaluation

Contact Info

Product

Resources

About