Evaluation

Sheelagh Carpendale
Christopher Collins
Mark Hancock
Petra Isenberg
Torre Zuk

Overview

Information visualization research is becoming more established, and as a result, it is becoming increasingly important that research in this field is validated. With the general increase in information visualization research there has also been an increase, albeit disproportionately small, in the amount of empirical work directly focused on information visualization. The purpose of this paper is to increase awareness of empirical research in general, of its relationship to information visualization in particular; to emphasize its importance; and to encourage thoughtful application of a greater variety of evaluative research methodologies in information visualization.

Additional Project Pages

Petra Isenberg's project page on Evaluation Scenarios.

Tutorials

IEEE Vis 2016: Considering Qualitative Evaluation

Publications

Brehmer, Matthew, Carpendale, Sheelagh, Lee, Bongshin and Tory, Melanie. Pre-design Empiricism for Information Visualization: Scenarios, Methods, and Challenges. In Proceedings of BELIV 2014: the Fifth Workshop on Beyond Time and Errors: Novel Evaluation Methods for Visualization. (New York, NY, USA), ACM, pages 147-151, 2014.

Sheelagh Carpendale. Evaluating Information Visualizations. In Information Visualization: Human-Centered Issues and Perspectives, pages 19-45. Springer Berlin / Heidelberg, 2008.

Petra Isenberg, Torre Zuk, Christopher Collins and Sheelagh Carpendale. Grounded Evaluation of Information Visualizations. In BELIV 2008: Proceedings of the CHI Workshop Beyond Time and Errors: Novel Evaluation Methods for Information Visualization. ACM Press, pages 56-63, 2008.

Heidi Lam, Enrico Bertini, Petra Isenberg, Catherine Plaisant and Sheelagh Carpendale. Empirical Studies in Information Visualization: Seven Scenarios. IEEE Transactions on Visualization and Computer Graphics, 2012. Appeared online: 30 Nov. 2011. Supersedes the earlier techreport.

Torre Zuk, Lothar Schlesier, Petra Neumann, Mark S. Hancock and M. Sheelagh T. Carpendale. Heuristics for Information Visualization Evaluation. In BELIV 2006: Proceedings of the Workshop Beyond Time and Errors: Novel Evaluation Methods for Information Visualization, held in conjunction with the Working Conference on Advanced Visual Interfaces (AVI 2006). (Venice, Italy), ACM Press, May 23--26, 2006.