Citation Context

...level, more theoretical understanding of the work in our field becomes increasingly important. Towards that goal, this paper follows in the line of structured analyses of the visualization literature =-=[11, 31, 39]-=- . Bertini et al. [11], for instance, proposed a systematization and overview of quality measures and derived implications for future work. Here, we focus on a similar goal as Bertini et al. but for t...

Citation Context

...esearchers to compare the suitability of different methods and determine good parameter settings for our dynamic steering. User studies in visualization have recently been reviewed by Isenberg et al. =-=[16]-=-. Tory and Möller [33] discuss human factors in user studies and visualization design. Anderson et al. [1] explore brain activity recorded using electroencephalography (EEG) to compare different visu...

Citation Context

...level, more theoretical understanding of the work in our field becomes increasingly important. Towards that goal, this paper follows in the line of structured analyses of the visualization literature =-=[11, 31, 39]-=- . Bertini et al. [11], for instance, proposed a systematization and overview of quality measures and derived implications for future work. Here, we focus on a similar goal as Bertini et al. but for t...

Citation Context

...e is a need to evaluate the hierarchies in work and task contexts. Evaluation of visualizations: information visualizations are inherently complex to evaluate and multiple evaluation approaches exist =-=[31, 22]-=-. Plaisant [31] identifies four areas of focus for evaluation: (i) controlled experiments comparing different design elements (e.g., specific interface widgets), (ii) usability evaluation of a tool; (...

Citation Context

...o better understand how our design would fare in practice we conducted an observational study with domain experts. In visualization, there are many different evaluation goals and types to choose from =-=[36, 47]-=-. In our case we were less interested in algorithmic performance, a qualitative results inspection, or user performance with respect to time and error metrics. Instead, we wanted to explore how domain...

Citation Context

...on. They adapted the original model for a total of eight evaluation scenarios and grouped the scenarios into those that target data analysis and those that target visualization systems and algorithms =-=[18]-=-. While these reviews are thorough, neither of them addressed visualization specifically for cyber security. 2.3 Evaluation for System Design Motivation for conducting an evaluation can vary, but is g...

Citation Context

...nter (NHC). We accomplished a “Qualitative Result Inspection” (QRI) study via a walk-through presentation of our technique with contracts to other techniques used in the literature for the same tasks =-=[25]-=-. We then spent a day examining the procedures used at NHC for generating their forecasts and for generating their visualizations. This one-day exercise has led to further collaboration in which membe...

Citation Context

...eductionist” evaluation methodologies, their benefits and drawbacks, and techniques for movement between these extremes. Generally, since there are a wide variety of reasons for performing evaluation =-=[11, 13]-=-, it is critical to tailor evaluation techniques to generate relevant, extensible knowledge. In this vein, we present examples from our own work in which we have employed evaluation techniques that mo...

Citation Context

...esign study approaches. Further, Lam et al. [22] studied the practice of evaluations in Information Visualization papers which was then extended to include all visualization papers by Isenberg et al. =-=[20]-=-. Others have surveyed, for instance, the literature on interactive visualization [21, 39], on tree visualizations [27], on quality metrics in high-dimensional data visualization [2], on human-compute...

Citation Context

...evaluation, visualization 1 INTRODUCTION As the field of visualization matures, theories and models that capture the how of visualization design have become more prevalent, from evaluation strategies =-=[11, 29, 34, 49, 55]-=- to the design process itself [32, 37, 54, 55, 60, 66]. While these theories and models for the design process largely address the how of visualization design, they fail to explicitly describe the con...