Abstract
Traditional studies in uncertainty visualization often require naive participants to complete complex, domain-specific tasks in order to examine how effectively a visualization conveys uncertainty to support decision making. However, without assessing whether participants understand such tasks, it can be difficult to determine whether differences in performance are due to a given visualization or to varying degrees of comprehension. Although training is commonly administered to non-experts, to date, training has not been a focal point in uncertainty visualization research. In this paper, we evaluated how variations in training, coupled with assessments of knowledge acquisition and application, can inform uncertainty visualization research. Overall, we found significant performance differences based on training condition, illustrating how training influences task comprehension, which in turn influences decision making. This study serves to highlight training as a critical component of uncertainty visualization studies by quantifying performance variations due to training.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Andrienko, G., Andrienko, N., Demsar, U., Dransch, D., Dykes, J., Fabrikant, S.I., Jern, M., Kraak, M.J., Schumann, H., Tominski, C.: Space, time and visual analytics. Int. J. Geogr. Inf. Sci. 24, 1577–1600 (2010)
Sedig, K., Parsons, P.: Interaction design for complex cognitive activities with visual representations: a pattern-based approach. AIS Trans. Hum. Comput. Interact. 2, 84–133 (2013)
Kehrer, J., Hauser, H.: Visualization and visual analysis of multifaceted scientific data: a survey. IEEE Trans. Vis. Comput. Graph. 19, 495–513 (2013)
Sanyal, J., Zhang, S., Bhattacharya, G., Amburn, P., Moorhead, R.J.: A user study to compare four uncertainty visualization methods for 1D and 2D datasets. IEEE Trans. Vis. Comput. Graph. 15, 1209–1218 (2009)
Bisantz, A.M., Cao, D., Jenkins, M., Pennathur, P.R., Farry, M., Roth, E., Potter, S.S., Pfautz, J.: Comparing uncertainty visualizations for a dynamic decision-making task. J. Cogn. Eng. Decis. Mak. 5, 277–293 (2011)
MacEachren, A.M., Robinson, A., Hopper, S., Gardner, S., Murray, R., Gahegan, M., Hetzler, E.: Visualizing geospatial information uncertainty: what we know and what we need to know. Cartogr. Geogr. Inf. Sci. 32, 139–160 (2005)
Nadav-Greenberg, L., Joslyn, S.L.: Uncertainty forecasts improve decision making among nonexperts. J. Cogn. Eng. Decis. Mak. 3, 209–227 (2009)
Isenberg, T., Isenberg, P., Chen, J., Sedlmair, M., Moller, T.: A systematic review on the practice of evaluating visualization. IEEE Trans. Vis. Comput. Graph. 19, 2818–2827 (2013)
Andrews, K.: Evaluation comes in many guises. In: AVI Workshop on BEyond Time Errors, pp. 8–10 (2008)
Kwon, B.C., Lee, B.: A comparative evaluation on online learning approaches using parallel coordinate visualization. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pp. 993–997 (2016)
Netzel, R., Hlawatsch, M., Burch, M., Balakrishnan, S., Schmauder, H., Weiskopf, D.: An evaluation of visual search support in maps. IEEE Trans. Vis. Comput. Graph. 23, 421–430 (2017)
Chang, C., Bach, B., Marriott, K., Dwyer, T.: Evaluating perceptually complementary views for network exploration tasks. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pp. 1397–1407 (2017)
Leitner, M., Buttenfield, B.P.: Guidelines for the display of attribute certainty. Cartogr. Geogr. Inf. Sci. 27, 3–14 (2000)
Moray, N.: Subjective mental workload. Hum. Factors J. Hum. Factors Ergon. Soc. 24, 25–40 (1982)
Kirschenbaum, S.S., Trafton, J.G., Schunn, C.D., Trickett, S.B.: Visualizing uncertainty: the impact on performance. Hum. Factors 56, 509–520 (2014)
Karstens, C.D., Stumpf, G., Ling, C., Hua, L., Kingfield, D., Smith, T.M., Correia, J., Calhoun, K., Ortega, K., Melick, C., Rothfusz, L.P.: Evaluation of a probabilistic forecasting methodology for severe convective weather in the 2014 hazardous weather testbed. Weather Forecast. 30, 1551–1570 (2015)
Loft, S., Morrell, D.B., Ponton, K., Braithwaite, J., Bowden, V., Huf, S.: The impact of uncertain contact location on situation awareness and performance in simulated submarine track management. Hum. Factors 58, 1052–1068 (2016)
Beach, L.R., Mitchell, T.R.: A contingency model for the selection of decision strategies. Acad. Manag. Rev. 3, 439–449 (1978)
Cuevas, H.M., Fiore, S.M., Bowers, C.A., Salas, E.: Fostering constructive cognitive and metacognitive activity in computer-based complex task training environments. Comput. Hum. Behav. 20, 225–241 (2004)
Fiore, S.M., Cuevas, H.M., Scielzo, S., Salas, E.: Training individuals for distributed teams: problem solving assessment for distributed mission research. Comput. Hum. Behav. 18, 729–744 (2002)
Paas, F., Renkl, A., Sweller, J.: Cognitive load theory and instructional design: recent developments. Educ. Psychol. 38, 1–4 (2003)
Fiore, S.M., Scielzo, S., Jentsch, F., Howard, M.L.: Effects of discrimination task training on X-ray screening decisions. In: Proceedings of the 50th Annual Meeting of the Human Factors and Ergonomics Society, pp. 2610–2614 (2006)
Paas, F.G.W.C., Van Merriënboer, J.J.G.: The efficiency of instructional conditions: an approach to combine mental effort and performance measures. Hum. Factors J. Hum. Factors Ergon. Soc. 35, 737–743 (1993)
Johnston, J.H., Fiore, S.M., Paris, C., Smith, C.A.P.: Application of cognitive load theory to develop a measure of team cognitive efficiency. Mil. Psychol. 25, 252–265 (2013)
Acknowledgments
This work was supported by the Office of Naval Research Grant N00014-15-1-2708, under the Command Decision Making program. The views and opinions contained in this article are the authors’ and should not be construed as official or as reflecting the views of the University of Central Florida or the Office of Naval Research.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Fiore, S.M., Song, J., Newton, O.B., Pittman, C., Warta, S.F., LaViola, J.J. (2019). Determining the Effect of Training on Uncertainty Visualization Evaluations. In: Ahram, T., Falcão, C. (eds) Advances in Usability, User Experience and Assistive Technology. AHFE 2018. Advances in Intelligent Systems and Computing, vol 794. Springer, Cham. https://doi.org/10.1007/978-3-319-94947-5_14
Download citation
DOI: https://doi.org/10.1007/978-3-319-94947-5_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-94946-8
Online ISBN: 978-3-319-94947-5
eBook Packages: EngineeringEngineering (R0)