Visually supported reasoning under uncertain conditions: Effects of domain expertise on air traffic risk assessment

References

• Aerts, J. C., Clarke, K. C., & Keuper, A. D. (2003). Testing popular visualization techniques for representing model uncertainty. Cartography and Geographic Information Science: journal of the American Congress on Surveying and Mapping, 30(3), 249–261.
   Google Scholar
• Bisantz, A., Cao, D., Jenkins, M., Pennathur, P., Farry, M., Roth, E., … Pfautz, J. (2011). Comparing uncertainty visualizations for a dynamic decision-making task. Journal of Cognitive Engineering and Decision Making, 5(3), 277–293.
   Google Scholar
• Boukhelifa, N., & Duke, D. J. (2009). Uncertainty visualization: Why might it fail? In CHI ′09 extended abstracts on human factors in computing systems (pp. 4051–4056). New York, NY, USA: ACM.
   Google Scholar
• Buttenfield, B., & Weibel, R. (1988). Visualizing the quality of cartographic data. Third International Geographic Information Systems Symposium, GIS/LIS 88. San Antonio, Marriott Rivercenter Hotel, San Antonio, Texas, November 30-December 2, 1988.
   Google Scholar
• Carpendale, S. (2008). Evaluating information visualizations. In A. Kerren, J. Stasko, J.-D. Fekete, & C. North (Eds.), Information visualization (pp. 19–45). Berlin Heidelberg: Springer-Verlag.
   Google Scholar
• Cliburn, D. C., Feddemab, J. J., Miller, J. R., & Slocum, T. A. (2002). Design and evaluation of a decision support system in a water balance application. Computers & Graphics, 26, 931–949.
   Web of Science ®Google Scholar
• Deitrick, S., & Edsall, R. (2006). The inuence of uncertainty visualization on decision making: An empirical evaluation. In A.Riedl, W. Kainz, and G. A. Elmes (Eds.), Progress in spatial data handling (pp. 719–738). Berlin Heidelberg: Springer.
   Google Scholar
• Dong, X., & Hayes, C. C. (2012). Uncertainty visualizations: Helping decision makers become more aware of uncertainty and its implications. Journal of Cognitive Engineering and Decision Making, 6(1), 30–56.
   Google Scholar
• Endsley, M. (1995). Toward a theory of situation awareness in dynamic systems. Human Factors Journal, 37(1), 32–64.
   Web of Science ®Google Scholar
• Evans, B. (1997). Dynamic display of spatial data-reliability: does it benefit the map user? Computers & Geosciences, 23(4), 409–422.
   Web of Science ®Google Scholar
• Finger, R., & Bisantz, A. (2000). Utilizing graphical formats to convey uncertainty in a decision making task. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 44(1), 13–16.
   Google Scholar
• Griethe, H., & Schumann, H. (2005). Visualizing uncertainty for improved decision making. Proceedings of the 4th International Conference on Perspectives in Business Informatics Research. University of Skövde, Sweden, 3–4 October 2005.
   Google Scholar
• Griffin, A. L., & Bell, S. (2009). Applications of signal detection theory to geographic information science. Cartographica, 44(3), 145–158.
   Google Scholar
• Harrower, M. (2003). Representing uncertainty: Does it help people make better decisions? In UCGIS Workshop on Geospatial Visualization and Knowledge Discovery, sponsored by the Advanced Research and Development Activity (ARDA) and the United States Geological Survey (USGS), November 18–20, 2003, Landsdowne, VA  (invited white paper).
   Google Scholar
• Hart, S. G., & Staveland, L. E. (1988). Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In P. A. Hancock & N. Meshkati (Eds.), Human mental workload (Vol. 52, pp. 139–183). North-Holland.
   Google Scholar
• Helldin, T., Falkman, G., Riveiro, M., Dahlbom, A., & Lebram, M. (2013). Transparency of military threat evaluation through visualizing uncertainty and system rationale. Proc. 15th Int. Conf. on Human-Computer Interaction (HCII 2013). Las Vegas, Nevada, USA, 21–26 July 2013.
   Google Scholar
• Hope, S., & Hunter, G. (2007). Testing the effects of positional uncertainty on spatial decision-making. International Journal of Geographical Information Science, 21(6), 645–665.
   Web of Science ®Google Scholar
• Irandoust, H., Benaskeur, A., Kabanza, F., & Bellefeuille, P. (2010). A mixed-initiative advisory system for threat evaluation. In Proceedings of the 15th International Command and Control Research and Technology Symposium (ICCRTS): The Evolution of C2, Santa Monica, California, USA.
   Google Scholar
• John, M. S., Callan, J., Proctor, S., & Holste, S. T. (2000). Tactical Decision-Making Under Uncertainty: Experiments I and II (Tech. Rep. No. 1821). San Diego, CA: Pacific Sciences and Engineering group Inc.
   Google Scholar
• Johnson, C. R., & Sanderson, A. R. (2003). A next step: Visualizing errors and uncertainty. IEEE Computer Graphics and Applications, 23(5), 6–10.
   Web of Science ®Google Scholar
• Kalman, R. E. (1960). A new approach to linear filtering and prediction problems. Transactions of the ASME-Journal of Basic Engineering, 82(Series D), 35–45.
   Google Scholar
• Keim, D., Andrienko, G., Fekete, J.-D., Görg, C., Kohlhammer, J., & Melançon, G. (2008). Visual analytics: Definition, process, and challenges. In A. Kerren, J. T. Stasko, J.-D. Fekete, & C. North (Eds.), Information visualization (pp. 154–175). Berlin, Heidelberg: Springer.
   Google Scholar
• Kinkeldey, C., MacEachren, A. M., Riveiro, M., & Schiewe, J. (2015). Evaluating the effect of visually represented geodata uncertainty on decision-making: systematic review, lessons learned, and recommendations, cartography and geographic information science. Cartography and Geographic Information Science, 1–21. doi:10.1080/15230406.2015.1089792.
   Web of Science ®Google Scholar
• Kirschenbaum, S. S., Trafton, J. G., Schunn, C. D., & Trickett, S. B. (2013). Visualizing uncertainty the impact on performance. Human Factors: The Journal of the Human Factors and Ergonomics Society, 56(3), 509–520.
   Google Scholar
• Kobus, D. A., Proctor, S., & Holste, S. (2001). Effects of experience and uncertainty during dynamic decision making. International Journal of Industrial Ergonomics, 28(5), 275–290.
   Web of Science ®Google Scholar
• Kruger, M., & Kratzke, N. (2009). Monitoring of reliability in Bayesian identification. In 12th International Conference on Information Fusion (pp. 1241–1248), 6–9 July 2009, Seattle, WA, IEEE.
   Google Scholar
• Liebhaber, M. J., & Feher, B. (2002). Air threat assessment: Research, model, and display guidelines. Proceedings of the 2002 Command and Control Research and Technology Symposium.
   Google Scholar
• MacEachren, A., Robinson, A., Hopper, S., Gardner, S., Murray, R., Gahegan, M., & Hetzler, E. (2005). Visualizing geospatial information uncertainty: What we know and what we need to know. Cartography and Geographic Information Science, 32(3), 139–160.
   Google Scholar
• MacEachren, A., Roth, R., O'Brien, J., Li, B., Swingley, D., & Gahegan, M. (2012). Visual semiotics uncertainty visualization: An empirical study. IEEE Transactions on Visualization and Computer Graphics, 18(12), 2496–2505.
   PubMed Web of Science ®Google Scholar
• Macmillan, N., & Creelman, C. (2005). Detection theory: A user's guide (2nd ed.). Mahwah, NJ: Lawrence Erlbaum Associates.
   Google Scholar
• Mason, J. S., Retchless, D., & Klippel, A. (2014, September 23rd). Dimensions of uncertainty: A visual classification of geospatial uncertainty visualization research. In Visually-supported reasoning with uncertainty workshop at GIScience conference, September 23rd, 2014, Vienna, Austria.
   Google Scholar
• Nadav-Greenberg, L., Joslyn, S. L., & Taing, M. U. (2008). The effect of uncertainty visualizations on decision making in weather forecasting. Journal of Cognitive Engineering and Decision Making, 2(1), 24–47.
   Google Scholar
• Neyedli, H., Hollands, J., & Jamieson, G. (2011). Beyond identity incorporating system reliability information into an automated combat identification system. Human Factors: The Journal of the Human Factors and Ergonomics Society, 53(4), 338–355.
   PubMed Web of Science ®Google Scholar
• Potter, K., Gerber, S., & Anderson, E. (2013). Visualization of uncertainty without a mean. Computer Graphics and Applications, IEEE, 33(1), 75–79. doi:10.1109/MCG.2013.14.
   PubMed Web of Science ®Google Scholar
• Ribeiro, M. I. (2004). Gaussian probability density functions: Properties and error characterization (Tech. Rep.). Instituto Superior Tecnico, Lisboa, Published at Robotics WEBook, http://www.euron.org.
   Google Scholar
• Riveiro, M., Helldin, T., Lebram, M., & Falkman, G. (2013). Towards future threat evaluation systems: user study, proposal and precepts for design Proc. 16^th Int. Conf. on Information Fusion. Istanbul, Turkey: IEEE Computer Society.
   Google Scholar
• Riveiro, M., Helldin, T., Falkman, G., & Lebram, M. (2014). Effects of visualizing uncertainty on decision-making in a target identification scenario. Computers & Graphics, 41(0), 84–98. http://dx.doi.org/10.1016/j.cag.2014.02.006.
   Web of Science ®Google Scholar
• Roth, R. E. (2009). The impact of user expertise on geographic risk assessment under uncertain conditions. Cartography and Geographic Information Science, 36(1), 29–43.
   Web of Science ®Google Scholar
• Shattuck, L. G., Miller, N. L., & Kemmerer, K. E. (2009). Tactical decision making under conditions of uncertainty: An empirical study. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 53(4), 242–246.
   Google Scholar
• Skeels, M., Lee, B., Smith, G., & Robertson, G. G. (2010). Revealing uncertainty for information visualization. information visualization. Information Visualization, 9(1), 70–81.
   Web of Science ®Google Scholar
• Stokes, A. F., Kemper, K., & Kite, K. (1997). Aeronautical decision making, cue recognition, and expertise under time pressure. In C. E. Zsambok & G. Klein (Eds.), Naturalistic Decision Making (pp. 183–196). Yahweh, NJ: Lawrence Erlbaum Associates.
   Google Scholar
• Zuk, T., & Carpendale, S. (2006). Theoretical analysis of uncertainty visualizations. In Erbacher, R. F., Roberts, J. C., Gröhn, M. T., & Börne, K. (Eds.), Visualization and Data Analysis, Proceedings of SPIE-IS&T Electronic Imaging. Vol. 6060, 16 January 2006.
   Google Scholar