99
Views
0
CrossRef citations to date
0
Altmetric
Review Article

Reviewing linkages between display design and cognitive biases in decision making: an emergency response perspective

& ORCID Icon
Received 19 Dec 2022, Accepted 24 Mar 2024, Published online: 10 Apr 2024

References

  • Andreasson, Rebecca, and Maria Riveiro. 2014. “Effects of Visualizing Missing Data: An Empirical Evaluation.” In 2014 18th International Conference on Information Visualisation, 132–138.
  • Andrews, Robert W., J. Mason Lilly, Divya Srivastava, and Karen M. Feigh. 2023. “The Role of Shared Mental Models in Human-AI Teams: A Theoretical Review.” Theoretical Issues in Ergonomics Science 24 (2): 129–175. https://doi.org/10.1080/1463922X.2022.2061080.
  • Arnott, David. 1998. A Taxonomy of Decision Biases. Caulfield: Monash University, School of Information Management and Systems.
  • Arnott, David. 2006. “Cognitive Biases and Decision Support Systems Development: A Design Science Approach.” Information Systems Journal 16 (1): 55–78. https://doi.org/10.1111/j.1365-2575.2006.00208.x.
  • Arnott, David, and Graham Pervan. 2015. “A Critical Analysis of Decision Support Systems Research.” In Formulating Research Methods for Information Systems, 127-168, Vol. 2. London: Palgrave Macmillan.
  • Ash, Kevin D., Ronald L. Schumann, and Gregg C. Bowser. 2014. “Tornado Warning Trade-Offs: Evaluating Choices for Visually Communicating Risk.” Weather, Climate, and Society 6 (1): 104–118. https://doi.org/10.1175/WCAS-D-13-00021.1.
  • Bhandari, Gokul, Khaled Hassanein, and Richard Deaves. 2008. “Debiasing Investors with Decision Support Systems: An Experimental Investigation.” Decision Support Systems 46 (1): 399–410. https://doi.org/10.1016/j.dss.2008.07.010.
  • Bisantz, Ann M., Dapeng Cao, Michael Jenkins, Priyadarshini R. Pennathur, Michael Farry, Emilie Roth, Scott S. Potter, and Jonathan Pfautz. 2011. “Comparing Uncertainty Visualizations for a Dynamic Decision-Making Task.” Journal of Cognitive Engineering and Decision Making 5 (3): 277–293. https://doi.org/10.1177/1555343411415793.
  • Bisantz, Ann M., Richard T. Stone, Jonathan Pfautz, Adam Fouse, Michael Farry, Emilie Roth, Allen L. Nagy, and Gina Thomas. 2009. “Visual Representations of Meta-Information.” Journal of Cognitive Engineering and Decision Making 3 (1): 67–91. https://doi.org/10.1518/155534309X433726.
  • Borst, Clark, Vincent A. Bijsterbosch, M. M. Van Paassen, and Max Mulder. 2017. “Ecological Interface Design: Supporting Fault Diagnosis of Automated Advice in a Supervisory Air Traffic Control Task.” Cognition, Technology & Work 19 (4): 545–560. https://doi.org/10.1007/s10111-017-0438-y.
  • Brenner, Lyle A., Derek J. Koehler, and Amos Tversky. 1996. “On the Evaluation of One‐Sided Evidence.” Journal of Behavioral Decision Making 9 (1): 59–70. https://doi.org/10.1002/(SICI)1099-0771(199603)9:1<59::AID-BDM216>3.0.CO;2-V.
  • Bruine de Bruin, Wändi, Andrew M. Parker, and Baruch Fischhoff. 2007. “Individual Differences in Adult Decision-Making Competence.” Journal of Personality and Social Psychology 92 (5): 938.
  • Burns, Catherine M., and John Hajdukiewicz. 2004. Ecological Interface Design. Boca Raton, Florida: CRC Press.
  • Burns, Catherine M., Gyrd Skraaning, Jr, Greg A. Jamieson, Nathan Lau, Jordanna Kwok, Robin Welch, and Gisle Andresen. 2008. “Evaluation of Ecological Interface Design for Nuclear Process Control: Situation Awareness Effects.” Human Factors 50 (4): 663–679. https://doi.org/10.1518/001872008X312305.
  • Carney, Dana R., and Mahzarin R. Banaji. 2012. “First Is Best.” PLoS One 7 (6): E 35088. https://doi.org/10.1371/journal.pone.0035088.
  • Carroll, John M., M. Mentis, Gregorio Convertino, Mary Beth Rosson, Craig Ganoe, Hansa Sinha, and Dejin Zhao. 2007. “Prototyping Collaborative Geospatial Emergency Planning.” Proceedings of ISCRAM 2007, 105–113.
  • Chen, N., W. Liu, R. Bai, and A. Chen. 2019. “Application of Computational Intelligence Technologies in Emergency Management: A Literature Review.” Artificial Intelligence Review 52 (3): 2131–2168. https://doi.org/10.1007/s10462-017-9589-8.
  • Cheng, Fei-Fei, and Chin-Shan Wu. 2010. “Debiasing the Framing Effect: The Effect of Warning and Involvement.” Decision Support Systems 49 (3): 328–334. https://doi.org/10.1016/j.dss.2010.04.002.
  • Clegg, Benjamin A., Rosa Mikeal Martey, Jennifer Stromer-Galley, Kate Kenski, Tobi Saulnier, James E. Folkestad, Elizabeth McLaren, et al. 2014. “Game-Based Training to Mitigate Three Forms of Cognitive Bias.” Proceedings of Interservice/Industry Training, Simulation and Education Conference (I/ITSEC) 14180: 1–12.
  • Cook, Maia B., and Harvey S. Smallman. 2008. “Human Factors of the Confirmation Bias in Intelligence Analysis: Decision Support from Graphical Evidence Landscapes.” Human Factors 50 (5): 745–754. https://doi.org/10.1518/001872008X354183.
  • Croskerry, Pat. 2009. “Clinical Cognition and Diagnostic Error: Applications of a Dual Process Model of Reasoning.” Advances in Health Sciences Education: Theory and Practice 14 (S1): 27–35. https://doi.org/10.1007/s10459-009-9182-2.
  • Croskerry, Pat, Geeta Singhal, and Silvia Mamede. 2013. “Cognitive Debiasing 2: Impediments to and Strategies for Change.” BMJ Quality & Safety 22 (Suppl 2): ii65–ii72. https://doi.org/10.1136/bmjqs-2012-001713.
  • De Meutter, P., J. Camps, A. Delcloo, and P. Termonia. 2017. “Uncertainty Quantification of Atmospheric Transport Modelling of Radionuclides.” Paper presented at 3rd NERIS Workshop: State of the Art and Needs for Further Research for Emergency and Recovery Preparedness and Response, 61–66, Lisbon, Portugal, May 2017.
  • Dimara, E., S. Franconeri, C. Plaisant, A. Bezerianos, and P. Dragicevic. 2018. “A Task-Based Taxonomy of Cognitive Biases for Information Visualization.” IEEE Transactions on Visualization and Computer Graphics 26 (2): 1413–1432. https://doi.org/10.1109/TVCG.2018.2872577.
  • Dougherty, M., R. Thomas, and N. Lange. 2010. “Toward an Integrative Theory of Hypothesis Generation, Probability Judgment, and Hypothesis Testing.” Psychology of Learning and Motivation 52: 299–342.
  • Dwarakanath, L., A. Kamsin, R. A. Rasheed, A. Anandhan, and L. Shuib. 2021. “Automated Machine Learning Approaches for Emergency Response and Coordination via Social Media in the Aftermath of a Disaster: A Review.” IEEE Access 9: 68917–68931. https://doi.org/10.1109/ACCESS.2021.3074819.
  • Ellis, Geoffrey, and Alan Dix. 2015. “Decision Making under Uncertainty in Visualisation?”. Paper presented at IEEE Vis2015, Chicago, USA, October 2015.
  • Fischoff, Baruch. 1981. Debiasing. Eugene, OR: Decision Research (No. PTR-1092-81-3).
  • Garcia-Retamero, Rocio, and Mirta Galesic. 2010. “How to Reduce the Effect of Framing on Messages about Health.” Journal of General Internal Medicine 25 (12): 1323–1329. https://doi.org/10.1007/s11606-010-1484-9.
  • George, J. F., K. Duffy, and M. Ahuja. 2000. “Countering the Anchoring and Adjustment Bias with Decision Support Systems.” Decision Support Systems 29 (2): 195–206. https://doi.org/10.1016/S0167-9236(00)00074-9.
  • Gigerenzer, Gerd, and Wolfgang Gaissmaier. 2011. “Heuristic Decision Making.” Annual Review of Psychology 62 (1): 451–482. https://doi.org/10.1146/annurev-psych-120709-145346.
  • Graber, Mark L., Stephanie Kissam, Velma L. Payne, Ashley N. D. Meyer, Asta Sorensen, Nancy Lenfestey, Elizabeth Tant, Kerm Henriksen, Kenneth LaBresh, and Hardeep Singh. 2012. “Cognitive Interventions to Reduce Diagnostic Error: A Narrative Review.” BMJ Quality & Safety 21 (7): 535–557. https://doi.org/10.1136/bmjqs-2011-000149.
  • Guarino, Sean L., Jonathan D. Pfautz, Zach Cox, and Emilie Roth. 2009. “Modeling Human Reasoning about Meta-Information.” International Journal of Approximate Reasoning 50 (3): 437–449. https://doi.org/10.1016/j.ijar.2008.04.009.
  • Hadley, Constance Noonan, Todd L. Pittinsky, S. Amy Sommer, and Weichun Zhu. 2011. “Measuring the Efficacy of Leaders to Assess Information and Make Decisions in a Crisis: The C-LEAD Scale.” The Leadership Quarterly 22 (4): 633–648. https://doi.org/10.1016/j.leaqua.2011.05.005.
  • Higgins, Margaret. 1999. “Meta‐Information, and Time: Factors in Human Decision Making.” Journal of the American Society for Information Science 50 (2): 132–139. https://doi.org/10.1002/(SICI)1097-4571(1999)50:2<132::AID-ASI4>3.0.CO;2-N.
  • Huang, Weidong, Peter Eades, and Seok-Hee Hong. 2009. “Measuring Effectiveness of Graph Visualizations: A Cognitive Load Perspective.” Information Visualization 8 (3): 139–152. https://doi.org/10.1057/ivs.2009.10.
  • IAEA (International Atomic Energy Agency). 2014. “IAEA Report on Human and Organizational Factors in Nuclear Safety in the Light of the Accident at the Fukushima Daiichi Nuclear Power Plant.” International Experts Meeting, 21–24 May, Vienna, Austria.
  • IAEA (International Atomic Energy Agency). 2015. The Fukushima Daiichi Accident: Report by the Director General, Printed by the IAEA in Austria.
  • Illingworth, David. 2020. “Hypothesis-Guided Testing Behavior: The Role of Generation, Meta-Cognition, and Search.” PhD diss., Georgia Institute of Technology, Atlanta, GA.
  • Illingworth, David A., and Karen M. Feigh. 2022. “Impact Mapping for Geospatial Reasoning and Decision Making.” Human Factors 64 (8): 1363–1378. https://doi.org/10.1177/0018720821999021.
  • Jamieson, Greg A. 2007. “Ecological Interface Design for Petrochemical Process Control: An Empirical Assessment.” IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans 37 (6): 906–920. https://doi.org/10.1109/TSMCA.2007.897583.
  • Jenni, Karen, and George Loewenstein. 1997. “Explaining the Identifiable Victim Effect.” Journal of Risk and Uncertainty 14 (3): 235–257. https://doi.org/10.1023/A:1007740225484.
  • Jonas, Eva, Stefan Schulz-Hardt, Dieter Frey, and Norman Thelen. 2001. “Confirmation Bias in Sequential Information Search after Preliminary Decisions: An Expansion of Dissonance Theoretical Research on Selective Exposure to Information.” Journal of Personality and Social Psychology 80 (4): 557–571. https://doi.org/10.1037/0022-3514.80.4.557.
  • Kahneman, Daniel. 2003. “A Perspective on Judgment and Choice: Mapping Bounded Rationality.” American Psychologist 58 (9): 697–720.
  • Kahneman, Daniel, Dan Lovallo, and Olivier Sibony. 2011. “Before You Make That Big Decision.” Harvard Business Review 89 (6): 50–60, 137.
  • Kahneman, Daniel, and Amos Tversky. 2013. “Prospect Theory: An Analysis of Decision under Risk.” In Handbook of the Fundamentals of Financial Decision Making: Part I, 99–127.
  • Kinkeldey, Christoph, Jennifer Mason, Alexander Klippel, and Jochen Schiewe. 2013. “Assessing the Impact of Design Decisions on the Usability of Uncertainty Visualization: Noise Annotation Lines for the Visual Representation of Attribute Uncertainty.” Proceedings of the 26th International Cartographic Conference: 25–30.
  • Kinkeldey, Christoph, Alan M. MacEachren, Maria Riveiro, and Jochen Schiewe. 2015. “Evaluating the Effect of Visually Represented Geodata Uncertainty on Decision-Making: Systematic Review, Lessons Learned, and Recommendations.” Cartography and Geographic Information Science 44 (1): 1–21. https://doi.org/10.1080/15230406.2015.1089792.
  • Klayman, Joshua, and Kaye Brown. 1993. “Debias the Environment instead of the Judge: An Alternative Approach to Reducing Error in Diagnostic (and Other) Judgment.” Cognition 49 (1-2): 97–122. https://doi.org/10.1016/0010-0277(93)90037-v.
  • Klein, Gary A. 1993. “A Recognition-Primed Decision (RPD) Model of Rapid Decision Making.” In Decision Making in Action: Models and Methods, edited by G. A. Klein, J. Orasanu, R. Calderwood, and C. E. Zsambok, vol. 5, 138–147. Norwood, NJ: Ablex Publishing Corporation.
  • Leitner, Michael, and Barbara P. Buttenfield. 2000. “Guidelines for the Display of Attribute Certainty.” Cartography and Geographic Information Science 27 (1): 3–14. https://doi.org/10.1559/152304000783548037.
  • Liu, Baoxia, and James T. Todd. 2004. “Perceptual Biases in the Interpretation of 3D Shape from Shading.” Vision Research 44 (18): 2135–2145. https://doi.org/10.1016/j.visres.2004.03.024.
  • Mancuso, Vincent F., Victor S. Finomore, Katherine M. Rahill, Elizabeth A. Blair, and Gregory J. Funke. 2014. “Effects of Cognitive Biases on Distributed Team Decision Making.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 58 (1): 405–409. https://doi.org/10.1177/1541931214581083.
  • Mantonakis, Antonia, Pauline Rodero, Isabelle Lesschaeve, and Reid Hastie. 2009. “Order in Choice: Effects of Serial Position on Preferences.” Psychological Science 20 (11): 1309–1312. https://doi.org/10.1111/j.1467-9280.2009.02453.x.
  • Mineka, Susan, and Steven K. Sutton. 1992. “Cognitive Biases and the Emotional Disorders.” Psychological Science 3 (1): 65–69. https://doi.org/10.1111/j.1467-9280.1992.tb00260.x.
  • Murata, Atsuo, Tomoko Nakamura, and Waldemar Karwowski. 2015. “Influence of Cognitive Biases in Distorting Decision Making and Leading to Critical Unfavorable Incidents.” Safety 1 (1): 44–58. https://doi.org/10.3390/safety1010044.
  • Nadav-Greenberg, Limor, Susan L. Joslyn, and Meng U. Taing. 2008. “The Effect of Uncertainty Visualizations on Decision Making in Weather Forecasting.” Journal of Cognitive Engineering and Decision Making 2 (1): 24–47. https://doi.org/10.1518/155534308X284354.
  • Nagy, A., T. Perko, T. Müller, W. Raskob, and L. Benighaus. 2020. “Uncertainty Visualization Using Maps for Nuclear and Radiological Emergencies.” Radioprotection 55: S197–S203. https://doi.org/10.1051/radiopro/2020033.
  • National Academies of Sciences, Engineering, and Medicine. 2016. Lessons Learned from the Fukushima Nuclear Accident for Improving Safety and Security of US Nuclear Plants. Washington, DC: National Academies Press.
  • Nickerson, Raymond S. 1998. “Confirmation Bias: A Ubiquitous Phenomenon in Many Guises.” Review of General Psychology 2 (2): 175–220. https://doi.org/10.1037/1089-2680.2.2.175.
  • Nuclear Energy Agency. n.d. “Ukraine: Current status of Nuclear Power Installations.” Accessed 2022. https://www.oecd-nea.org/jcms/pl_66130/ukraine-current-status-of-nuclear-power-installations
  • Padilla, Lace M., Sarah H. Creem-Regehr, Mary Hegarty, and Jeanine K. Stefanucci. 2018. “Decision Making with Visualizations: A Cognitive Framework across Disciplines.” Cognitive Research: Principles and Implications 3: 29. https://doi.org/10.1186/s41235-018-0120-9.
  • Pantazi, Myrto, Mikhail Kissine, and Olivier Klein. 2018. “The Power of the Truth Bias: False Information Affects Memory and Judgment Even in the Absence of Distraction.” Social Cognition 36 (2): 167–198. https://doi.org/10.1521/soco.2018.36.2.167.
  • Parsons, Paul. 2018. “Promoting Representational Fluency for Cognitive Bias Mitigation in Information Visualization.” In Cognitive Biases in Visualizations, edited by Geoffrey Ellis, 137–147. Cham: Springer.
  • Paudyal, Pragya, and B. L. William Wong. 2018. “Algorithmic Opacity: Making Algorithmic Processes Transparent through Abstraction Hierarchy.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 62 (1): 192–196. https://doi.org/10.1177/1541931218621046.
  • Paulus, David, Ramian Fathi, Frank Fiedrich, Bartel Van de Walle, and Tina Comes. 2022. “On the Interplay of Data and Cognitive Bias in Crisis Information Management: An Exploratory Study on Epidemic Response.” Information Systems Frontiers: A Journal of Research and Innovation: 1–25. https://doi.org/10.1007/s10796-022-10241-0.
  • Perrin, Bruce M., Barbara J. Barnett, Larry Walrath, and Jeffrey D. Grossman. 2001. “Information Order and Outcome Framing: An Assessment of Judgment Bias in a Naturalistic Decision-Making Context.” Human Factors 43 (2): 227–238. https://doi.org/10.1518/001872001775900968.
  • Peters, Ellen, P. Sol Hart, and Liana Fraenkel. 2011. “Informing Patients: The Influence of Numeracy, Framing, and Format of Side Effect Information on Risk Perceptions.” Medical Decision Making: An International Journal of the Society for Medical Decision Making 31 (3): 432–436. https://doi.org/10.1177/0272989X10391672.
  • Pfautz, Jonathan, Emilie Roth, Ann Bisantz, Gina Thomas-Meyers, James Llinas, and Adam Fouse. 2006. The Role of Meta-Information in C2 Decision-Support Systems. Cambridge, MA: Charles River Analytics Inc.
  • Rafiei, Mohsen, Sabrina Hansmann-Roth, David Whitney, Árni Kristjánsson, and Andrey Chetverikov. 2021. “Optimizing Perception: Attended and Ignored Stimuli Create Opposing Perceptual Biases.” Attention, Perception & Psychophysics 83 (3): 1230–1239. https://doi.org/10.3758/s13414-020-02030-1.
  • Reising, Dal Vernon C., and Penelope M. Sanderson. 2004. “Minimal Instrumentation May Compromise Failure Diagnosis with an Ecological Interface.” Human Factors 46 (2): 316–333. https://doi.org/10.1518/hfes.46.2.316.37338.
  • Riveiro, Maria, Tove Helldin, and Göran Falkman. 2014. “Influence of Meta-Information on Decision-Making: Lessons Learned from Four Case Studies.” In 2014 IEEE International Inter-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support (CogSIMA), 14–20 https://doi.org/10.1109/CogSIMA.2014.6816534.
  • Roberts, Patrick S., and Kris Wernstedt. 2019. “Decision Biases and Heuristics among Emergency Managers: Just like the Public They Manage for?” The American Review of Public Administration 49 (3): 292–308. https://doi.org/10.1177/0275074018799490.
  • Scholz, Ruojing W., and Yongmei Lu. 2014. “Uncertainty in Geographic Data on Bivariate Maps: An Examination of Visualization Preference and Decision Making.” ISPRS International Journal of Geo-Information 3 (4): 1180–1197. https://doi.org/10.3390/ijgi3041180.
  • Slovic, Paul, and Ellen Peters. 2006. “Risk Perception and Affect.” Current Directions in Psychological Science 15 (6): 322–325. https://doi.org/10.1111/j.1467-8721.2006.00461.x.
  • Slovic, Paul, John Monahan, and Donald G. MacGregor. 2000. “Violence Risk Assessment and Risk Communication: The Effects of Using Actual Cases, Providing Instruction, and Employing Probability versus Frequency Formats.” Law and Human Behavior 24 (3): 271–296. https://doi.org/10.1023/a:1005595519944.
  • St-Cyr, Olivier, Greg A. Jamieson, and Kim J. Vicente. 2013. “Ecological Interface Design and Sensor Noise.” International Journal of Human-Computer Studies 71 (11): 1056–1068. https://doi.org/10.1016/j.ijhcs.2013.08.005.
  • Tschan, Franziska, Norbert K. Semmer, Andrea Gurtner, Lara Bizzari, Martin Spychiger, Marc Breuer, and Stephan U. Marsch. 2009. “Explicit Reasoning, Confirmation Bias, and Illusory Transactive Memory: A Simulation Study of Group Medical Decision Making.” Small Group Research 40 (3): 271–300. https://doi.org/10.1177/1046496409332928.
  • Tversky, Amos, and Daniel Kahneman. 1974. “Judgment under Uncertainty: Heuristics and Biases: Biases in Judgments Reveal Some Heuristics of Thinking under Uncertainty.” Science (New York, N.Y.) 185 (4157): 1124–1131. https://doi.org/10.1126/science.185.4157.1124.
  • Wall, Emily, John Stasko, and Alex Endert. 2019. “Toward a Design Space for Mitigating Cognitive Bias in Vis.” 2019 IEEE Visualization Conference (VIS), 111–115. https://doi.org/10.1109/VISUAL.2019.8933611.
  • Walmsley, Stephen, and Andrew Gilbey. 2017. “Debiasing Visual Pilots’ Weather-Related Decision Making.” Applied Ergonomics 65: 200–208. https://doi.org/10.1016/j.apergo.2017.06.019.
  • Wang, Danding, Qian Yang, Ashraf Abdul, and Brian Y. Lim. 2019. “Designing Theory-Driven User-Centric Explainable AI.” Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 1–15. https://doi.org/10.1145/3290605.3300831.
  • Wickens, Christopher D., Shaw L. Ketels, Alice F. Healy, Carolyn J. Buck-Gengler, and Lyle E. Bourne. Jr. 2010. “The Anchoring Heuristic in Intelligence Integration: A Bias in Need of De-Biasing.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 54 (27): 2324–2328. https://doi.org/10.1177/154193121005402722.
  • Zhang, Yunfeng, Rachel K. E. Bellamy, and Wendy A. Kellogg. 2015. “Designing Information for Remediating Cognitive Biases in Decision-Making.” Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, 2211–2220. https://doi.org/10.1145/2702123.2702239.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.