Prediction in Situation Awareness: Confidence Bias and Underlying Cognitive Abilities

REFERENCES

• Alfredson , J. 2007 . Differences in situational awareness and how to manage them in development of complex systems , Linkoping, , Sweden : Unpublished PhD dissertation, Linkoping University .
   Google Scholar
• Artman , H. and Garbis , C. Situation awareness as distributed cognition . Cognition and cooperation: Proceedings of 9th Conference of cognitive ergonomics . Limerick, Ireland. Edited by: Green , T. , Bannon , L. , Warren , C. and Buckley , J. pp. 151 – 156 .
   Google Scholar
• Carretta , T. R. , Perry , D. C. and Ree , M. J. 1996 . Prediction of situational awareness in F-15 pilots . International Journal of Aviation Psychology , 6 ( 1 ) : 21 – 41 .
   PubMed Web of Science ®Google Scholar
• Dekker , S. and Hollnagel , E. 2004 . Human factors and folk models . Cognition, Technology, and Work , 6 : 79 – 86 .
   Google Scholar
• Dekker , S. W. A. and Woods , D. D. 2002 . MABA-MABA or abracadabra? Progress on human–automation coordination . Cognition, Technology, and Work , 4 : 240 – 244 .
   Google Scholar
• Doane , S. M. , Sohn , Y. W. and Jodlowski , M. T. 2004 . Pilot ability to anticipate the consequences of flight actions as a function of expertise . Human Factors , 46 ( 1 ) : 92 – 103 .
   PubMed Web of Science ®Google Scholar
• Durso , F. T. , Bleckley , M. K. and Dattel , A. R. 2006 . Does SA add to the validity of cognitive tests? . Human Factors , 48 : 721 – 733 .
   PubMed Web of Science ®Google Scholar
• Durso , F. T. , Truitt , T. , Hackworth , C. A. , Crutchfield , J. , Nicolic , D. Moertl , P. M. 1995 . “ Expertise and chess: A pilot study comparing situation awareness methodologies ” . In Experimental analysis and measurement of situation awareness , Edited by: Garland , D. J. and Endsley , M. R. 295 – 304 . Daytona Beach, FL : Embry-Riddle Aeronautical University Press .
   Google Scholar
• Durso , F. T. and Gronlund , S. D. 1999 . “ Situation awareness ” . In Handbook of applied cognition , Edited by: Durso , F. T. , Nickerson , R. S. , Schvaneveldt , R. W. , Dumais , S. T. , Lindsay , D. S. and Chi , M. T. H. 283 – 314 . Chichester, , UK : Wiley .
   Google Scholar
• Durso , F. T. , Hackworth , C. A. , Truitt , T. , Crutchfield , J. and Manning , C. A. 1998 . Situation awareness as a predictor of performance in en route air traffic controllers . Air Traffic Quarterly , 6 ( 1 ) : 1 – 20 .
   Google Scholar
• Durso , F. T. , Rawson , K. A. and Girotto , S. 2007 . “ Comprehension and situation awareness ” . In Handbook of applied cognition , 2nd , Edited by: Durso , F. T. , Nickerson , R. S. , Dumais , S. , Lewandowsky , S. and Perfect , T. J. 163 – 194 . Hoboken, NJ : Wiley .
   Google Scholar
• Einhorn , H. J. and Hogarth , R. M. 1978 . Confidence in judgment: Persistence of the illusion of validity . Psychological Review , 85 : 395 – 416 .
   Web of Science ®Google Scholar
• Ekstrom , R. B. , French , J. W. , Harman , H. H. and Dermen , D. 1976a . Kit of factor-referenced cognitive tests , Princeton, NJ : Educational Testing Service .
   Google Scholar
• Ekstrom , R. B. , French , J. W. , Harman , H. H. and Dermen , D. 1976b . Manual for kit of factor-referenced cognitive tests , Princeton, NJ : Educational Testing Service .
   Google Scholar
• Endsley , M. R. Situation awareness global assessment technique (SAGAT) . Proceedings of the IEEE National Aerospace Electronic Conference, 3 . pp. 789 – 795 .
   Google Scholar
• Endsley , M. R. 1993 . A survey of situation awareness requirements in air-to-air combat fighters . International Journal of Aviation Psychology , 3 ( 2 ) : 157 – 168 .
   Google Scholar
• Endsley , M. R. 1995a . Measurement of situation awareness in dynamic systems . Human Factors , 37 : 65 – 84 .
   Web of Science ®Google Scholar
• Endsley , M. R. 1995b . “ A taxonomy of situation awareness errors ” . In Human factors in aviation operations , Edited by: Fuller , R. , Johnston , N. and McDonald , N. 287 – 292 . Aldershot, , UK : Avebury Aviation .
   Google Scholar
• Endsley , M. R. 1995c . Toward a theory of situation awareness in dynamic systems . Human Factors , 37 : 32 – 64 .
   Web of Science ®Google Scholar
• Endsley , M. R. A comparative analysis of SAGAT and SART for evaluations of situation awareness . Proceedings of the Human Factors and Ergonomics Society 42nd annual meeting . Santa Monica, CA. pp. 82 – 86 . Human Factors and Ergonomics Society .
   Google Scholar
• Endsley , M. R. 2000 . “ Direct measurement of situation awareness: Validity and use of SAGAT ” . In Situation awareness analysis and measurement , Edited by: Endsley , M. R. and Garland , D. J. 147 – 173 . Mahwah, NJ : Lawrence Erlbaum Associates, Inc .
   Google Scholar
• Endsley , M. R. and Bolstad , C. A. 1994 . Individual differences in pilot situation awareness . International Journal of Aviation Psychology , 4 ( 3 ) : 241 – 264 .
   Google Scholar
• Endsley , M. , Bolté , B. and Jones , D. G. 2003 . Designing for situation awareness: An approach to user-centered design , London, , England : Taylor & Francis .
   Google Scholar
• Endsley , M. R. , Sollenberger , R. and Stein , E. Situation awareness: A comparison of measures . Paper presented at the Human Performance, Situation Awareness and Automation: User Centered Design for the New Millennium Conference . Savannah, GA. October .
   Google Scholar
• Ericsson , K. A. and Kintsch , W. 1995 . Long-term working memory . Psychological Review , 102 ( 2 ) : 211 – 245 .
   PubMed Web of Science ®Google Scholar
• Federal Aviation Administration . 2009 . FAA's NextGen implementation plan , Washington, DC : Author .
   Google Scholar
• Fischoff , B. and MacGregor , D. 1982 . Subjective confidence in forecasts . Journal of Forecasting , 1 : 155 – 172 .
   Web of Science ®Google Scholar
• Hartel , C. , Smith , K. A. and Prince , C. Defining aircrew coordination: Searching mishaps for meaning . Paper presented at the Sixth International Symposium on Aviation Psychology . Columbus, OH. April .
   Google Scholar
• Hersen , M. , Hilsenroth , M. J. and Segal , D. L. 2004 . Comprehensive handbook of psychological assessment: Personality assessment , Vol. 2 , Hoboken, NJ : Wiley .
   Google Scholar
• Hogg , D. N. , Folleso , K. , Strand-Volden , F. and Torralba , B. 1995 . Development of a situation awareness measure to evaluate advanced alarm systems in nuclear power plan control rooms . Ergonomics , 38 ( 11 ) : 2394 – 2413 .
   Web of Science ®Google Scholar
• Hutchins , E. 1995 . How a cockpit remembers its speeds . Cognitive Science , 19 : 265 – 288 .
   Web of Science ®Google Scholar
• Jackson , L. , Chapman , P. and Crundall , D. 2009 . What happens next? Predicting other road users' behaviour as a function of driving experience and processing time . Ergonomics , 52 : 154 – 164 .
   PubMed Web of Science ®Google Scholar
• Jacobsen , A. , Chen , S. and Wiedemann , J. Vertical situation awareness display . Paper presented at the Royal Aeronautical Society Conference on Situation Awareness on the Flight Deck: Avionics and systems . London, UK. March .
   Google Scholar
• Jensen , R. S. 1982 . Pilot judgment training and evaluation . Human Factors , 24 : 61 – 73 .
   Web of Science ®Google Scholar
• Joint Planning and Development Office . 2008 . Integrated work plan for the next generation air transportation system (IWP) , Washington, DC : Author .
   Google Scholar
• Jones , D. G. and Endsley , M. R. 1996 . Sources of situation awareness errors in aviation . Aviation, Space, and Environmental Medicine , 67 ( 6 ) : 507 – 512 .
   PubMed Web of Science ®Google Scholar
• Kahneman , D. and Tversky , A. 1973 . On the psychology of prediction . Psychological Review , 80 : 237 – 251 .
   Web of Science ®Google Scholar
• Koehler , D. J. , Brenner , L. and Griffin , D. 2002 . “ The calibration of expert judgment: Heuristics and biases beyond the laboratory ” . In Heuristics and biases: The psychology of intuitive judgment , Edited by: Gilovich , T. , Griffin , D. and Kahneman , D. 686 – 715 . Cambridge, , UK : Cambridge University Press .
   Google Scholar
• Lichacz , F. M. J. 2008 . Augmenting understanding of the relationship between situation awareness and confidence using calibration analysis . Ergonomics , 51 : 1489 – 1502 .
   PubMed Web of Science ®Google Scholar
• Lichacz , F. M. J. , Cain , B. and Patel , S. Calibration of confidence in situation awareness queries . Proceedings of the Human Factors and Ergonomics Society 47th annual meeting . Santa Monica, CA. pp. 222 – 226 . Human Factors and Ergonomics Society .
   Google Scholar
• Lichtenstein , S. , Fischhoff , B. and Phillips , L. D. 1982 . “ Calibration of probabilities: The state of the art to 1980 ” . In Judgement under uncertainty: Heuristics and biases , Edited by: Kahneman , D. , Slovic , P. and Tversky , A. 3 – 20 . New York, NY : Cambridge University Press .
   Google Scholar
• Lichtenstein , S. and Fischoff , B. 1977 . Do those who know more also know more about much they know? . Organizational Behavior and Human Performance , 20 : 159 – 183 .
   Web of Science ®Google Scholar
• Ma , R. and Kaber , D. B. 2007 . Situation awareness and driving performance in a simulated navigation task . Ergonomics , 50 : 1351 – 1364 .
   PubMed Web of Science ®Google Scholar
• O'Brien , K. S. and O'Hare , D. O. 2007 . Situational awareness ability and cognitive skills training in a complex real-world task . Ergonomics , 50 ( 7 ) : 1064 – 1091 .
   PubMed Web of Science ®Google Scholar
• Orasanu , J. and Fischer , U. 1997 . “ Finding decisions in natural environments: The view from the cockpit ” . In Naturalistic decision making , Edited by: Zsambok , C. E. and Klein , G. 343 – 357 . Mahwah, NJ : Lawrence Erlbaum Associates, Inc .
   Google Scholar
• Pew , R. W. 2000 . “ The state of situation awareness measurement: Heading toward the next century ” . In Situation awareness analysis and measurement , Edited by: Endsley , M. R. and Garland , D. J. 33 – 47 . Mahwah, NJ : Lawrence Erlbaum Associates, Inc .
   Google Scholar
• Roscoe , S. N. and Corl , L. 1987 . “ Wondrous original method for basic airmanship testing ” . In Proceedings of the Fourth International Symposium on Aviation Psychology , Edited by: Jensen , R. S. 493 – 499 . Columbus, OH : Ohio State University, Department of Aviation .
   Google Scholar
• Roth , E. M. and Woods , D. D. 1988 . Aiding human performance: I. Cognitive analysis . Le Travail Humain , 51 : 139 – 171 .
   Web of Science ®Google Scholar
• Rowe , R. M. and McKenna , F. P. 2001 . Skilled anticipation in real-world tasks: Measurement of attentional demands in the domain of tennis . Journal of Experimental Psychology: Applied , 7 ( 1 ) : 60 – 67 .
   PubMed Web of Science ®Google Scholar
• Salmon , P. M. , Stanton , N. A. , Walker , G. H. , Jenkins , D. , Baber , C. and McMaster , R. 2008 . Representing situation awareness in collaborative systems: A case study in the energy distribution domain . Ergonomics , 51 : 367 – 384 .
   PubMed Web of Science ®Google Scholar
• Sarter , N. B. and Woods , D. D. 1991 . Situation awareness: A critical but ill-defined phenomenon . International Journal of Aviation Psychology , 1 ( 1 ) : 45 – 57 .
   Google Scholar
• Sohn , Y. W. and Doane , S. M. 2003 . Roles of working memory capacity and long-term working memory skill in complex task performance . Memory & Cognition , 31 ( 3 ) : 458 – 466 .
   PubMed Web of Science ®Google Scholar
• Sohn , Y. W. and Doane , S. M. 2004 . Memory processes of flight situation awareness: Interactive roles of working memory capacity, long-term working memory, and expertise . Human Factors , 46 ( 3 ) : 461 – 475 .
   PubMed Web of Science ®Google Scholar
• Stanton , N. A. , Stewart , R. , Harris , D. , Houghton , R. J. , Baber , C. McMaster , R. 2006 . Distributed situation awareness in dynamic systems: Theoretical development and application of an ergonomics methodology . Ergonomics , 49 : 1288 – 1311 .
   PubMed Web of Science ®Google Scholar
• Sulistyawati , K. , Wickens , C. D. and Chui , Y. P. 2009 . Exploring the concept of team situation awareness in a simulated air combat environment . Journal of Cognitive Engineering and Decision Making , 3 : 309 – 330 .
   Google Scholar
• Taleb , N. N. 2007 . The black swan: The impact of the highly improbable , New York, NY : Random House .
   Google Scholar
• Tetlock , P. E. 2005 . Expert political judgment: How good is it? How can we know? , Princeton, NJ : Princeton University Press .
   Google Scholar
• van Breda , L. 2000 . Capability prediction: An effective way to improve navigational performance . Journal of Navigation , 53 : 343 – 354 .
   Web of Science ®Google Scholar
• Weiner , E. L. 1977 . Controlled flight into terrain: System induced accidents . Human Factors , 19 : 171 – 181 .
   Web of Science ®Google Scholar
• Wickens , C. D. 2008 . Situation awareness: Review of Mica Endsley's 1995 articles on situation awareness theory and measurement . Human Factors , 50 : 397 – 403 .
   PubMed Web of Science ®Google Scholar
• Wickens , C. D. , Gempler , K. and Morphew , M. E. 2000 . Workload and reliability of predictor displays in aircraft traffic avoidance . Transportation Human Factors , 2 ( 2 ) : 99 – 126 .
   Google Scholar
• Wickens , C. D. and Hollands , J. 2000 . Engineering psychology and human performance , 3rd , New York, NY : Prentice Hall .
   Google Scholar
• Wickens , C. D. , Mavor , A. S. , Parasuraman , R. and McGee , J. P. 1998 . The future of air traffic control: Human operators and automation , Washington, DC : National Academy Press .
   Google Scholar
• Wiegmann , D. and Goh , J. Visual flight rules (VFR) flight into adverse weather: An empirical investigation of factors affecting pilot decision making . Tech. Rep. No. ARL-00-15/FAA-00-8 . 2000 . Savoy, IL: Aviation Research Lab Institute of Aviation
   Google Scholar
• Woodhouse , R. and Woodhouse , R. A. 1995 . “ Navigation errors in relation to controlled flight into terrain (CFIT) accidents ” . In Proceedings of the 8th International Symposium on Aviation Psychology , Edited by: Jensen , R. S. and Rackovan , L. A. 1403 – 1404 . Columbus, OH : Ohio State University Press .
   Google Scholar
• Xu , X. , Wickens , C. D. and Rantanen , E. M. 2007 . Effects of conflict alerting system reliability and task difficulty on pilots' conflict detection with cockpit display of traffic information . Ergonomics , 50 ( 1 ) : 112 – 130 .
   PubMed Web of Science ®Google Scholar