Unmanned aerial systems (UAS) operators’ accuracy and confidence of decisions: Professional pilots or video game players?

References

• Adidam, P. T., & Bingi, R. P. (2000). The importance of decision confidence to strategy outcomes. The Journal of Applied Business Research, 16, 35–50.
   Google Scholar
• Atinaja-Faller, J., Quigley, L., Banichoo, S., Tsveybel, V., & Quigley, M. (2010, November). Simulation training effect on confidence levels of senior clinical decision-making nursing students in managing an acute event. Paper presented to International Conference of Education, Research and Innovation, Madrid.
   Google Scholar
• Barrick, M. R., & Mount, M. K. (1991). The big five personality dimensions and job performance: A meta-analysis. Personnel Psychology, 44, 1–26.10.1111/peps.1991.44.issue-1
   Web of Science ®Google Scholar
• Bingi, R. P., Kasper, G. (1995, March). A model of the effect of decision aids on decision confidence and decision success. Paper presented to SouthWest DSI (SWFAD), Houston.
   Google Scholar
• Boot, W. R., Kramer, A. F., Simons, D. J., Fabiani, M., & Gratton, G. (2008). The effects of video game playing on attention, memory, and executive control. Acta Psychologica, 129, 387–398.10.1016/j.actpsy.2008.09.005
   PubMed Web of Science ®Google Scholar
• Budner, S. (1961). Intolerance of ambiguity as a personality variable. Journal of Personality, 30, 29–50.
   Web of Science ®Google Scholar
• Bureau d’Enquêtes et d’Analyses (BEA). (2012). Final report: On the accident on 1st June 2009 to the Airbus A330-203 registered F-GZCP operated by Air France flight AF 447 Rio de Janeiro – Paris. Bureau d’Enquêtes et d’Analyses pour la sécurité de l’aviation civile, Ministère de l’Écologie, du Développement durable, des Transports et du Logement, 27th July. Retrieved from https://www.bea.aero/docspa/2009/f-cp090601.en/pdf/f-cp090601.en.pdf
   Google Scholar
• Burke, E. (1995). Pilot selection II: Where do we go from here? In R. S. Jenson (Ed.), Proceedings of the Eighth International Symposium on Aviation Psychology (pp. 1347–1353). Columbus, OH: The Ohio State University.
   Google Scholar
• Carretta, T. R. (2013). Predictive validity of pilot selection instruments for remotely piloted aircraft training outcome. Aviation, Space, and Environmental Medicine, 84, 47–53.10.3357/ASEM.3441.2013
   PubMed Web of Science ®Google Scholar
• Carretta, T. R., Rose, M. R., & Barron, L. G. (2015). Predictive validity of UAS/RPA sensor operator training qualification measures. The International Journal of Aviation Psychology, 25, 3–13.10.1080/10508414.2015.981487
   Web of Science ®Google Scholar
• Castel, A. D., Pratt, J., & Drummond, E. (2005). The effects of action video game experience on the time course of inhibition of return and the efficiency of visual search. Acta Psychologica, 119, 217–230.10.1016/j.actpsy.2005.02.004
   PubMed Web of Science ®Google Scholar
• Chandler, C. C. (1994). Studying related pictures can reduce accuracy, but increase confidence, in a modified recognition test. Memory & Cognition, 22, 273–280.10.3758/BF03200854
   PubMed Web of Science ®Google Scholar
• Chappelle, W., McDonald, K., Heaton, J.N., Thompson, W., & Haynes, J. (2012). Neuropsychological and personality attributes distinguishing high vs. low training performance of MQ-1B pilot trainees. Paper presented to Aerospace Medicine Association Annual Conference, Atlanta, GA.
   Google Scholar
• Chidester, T., Helmreich, R., Gregorich, S., & Geis, C. (1991). Pilot personality and crew coordination: Implications for training and selection. The International Journal of Aviation Psychology, 1, 25–44.10.1207/s15327108ijap0101_3
   PubMedGoogle Scholar
• Chidester, T., Kanki, B., Foushee, H., Dickinson, C., & Bowles, S. (1990). Personality factors in flight operations (Vol. 1): Leader characteristics and crew performance in a full-mission air transport simulation (NASA Technical Memorandum-102259). Moffett Field: CAL NASA Ames Research Centre.
   Google Scholar
• Chung, J., & Monroe, G. S. (2000). The effects of experience and task difficulty on accuracy and confidence assessments of auditors. Accounting and Finance, 40, 135–151.10.1111/acfi.2000.40.issue-2
   Google Scholar
• Civil Aviation Authority. (2010). Lasors 2010. Norwich: The Stationary Office.
   Google Scholar
• Civil Aviation Authority. (2012). CAP722 unmanned aircraft system operations in UK airspace – guidance. Norwich: The Stationary Office.
   Google Scholar
• Civil Aviation Authority. (2013). Monitoring matters: Guidance on the development of pilot monitoring skills (CAA Paper 2013/02). West Sussex: Author. Retrieved from https://publicapps.caa.co.uk/docs/33/9323-CAA-Monitoring%20Matters%202nd%20Edition%20April%202013.pdf
   Google Scholar
• Civil Aviation Authority. (2016). CAP1377 ATM automation: Guidance on human-technology integration. West Sussex: Author.
   Google Scholar
• Costa, P. T., & McCrae, R. R. (1992). Four ways five factors are basic. Personality and Individual Differences, 13, 653–665.10.1016/0191-8869(92)90236-I
   Web of Science ®Google Scholar
• Cring, E. A., & Lenfestey, A. G. (2009). Architecting human operator trust in automation to improve system effectiveness in multiple Unmanned Aerial Vehicle (UAV) control (AFIT/GSE/ENV/09-M06). Wright-Patterson AFB, OH: Air Force Institute of Technology.
   Google Scholar
• Cummings, M. L. (2004). Automation bias in intelligent time critical decision support systems. Paper presented to AIAA 1st Intelligent Systems Technical Conference, Chicago, IL.
   Google Scholar
• Department of Defense. (2007). Unmanned systems roadmap 2007–2032 (see AD No. ADA475002). Washington, DC: Defense Technical Information Center.
   Google Scholar
• DePaulo, M. B., & Pfeifer, L. R. (2006). On-the-job experience and skill at detecting deception. Journal of Applied Social Psychology, 16, 249–267.
   Google Scholar
• de Vries, P., Midden, C., & Bouwhuis, D. (2003). The effects of errors on system trust, self-confidence, and the allocation of control in route planning. International Journal of Human-Computer Studies, 58, 719–735.10.1016/S1071-5819(03)00039-9
   Web of Science ®Google Scholar
• Dijkstra, J. J., Liebrand, W. B., & Timminga, E. (1998). Persuasiveness of expert systems. Behaviour & Information Technology, 17, 155–163.10.1080/014492998119526
   Web of Science ®Google Scholar
• Dorval, M., & Pepin, M. (1986). Effect of playing a video game on a measure of spatial visualization. Perceptual Motor Skills, 62, 159–162.10.2466/pms.1986.62.1.159
   PubMed Web of Science ®Google Scholar
• Drury, J. L., & Scott, S. D. (2008). Awareness in unmanned aerial vehicle operations. The International C2 Journal, 2, 1–10.
   Google Scholar
• Dzindolet, M. T., Beck, H. P., Pierce, L. G., & Dawe, L. A. (2001). A framework of automation use (Report No. ARL-TR-2412 (Aberdeen Proving Ground)). Adelphi, MD: Army Research Laboratory.10.1037/e447142006-001
   Google Scholar
• Fiske, S. T., & Taylor, S. E. (1991). Social cognition. New York, NY: McGraw-Hill.
   Google Scholar
• Funk, K., Lyall, B., Wilson, J., Vint, R., Niemczyk, M., Suroteguh, C., & Owen, G. (1999). Flight deck automation issues. The International Journal of Aviation Psychology, 9, 109–123.10.1207/s15327108ijap0902_2
   Web of Science ®Google Scholar
• Ghosh, D., & Ray, M. R. (1997). Risk, ambiguity, and decision choice: Some additional evidence. Decision Sciences, 28, 81–104.10.1111/deci.1997.28.issue-1
   Web of Science ®Google Scholar
• Glussich, D., & Histon, J.M. (2010). Human/automation interaction accidents: Implications for UAS operations. Paper presented to Digital Avionics Systems Conference (DASC), Salt Lake City, UT.
   Google Scholar
• Gopher, D., Weil, M., & Bareket, T. (1994). Transfer of skill from a computer game trainer to flight. Human Factors, 36, 387–405.
   Web of Science ®Google Scholar
• Green, C. S., & Bavelier, D. (2007). Action-video-game experience alters the spatial resolution of vision. Psychological Science, 18, 88–94.10.1111/j.1467-9280.2007.01853.x
   PubMed Web of Science ®Google Scholar
• Griffith, J. L., Voloschin, P., Gibb, G. D., & Bailey, J. R. (1983). Differences in eye-hand motor coordination of video-game users and non-users. Perceptual and Motor Skills, 57, 155–158.10.2466/pms.1983.57.1.155
   PubMed Web of Science ®Google Scholar
• Kebbell, M. R., Wagstaff, G. F., & Covey, J. A. (1996). The influence of item difficulty on the relationship between eyewitness confidence and accuracy. British Journal of Psychology, 87, 653–662.10.1111/bjop.1996.87.issue-4
   Web of Science ®Google Scholar
• Krueger, N., & Dickson, P. R. (1994). How believing in ourselves increases risk taking: Perceived self-efficacy and opportunity recognition. Decision Sciences, 25, 385–400.10.1111/deci.1994.25.issue-3
   Web of Science ®Google Scholar
• Latane, B., & Darley, J. M. (1970). The unresponsive bystander: Why doesn’t he help? New York, NY: Appleton-Century-Crofts.
   Google Scholar
• Lee, J. D., & Moray, N. (1992). Trust, control strategies and allocation of function in human-machine systems. Ergonomics, 35, 1243–1270.10.1080/00140139208967392
   PubMed Web of Science ®Google Scholar
• Lee, J. D., & See, K. A. (2004). Trust in automation: Designing for appropriate reliance. Human Factors: The Journal of the Human Factors and Ergonomics Society, 46, 50–80.10.1518/hfes.46.1.50.30392
   PubMed Web of Science ®Google Scholar
• Lyons, J. B., & Stokes, C. K. (2011). Human–human reliance in the context of automation. Human Factors, 54, 112–121.10.1177/0018720811427034
   Web of Science ®Google Scholar
• Maddux, J. E., & Volkmann, J. (2010). Self-efficacy. In R. H. Hoyle (Ed.), Handbook of personality and self-regulation. Oxford: Wiley-Blackwell.
   Google Scholar
• Madsen, M., & Gregor, S. (2000). Measuring human-computer trust. Gladstone: Central Queensland University.
   Google Scholar
• Martins, E., & Soares, M. (2012). Automation under suspicion: Case flight AF-477 Air France. Work: A Journal of Prevention, Assessment and Rehabilitation, 41, 222–224.
   Web of Science ®Google Scholar
• McCrae, R. R., & Costa, P. T. (1992). Discriminant validity of NEO-PIR facet scales. Educational and Psychological Measurement, 52, 229–237.10.1177/001316449205200128
   Web of Science ®Google Scholar
• McKinley, A. R., & McIntire, L. K. (2009). Operator selection for unmanned aerial vehicle operators: A comparison of video game players and manned aircraft pilots (AFRL-RH-WP-TR-2010-0057). Air Force Research Laboratory. Retrieved from http://www.dtic.mil
   Google Scholar
• Michie, S. (2002). Causes and management of stress at work. Occupational and Environmental Medicine, 59, 67–72.10.1136/oem.59.1.67
   PubMed Web of Science ®Google Scholar
• Mosier, K. L., & Skitka, L. J. (1996). Human decision makers and automated decision aids: Made for each other? In R. Parasuraman & M. Mouloua (Eds.), Automation and human performance: Theory and application (pp. 201–220). Mahwah, NJ: Erlbaum.
   Google Scholar
• Mosier, K. L., Palmer, E. A., & Degani, A. (1992). Electronic checklists: Implications for decision-making. Paper presented to Human Factors Society 36th Annual Meeting, Human Factors Society, Atlanta, GA.
   Google Scholar
• Muir, B. M. (1994). Trust in automation: Part II. Experimental studies of trust and human intervention in a process control stimulation. Ergonomics, 39, 429–460.
   Web of Science ®Google Scholar
• Murnaw, R. J., Sarter, N. B., & Wickens, C. D. (2001). Analysis of pilots’ monitoring and performance on an automated flight deck, 11th International Symposium on Aviation Psychology. Columbus, OH: The Ohio State University.
   Google Scholar
• National Transportation Safety Board. (1973). Eastern Airlines L-1011: Miami, Florida, 20 December 1921 (NTSB Report-ARR-73-14). Washington, DC: Author.
   Google Scholar
• Parasuraman, R., Cosenzo, K. A., & de Visser, E. (2009). Adaptive automation for human supervision of multiple uninhabited vehicles: Effects on change detection, situation awareness, and mental workload. Military Psychology, 21, 270–297.
   Web of Science ®Google Scholar
• Parasuraman, R., & Manzey, D. H. (2010). Complacency and bias in human use of automation: An attentional integration. Human Factors, 52, 381–410.10.1177/0018720810376055
   PubMed Web of Science ®Google Scholar
• Parasuraman, R., & Riley, V. (1997). Humans and automation: Use, misuse, disuse, abuse. Human Factors: The Journal of the Human Factors and Ergonomics Society, 39, 230–253.10.1518/001872097778543886
   Web of Science ®Google Scholar
• Parasuruman, R., Molloy, R., & Singh, I. L. (2009). Performance consequences of automation-induced ‘complacency’. International Journal of Aviation Psychology, 3(1), 1–23.
   Google Scholar
• Payne, F., Harvey, K., Jessopp, L., Plummer, S., Tylee, A., & Gournay, K. (2002). Knowledge, confidence and attitudes towards mental health of nurses working in NHS Direct and the effects of training. Journal of Advanced Nursing, 40, 549–559.10.1046/j.1365-2648.2002.02413.x
   PubMed Web of Science ®Google Scholar
• Perkins, L., Miller, J., Hashemi, A., & Burns, G. (2010). Designing for human centred systems: Situational risk as a factor of trust in automation. Proceedings of the 54th Annual Meeting of the Human Factors and Ergonomics Society, 27 September–1 October. San Francisco, CA.
   Google Scholar
• Piedmont, R. L., & Weinstein, H. P. (1993). A psychometric evaluation of the new NEO–PIR facet scales for agreeableness and conscientiousness. Journal of Personality Assessment, 60, 302–318.10.1207/s15327752jpa6002_8
   PubMed Web of Science ®Google Scholar
• Prinzel, L. J., DeVries, H., Freeman, F. G., & Mikulka, P. (2001). Examination of automation-induced complacency and individual differences variates (see technology memorandum No. 211413). Hampton, VA: NASA Langley Research Center.
   Google Scholar
• Riley, V. (1994). Human use of automation (Unpublished doctoral dissertation). University of Minnesota, USA.
   Google Scholar
• Riley, V., Lyall, E., & Weiner, E. (1993). Analytic methods for flight-deck automation design and evaluation, phase two report: Pilot use of automation (Federal Aviation Administrator Contractor Report). Minneapolis, MN: Honeywell Technology Centre.
   Google Scholar
• Roets, A., & Van Hiel, A. (2007). Separating ability from need: Clarifying the dimensional structure of the need for closure scale. Personality and Social Psychology Bulletin, 33, 266–280.10.1177/0146167206294744
   PubMed Web of Science ®Google Scholar
• Rose, M. R., Barron, L. G., Carretta, T. R., Arnold, R. D., & Howse, W. R. (2014). Early identification of unmanned aircraft pilots using measures of personality and aptitude. International Journal of Aviation Psychology, 24, 35–52.
   Web of Science ®Google Scholar
• Ross, J. M., Szalma, J. L., Hancock, P. A., Barnett, J. S., & Taylor, G. (2008). The effect of automation reliability on user automation trust and reliance in a search-and-rescue scenario (pp. 1340–1344). Paper presented to Humans Factors and Ergonomics Society 52nd Annual Meeting, New York, NY.
   Google Scholar
• Ruff, H. A., Calhoun, G. L., Draper, M. H., Fontejon, J. V., & Guilfoos, B. J. (2004). Exploring automation issues in supervisory control of multiple UAVs. Proceedings of the Human Performance, Situation Awareness and Automation Technology Conference, 218–222).
   Google Scholar
• Sanchez, J., Rogers, W. A., Fisk, A. D., & Rovira, E. (2014). Understanding reliance on automation: Effects of error type, error distribution, age and experience. Theoretical Issues in Ergonomics Science, 15, 134–160.10.1080/1463922X.2011.611269
   PubMedGoogle Scholar
• Sarter, N. B., & Woods, D. D. (1994). Pilot interaction with cockpit automation II: An experimental study of pilots’ model and awareness of the flight management system. The International Journal of Aviation Psychology, 4(1), 1–28.10.1207/s15327108ijap0401_1
   Google Scholar
• Sarter, N. B., & Woods, D. D. (1995). How in the world did we ever get into that mode? Mode error and awareness in supervisory control. Human Factors: The Journal of the Human Factors and Ergonomics Society, 37, 5–19.10.1518/001872095779049516
   Web of Science ®Google Scholar
• Shaw, R. B. (1997). Trust is the balance: Building successful organizations on results, integrity, and concern. San Francisco, CA: Jossey-Bass.
   Google Scholar
• Siem, F. M., & Murray, B. S. (1994). Personality factors affecting pilot combat performance: A preliminary investigation. Aviation, Space, and Environmental Medicine, 65, A45–A48.
   PubMed Web of Science ®Google Scholar
• Skitka, L. J., Mosier, K., & Burdick, M. D. (2000). Accountability and automation bias. International Journal of Human-Computer Studies, 52, 701–717.10.1006/ijhc.1999.0349
   Web of Science ®Google Scholar
• Szalma, J. L., & Taylor, G. S. (2011). Individual differences in response to automation: The five factor model of personality. Journal of Experimental Psychology: Applied, 17, 71–96.
   PubMed Web of Science ®Google Scholar
• Tajfel, H., & Turner, J. C. (1986). The social identity theory of intergroup behaviour. In S. Worchel & W. G. Austin (Eds.), Psychology of intergroup relations (2nd ed.). Chicago, IL: Nelson Hall.
   Google Scholar
• Toma, C., & Butera, F. (2009). Hidden profiles and concealed information: Strategic information sharing and use in group decision making. Personality and Social Psychology Bulletin, 35, 793–806.10.1177/0146167209333176
   PubMed Web of Science ®Google Scholar
• Tvaryanas, A. P., Thompson, B. T., & Constable, S. H. (2005). U.S. military unmanned aerial vehicle mishaps: Assessment of the role of human factors using HFACS (Technical Report). Brooks City-Base, TX: USAF Human Performance Directorate.
   Google Scholar
• Tversky, A., & Kahneman, D. (1974). Judgment under uncertainty: Heuristics and biases. Science, 185, 1124–1131.10.1126/science.185.4157.1124
   PubMed Web of Science ®Google Scholar
• Walliser, J. C. (2011). Trust in automated systems: The effect of automation level on trust calibration. Naval Postgraduate School. Retrieved July 2011, from, http://edocs.nps.edu/npspubs/scholarly/theses/2011/June/11Jun_Walliser.pdf
   Google Scholar
• Webster, M., Cameron, N., Fisher, M., & Jump, M. (2014). Generating certification evidence for autonomous unmanned aircraft using model checking and simulation. Journal of Aerospace Information Systems, 11, 258–279.10.2514/1.I010096
   Web of Science ®Google Scholar
• Wheatcroft, J. M., & Ellison, L. E. (2012). Evidence in court: Witness preparation and cross-examination style effects on adult witness accuracy. Behavioral Sciences & the Law, 30, 821–840.10.1002/bsl.2031
   PubMed Web of Science ®Google Scholar
• Wheatcroft, J. M., & Woods, S. (2010). Effectiveness of witness preparation and cross-examination non-directive and directive styles on witness accuracy and confidence. International Journal of Evidence and Proof, 14, 189–209.
   Google Scholar
• Wheatcroft, J. M., Wagstaff, G. F., & Kebbell, M. R. (2004). The influence of courtroom questioning style on actual and perceived eyewitness confidence and accuracy. Legal & Criminological Psychology, 9, 83–101.10.1348/135532504322776870
   Web of Science ®Google Scholar
• Wheatcroft, J. M., Wagstaff, G. F., & Manarin, B. (2015, April 3). The influence of delay and item difficulty on eyewitness confidence and accuracy. International Journal of Humanities and Social Science Research, 1, 1–9
   Google Scholar
• Will, R. P. (1991). True and false dependence on technology: Evaluation with an expert system. Computers in Human Behavior, 7, 171.10.1016/0747-5632(91)90006-M
   Web of Science ®Google Scholar
• Woods, D. D., & Sarter, N. B. (2000). Learning from automation surprises and going sour accidents. In N. Sarter & R. Amalberti (Eds.), Cognitive engineering in the aviation domain (pp. 327–354). Hillsdale, NJ: Erlbaum.
   Google Scholar
• Yeung, N., & Summerfield, C. (2012). Metacognition in human decision-making: Confidence and error monitoring. Philosophical Transactions of the Royal Society B: Biological Sciences, 367, 1310–1321.10.1098/rstb.2011.0416
   PubMed Web of Science ®Google Scholar
• Yuji, H. (1996). Computer games and information-processing skills. Perceptual and Motor Skills, 83, 643–647.10.2466/pms.1996.83.2.643
   PubMed Web of Science ®Google Scholar