The impact of alerting designs on air traffic controller’s eye movement patterns and situation awareness

References

• Ahlstrom, U., and F. J. Friedman-Berg. 2006. “Using Eye Movement Activity as a Correlate of Cognitive Workload.” International Journal of Industrial Ergonomics 36 (7): 623–636. doi:10.1016/j.ergon.2006.04.002.
   Web of Science ®Google Scholar
• Ahlstrom, V. 2003a. “An Initial Survey of National Airspace System Auditory Alarm Issues in Air Traffic Control (DOT/FAA-CT-TN03/10).” Accessed 12 March 2018. http://hf.tc.faa.gov/technotes/dot-faa-ct-tn03-10.pdf.
   Google Scholar
• Ahlstrom, V. 2003b. “Auditory Alarms in the Airway Facilities Environment (DOT/FAA-CT-TN04/04).” Accessed 12 March 2018. http://hf.tc.faa.gov/publications/2003-auditory-alarms-in-the-airway-facilities-environment/full_text.pdf.
   Google Scholar
• Ayaz, H., B. Willems, S. Bunce, P. A. Shewokis, K. Izzetoglu, S. Hah, A. Deshmukh, and B. Onaral. 2010. “Cognitive Workload Assessment of Air Traffic Controllers Using Optical Brain Imaging Sensors.” In Advances in Understanding Human Performance: Neuroergonomics, Human Factors Design, and Special Populations, edited by T. Marek, W. Karwowski and V. Rice, 21–32.FL: CRC Press, Taylor & Francis Group.
   Google Scholar
• Baldwin, C. L. 2011. “Verbal Collision Avoidance Messages During Simulated Driving: Perceived Urgency, Alerting Effectiveness and Annoyance.” Ergonomics 54 (4): 328–337. doi:10.1080/00140139.2011.558634.
   PubMed Web of Science ®Google Scholar
• Billings, C. E. 1995. “Situation Awareness Measurement and Analysis: A Commentary.” Paper presented at the International Conference on Experimental Analysis and Measurement of Situation Awareness, Daytona Beach, FL.
   Google Scholar
• Bruder, C., H. Eiszfeldt, P. Maschke, and C. Hasse. 2014. “A Model for Future Aviation: Operators Monitoring Appropriately.” Aviation Psychology and Applied Human Factors 4 (1):13–22. http://dx.doi.org/10.1027/2192-0923/a000051.
   Google Scholar
• Causse, M., J. P. Imbert, L. Giraudet, C. Jouffrais, and S. Tremblay. 2016. “The Role of Cognitive and Perceptual Loads in Inattentional Deafness.” Frontiers in Human Neuroscience 10: 344–355. doi: 10.3389/fnhum.2016.00344.
   PubMed Web of Science ®Google Scholar
• Chang, Y. H., H. H. Yang, and Y. J. Hsiao. 2016. “Human Risk Factors Associated with Pilots in Runway Excursions.” Accident Analysis and Prevention 94: 227–237. doi:10.1016/j.aap.2016.06.007.
   PubMed Web of Science ®Google Scholar
• Dehais, F., M. Causse, F. Vachon, N. Régis, E. Menant, and S. Tremblay. 2014. “Failure to Detect Critical Auditory Alerts in the Cockpit: Evidence for Inattentional Deafness.” Human Factors 56 (4): 631–644. doi:10.1177/0018720813510735.
   PubMed Web of Science ®Google Scholar
• Dekker, S. 2001. “The Re-invention of Human Error.” Human Factors and Aerospace Safety 1 (3): 247–265.
   Google Scholar
• Dekker, S., and E. Hollnagel. 2004. “Human Factors and Folk Models.” Cognition, Technology and Work 6 (2): 79–86. doi:10.1007/s10111-003-0136-9.
   Google Scholar
• Diehl, A. 1991. “The Effectiveness of Training Programs for Preventing Aircrew Error.” In Proceedings of the Sixth International Symposium on Aviation Psychology, edited by R. S. Jensen, Vol. 2, 640–655. Columbus, OH: The Ohio State University.
   Google Scholar
• Dorner, D. 1993. “Wissen, emotionen und handlungsreglation oder die vernunft der gerfuhle.” Zeitschrift fur Psychologie 201: 167–202.
   PubMed Web of Science ®Google Scholar
• Durso, F. T., T. R. Truitt, C. A. Hackworth, J. M. Crutchfield, and C. A. Manning. 1998. “En Route Operational Errors and Situational Awareness.” International Journal of Aviation Psychology 8 (2): 177–194.
   Web of Science ®Google Scholar
• Edworthy, J., and E. Hellier. 2006. “Complex Nonverbal Auditory Signals and Speech Warnings.” In Handbook of warnings, edited by M. S. Wogalter, 199–220. Mahwah, NJ: Lawrence Erlbaum Associates.
   Google Scholar
• Endsley, M. R. 1997. “The Role of Situation Awareness in Naturalistic Decision Making.” In Expertise: Research and Applications. Naturalistic Decision Making, edited by C. E. Zsambok and G. Klein, 269–283. Hillsdale, NJ: Lawrence Erlbaum Associates.
   Google Scholar
• Endsley, M. R. 2015. “Situation Awareness Misconceptions and Misunderstandings.” Journal of Cognitive Engineering and Decision Making 9 (1): 4–32. doi:10.1177/1555343415572631
   Web of Science ®Google Scholar
• Eurocontrol. 2015. “ATM Cost‐Effectiveness (ACE) 2013 Benchmarking Report with 2014–2018 outlook.” https://www.eurocontrol.int/sites/default/files/publication/files/ace-2013-benchmarking-report-final.pdf.
   Google Scholar
• Gartenberg, D., L. Breslow, J. M. McCurry, and J. G. Trafton. 2014. “Situation Awareness Recovery.” Human Factors 56 (4): 710–727. doi:10.1177/0018720813506223.
   PubMed Web of Science ®Google Scholar
• German Federal Bureau of Aircraft Accidents Investigation. 2004. “Investigation Report AX001-1-2/02.” https://skybrary.aero/bookshelf/books/414.pdf.
   Google Scholar
• Gobet, F. 1998. “Expert Memory: A Comparison of Four Theories.” Cognition 66 (2): 115–152. doi:10.1016/s0010-0277(98)00020-1
   PubMed Web of Science ®Google Scholar
• Greve, A., M. C. W. van Rossum, and D. I. Donaldson. 2007. “Investigating the Functional Interaction between Semantic and Episodic Memory: Convergent Behavioral and Electrophysiological Evidence for the Role of Familiarity.” NeuroImage 34 (2): 801–814. doi:10.1016/j.neuroimage.2006.07.043.
   PubMed Web of Science ®Google Scholar
• Ha, C. H., J. H. Kim, S. J. Lee, and P. H. Seong. 2006. “Investigation on Relationship between Information Flow Rate and Mental Workload of Accident Diagnosis Tasks in NPPs.” IEEE Transactions on Nuclear Science 53 (3): 1450–1459. doi:10.1109/tns.2006.874189.
   Web of Science ®Google Scholar
• Henderson, J. M. 2003. “Human Gaze Control During Real-world Scene Perception.” Trends in Cognitive Sciences 7 (11): 498–504. doi:10.1016/j.tics.2003.09.006.
   PubMed Web of Science ®Google Scholar
• Hoffman, J. E., and B. Subramaniam. 1995. “The Role of Visual-attention in Saccadic Eye-Movements.” Perception & Psychophysics 57 (6): 787–795. doi:10.3758/bf03206794.
   PubMed Web of Science ®Google Scholar
• Hollan, J., E. Hutchins, and D. Kirsh. 2000. “Distributed Cognition: Toward a New Foundation for Human-Computer Interaction Research.” ACM Transactions on Computer-Human Interaction (TOCHI) 7 (2): 174–196. doi:10.1145/353485.353487.
   Google Scholar
• Honn, K. A., B. C. Satterfield, P. McCauley, J. L. Caldwell, and H. P. A. Dongen. 2016. “Fatiguing Effect of Multiple Take-offs and Landings in Regional Airline Operations.” Accident Analysis and Prevention 86: 199–208. doi:10.1016/j.aap.2015.10.005.
   PubMed Web of Science ®Google Scholar
• Imbert, J. P., H. M. Hodgetts, R. Parise, F. Vachon, F. Dehais, and S. Tremblay. 2014. “Attentional Costs and Failures in Air Traffic Control Notifications.” Ergonomics 57 (12): 1817–1832. doi:10.1080/00140139.2014.952680.
   PubMed Web of Science ®Google Scholar
• Irish Aviation Authority 2016. Technical Report of Statistical Analysis Safety Net Alerts COOPANS. Dublin, Ireland: Irish Aviation Authority.
   Google Scholar
• Johnson, A., and R. W. Proctor. 2004. Attention: Theory and Practice. London: SAGE Publications.
   Google Scholar
• Jones, D. G., and M. R. Endsley. 1996. “Sources of Situation Awareness Errors in Aviation.” Aviation, Space, and Environmental Medicine 67 (6): 507–512.
   PubMed Web of Science ®Google Scholar
• Kaber, D. B., C. M. Perry, N. Segall, C. K. McClernon, and L. J. Prinzel. 2006. “Situation Awareness Implications of Adaptive Automation for Information Processing in an Air Traffic Control-related Task.” International Journal of Industrial Ergonomics 36 (5): 447–462. doi:10.1016/j.ergon.2006.01.008.
   Web of Science ®Google Scholar
• Kearney, P., and W. C. Li. 2015. “The Efficiency of New Audio Alerts in the COOPANS Eurocat System.” Paper presented at the Proceedings of the Engineering Psychology and Cognitive Ergonomics 12th International Conference, EPCE 2015, Held as Part of HCI International 2015, Los Angeles, CA, USA.
   Google Scholar
• Kearney, P., W. C. Li, and J. J. H. Lin. 2016. “The Impact of Alerting Design on Air Traffic Controllers’ Response to Conflict Detection and Resolution.” International Journal of Industrial Ergonomics 56: 51–58. doi:10.1016/j.ergon.2016.09.002.
   Web of Science ®Google Scholar
• Kotval, X. P., and J. H. Goldberg. 1998. “Eye Movements and Interface Component Grouping: An Evaluation Method.” Paper presented at the Proceedings of the Human Factors and Ergonomics Society 42nd Annual Meeting, Vols. 1 and 2, Santa Monica, CA, USA.
   Google Scholar
• Kowler, E. 2011. “Eye Movements: The Past 25 Years.” Vision Research 51 (13): 1457–1483. doi:10.1016/j.visres.2010.12.014.
   PubMed Web of Science ®Google Scholar
• Kuchar, J. K., and L. C. Yang. 2000. “A Review of Conflict Detection and Resolution Modeling Methods.” IEEE Transactions on Intelligent Transportation Systems 1 (4): 179–189. doi:10.1109/6979.898217.
   Google Scholar
• Langan-Fox, J., J. M. Canty, and M. J. Sankey. 2009. “Human-automation Teams and Adaptable Control for Future Air Traffic Management.” International Journal of Industrial Ergonomics 39 (5): 894–903. doi:10.1016/j.ergon.2009.04.002.
   Web of Science ®Google Scholar
• Laois, L., and M. Giannacourou. 1995. “Perceived Effects of Advanced ATC Functions on Human Activities: Results of a Survey on Controllers and Experts.” Paper presented at the Proceedings of the Eighth International Symposium on Aviation Psychology, Columbus, OH, USA.
   Google Scholar
• Lavine, R. A., J. L. Sibert, M. Gokturk, and B. Dickens. 2002. “Eye-tracking Measures and Human Performance in a Vigilance Task.” Aviation Space and Environmental Medicine 73 (4): 367–372.
   PubMedGoogle Scholar
• Li, W. C., D. Harris, and C. S. Yu. 2008. “Routes to Failure: Analysis of 41 Civil Aviation Accidents from the Republic of China Using the Human Factors Analysis and Classification System.” Accident Analysis and Prevention 40 (2): 426–434. doi:10.1016/j.aap.2007.07.011.
   PubMed Web of Science ®Google Scholar
• Li, W. C., L. W. Li, D. Harris, and Y. L. Hsu. 2014. “The Application of Aeronautical Decision-making Support Systems for Improving Pilots’ Performance in Flight Operations.” Journal of Aeronautics, Astronautics and Aviation 46 (2): 114–123. doi:10.6125/14-0324-789.
   Google Scholar
• Li, W. C., C. S. Yu, G. Braithwaite, and M. Greaves. 2016. “Pilots’ Attention Distributions between Chasing a Moving Target and a Stationary Target.” Aerospace Medicine and Human Performance 87 (12): 989–995. doi:10.3357/amhp.4617.2016.
   PubMed Web of Science ®Google Scholar
• Ltifi, H., C. Kolski, and M. Ben Ayed. 2015. “Combination of Cognitive and HCI Modeling for the Design of KDD-based DSS Used in Dynamic Situations.” Decision Support Systems 78: 51–64. doi:10.1016/j.dss.2015.07.003.
   Web of Science ®Google Scholar
• Lundberg, J. 2015. “Situation Awareness Systems, States and Processes: A Holistic Framework.” Theoretical Issues in Ergonomics Science 16 (5): 447–473. doi:10.1080/1463922X.2015.1008601.
   Web of Science ®Google Scholar
• MacDonald, J. S. P., and N. Lavie. 2011. “Visual Perceptual Load Induces Inattentional Deafness.” Attention, Perception, and Psychophysics 73: 1780–1789. doi:10.3758/s13414-011-0144-4.
   PubMed Web of Science ®Google Scholar
• Moore, K., and L. Gugerty. 2010. “Development of a Novel Measure of Situation Awareness: The Case for Eye Movement Analysis.” Paper presented at the Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Santa Monica, CA, USA.
   Google Scholar
• Newman, R. A., and K. Allendoerfer. 2000. “Assessment of Current and Proposed Audio Alarms in Terminal Air Traffic Control (DOT/FAA/CT-TN00/21).” http://ntl.bts.gov/lib/30000/30900/30987/TN0021.pdf.
   Google Scholar
• Orasanu, J. 2005. “Crew Collaboration in Space: A Naturalistic Decision-making Perspective.” Aviation Space and Environmental Medicine 76 (6): B154–B163.
   PubMedGoogle Scholar
• Orasanu, J., and J. Davison. 2001. “The Role of Risk in Aviation Decision Making: How Pilots Perceive and Manage Flight Risks.” Paper presented at the Proceedings of the Human Factors and Ergonomics Society 45th Annual Meeting, Minneapolis, MN, USA.
   Google Scholar
• Parasuraman, R., T. B. Sheridan, and C. D. Wickens. 2008. “Situation Awareness, Mental Workload, and Trust in Automation: Viable, Empirically Supported Cognitive Engineering Constructs.” Journal of Cognitive Engineering and Decision Making 2 (2): 140–160. doi:10.1518/155534308X284417.
   Google Scholar
• Ratwani, R. M., J. M. McCurry, and J. G. Trafton. 2010. “Single Operator, Multiple Robots: An Eye Movement Based Theoretic Model of Operator Situation Awareness.” Paper presented at the Proceedings of the 5th ACM/IEEE International Conference on Human-robot Interaction, Nara, Japan.
   Google Scholar
• Rognin, L., I. Grimaud, E. Hoffman, and K. Zeghal. 2004. “Assessing the Impact of a New Instruction on Air Traffic Controller Monitoring Tasks.” Paper presented at the Proceedings of the International Conference on Human–Computer Interaction in Aeronautics, Toulouse, France.
   Google Scholar
• Sarter, N. B., and D. D. Woods. 1991. “Situation Awareness: A Critical but Ill-defined Phenomenon.” The International Journal of Aviation Psychology 1 (1): 45–57. doi:10.1207/s15327108ijap0101_4.
   Google Scholar
• Sarter, N. B., and D. D. Woods. 1994. “Pilot Interaction with Cockpit Automation II: An Experimental Study of Pilots’ Model and Awareness of the Flight Management System.” The International Journal of Aviation Psychology 4 (1): 1–28. doi:10.1207/s15327108ijap0401_1.
   Google Scholar
• Schulte-Mecklenbeck, M., A. Kuhberger, and R. Ranyard. 2011. “The Role of Process Data in the Development and Testing of Process Models of Judgment and Decision Making.” Judgment and Decision Making 6 (8): 733–739.
   Web of Science ®Google Scholar
• Schuster, W., and W. Ochieng. 2014. “Performance Requirements of Future Trajectory Prediction and Conflict Detection and Resolution Tools within SESAR and NextGen: Framework for the Derivation and Discussion.” Journal of Air Transport Management 35: 92–101. doi:10.1016/j.jairtraman.2013.11.005.
   Web of Science ®Google Scholar
• Stanton, N. A., R. Stewart, D. Harris, R. J. Houghton, C. Baber, R. McMaster, and D. Green. 2006. “Distributed Situation Awareness in Dynamic Systems: Theoretical Development and Application of an Ergonomics Methodology.” Ergonomics 49 (12–13): 1288–1311. doi:10.1080/00140130600612762.
   PubMed Web of Science ®Google Scholar
• Stanton, N. A., P. M. Salmon, G. H. Walker, E. Salas, and P. A. Hancock. 2017. “State-of-science: Situation Awareness in Individuals, Teams and Systems.” Ergonomics 60 (4): 449–466. doi:10.1080/00140139.2017.1278796.
   PubMed Web of Science ®Google Scholar
• Tobaruela, G., W. Schuster, A. Majumdar, W. Y. Ochieng, L. Martinez, and P. Hendrickx. 2014. “A Method to Estimate Air Traffic Controller Mental Workload Based on Traffic Clearances.” Journal of Air Transport Management 39: 59–71. doi:10.1016/j.jairtraman.2014.04.002.
   Web of Science ®Google Scholar
• Tvaryanas, A. P. 2004. “USAF UAV Mishap Epidemiology, 1997–2003.” Paper presented at the Human Factors of Uninhabited Aerial Vehicles First Annual Workshop, May 24–25, Phoenix, AZ.
   Google Scholar
• Vaitkunas-Kalita, S., S. J. Landry, and H.-S. Yoo. 2011. “Coincidence between the Scientific and Folk Uses of the Term “Situation(al) awareness” in Aviation Incident Reports.” Journal of Cognitive Engineering and Decision Making 5 (4): 378–400. doi:10.1177/1555343411424694.
   Google Scholar
• Vessey, I. 1991. “Cognitive Fit – A Theory-based Analysis of the Graphs versus Tables Literature.” Decision Sciences 22 (2): 219–240. doi:10.1111/j.1540-5915.1991.tb00344.x.
   Web of Science ®Google Scholar
• Wickens, C. D., and J. G. Hollands. 2000. Engineering Psychology and Human Performance. 3rd ed. Upper Saddle River, NJ: Prentice Hall.
   Google Scholar
• Zakay, D. 1993. “The Impact of Time Perception Processes on Decision Making under Time Stress.” In Time Pressure and Stress in Human Judgment and Decision Making, edited by O. Svenson and A. J. Maule, 59–72. New York: Springer.
   Google Scholar
• Zhao, M., T. M. Gersch, B. S. Schnitzer, B. A Dosher, and E. Kowler. 2012. “Eye Movements and Attention: The Role of Pre-saccadic Shifts of Attention in Perception, Memory and the Control of Saccades.” Vision Research 74: 40–60. doi:10.1016/j.visres.2012.06.017.
   PubMed Web of Science ®Google Scholar