Eye tracking as a debriefing tool in upset prevention and recovery training (UPRT) for general aviation pilots

References

• Adam, R., P.M. Bays, and M. Husain. 2012. “Rapid Decision-Making Under Risk.” Cognitive neuroscience 3 (1): 52–61. doi:10.1080/17588928.2011.613988.
   PubMed Web of Science ®Google Scholar
• Advani, S., and J. Field. 2011. “Upset Prevention and Recovery Training in Flight Simulators.” Paper presented at the AIAA Modeling and Simulation Technologies Conference, Portland, August 8–11.
   Google Scholar
• Advani, S.K., J.A. Schroeder, and B. Burks. 2016. “Global Implementation of Upset Prevention and Recovery Training.” Paper presented at the AIAA Modeling and Simulation Technologies Conference, San Diego, January 4–8.
   Google Scholar
• Ahlstrom, U., and F.J. Friedman-Berg. 2006. “Using Eye Movement Activity as a Correlate of Cognitive Workload.” International Journal of Industrial Ergonomics 36 (7): 623–636. doi:10.1016/j.ergon.2006.04.002.
   Web of Science ®Google Scholar
• Ali-Hasan, N., E. Harrington, and J. Richman. 2008. “Best Practices for Eye Tracking of Television and Video User Experiences.” Paper presented at proceedings of the 1st International Conference on Designing Interactive User ex-periences for TV and Video, California, October 22–24. doi:10.1145/1453805.1453808.
   Google Scholar
• Atkins, M.S., A. Moise, and R. Rohling. 2006. “An Application of Eyegaze Tracking for Designing Radiologists’ Workstations: Insights for Comparative Visual Search Tasks. “ACM Transactions on Applied Perception (TAP) 3 (2): 136–151. doi:10.1145/1141897.1141902.
   Google Scholar
• Björklund, C.M., J. Alfredson, and S.W. Dekker. 2006. “Mode Monitoring and Call-Outs: An Eye-Tracking Study of Two-Crew Automated Flight Deck Operations.” The International journal of AviationPpsychology 16 (3): 263–275. doi:10.1207/s15327108ijap1603_2.
   Web of Science ®Google Scholar
• Blascheck, T., K. Kurzhals, M. Raschke, M. Burch, D. Weiskopf, and T. Ertl. 2014. “State-of-the-Art of Visualization for Eye Tracking Data.” Paper presented at the Eurographics Conference on Visualization, Swansea University, June 9–13.
   Google Scholar
• Bonner, M.A., and G.F. Wilson. 2002. “Heart Rate Measures of Flight Test and Evaluation.” The International Journal of Aviation Psychology 12 (1): 63–77. doi:10.1207/S15327108IJAP1201_6.
   Web of Science ®Google Scholar
• Borghini, G., L. Astolfi, G. Vecchiato, D. Mattia, and F. Babiloni. 2014. “Measuring Neurophysiological Signals in Aircraft Pilots and Car Drivers for the Assessment of Mental Workload, Fatigue and Drowsiness.” Neuroscience and Biobehavioral Reviews 44: 58–75. doi:10.1016/j.neubiorev.2012.10.003.
   PubMed Web of Science ®Google Scholar
• Bürki-Cohen, J. 2010. “Technical Challenges of Upset Recovery Training: Simulating the Element of Surprise.” Paper presented at the AIAA Modeling and Simulation Technologies Conference, Toronto, August 2–5.
   Google Scholar
• Bürki-Cohen, J., and A. Sparko. 2008. “Airplane Upset Prevention Research Needs.” Paper presented at the AIAA Modeling and Simulation Technologies Conference, Honolulu, August 18–21.
   Google Scholar
• Casner, S.M., R.W. Geven, and K.T. Williams. 2013. “The Effectiveness of Airline Pilot Training for Abnormal Events.” Human factors 55 (3): 477–485. doi:10.1177/0018720812466893.
   PubMed Web of Science ®Google Scholar
• Croft, J. 2015. “Regaining Control – Findings in the Indonesia Airasia Flight 8501 Crash Highlight: Lessons Learned – But Not Implemented – From High-Profile Crashes in 2009.” Aviation Week and Space Technology 20: 24–25.
   Google Scholar
• Dahlstrom, N., S. Nahlinder, G.F. Wilson, and E. Svensson. 2011. “Recording of Psychophysiological Data During Aerobatic Training.” The International Journal of Aaviation Psychology 21 (2): 105–122. doi:10.1080/10508414.2011.556443.
   Web of Science ®Google Scholar
• De Greef, T., H. Lafeber, H. van Oostendorp, and J. Lindenberg. 2009. “Eye Movement as Indicators of Mental Workload to Trigger Adaptive Automation.” Paper presented at 5th International Conference, FAC 2009 held as part of HCI International, San Deigo, July 19–24.
   Google Scholar
• Dehais, F., J. Behrend, V. Peysakhovich, M. Causse, and C.D. Wickens. 2017. “Pilot Flying and Pilot Monitoring’s Aircraft State Awareness During Go-Around Execution in Aviation: A Behavioral and Eye Tracking Study.” The International Journal of Aerospace Psychology 27 (1-2): 15–28.
   Web of Science ®Google Scholar
• Dehais, F., M. Causse, and J. Pastor. 2008. “Embedded Eye Tracker in a Real Aircraft: New Perspectives on Pilot/Aircraft Interaction Monitoring.” Presented at The 3rd International Conference on Research and Air Transportation. Fairfax, June 1–4.
   Google Scholar
• De Rivecourt, M., M.N. Kuperus, W.J. Post, and L.J.M. Mulder. 2008. “Cardiovascular and Eye Activity Measures as Indices for Momentary Changes in Mental Effort During Simulated Flight.” Ergonomics 51 (9): 1295–1319. doi:10.1080/00140130802120267.
   PubMed Web of Science ®Google Scholar
• Duchowski, A.T. 2002. “A Breadth-First Survey of Eye-Tracking Applications.” Behavior Research Methods, Instruments, and Computers 34 (4): 455–470. doi:10.3758/BF03195475.
   PubMedGoogle Scholar
• Dussault, C., J.C. Jouanin, and C.Y. Guezennec. 2004. “EEG and ECG Changes During Selected Flight Sequences.” Aviation, Space, and Environmental Medicine 75 (10): 889–897.
   PubMedGoogle Scholar
• EASA. 2015. “Loss of control prevention and recovery training.” Notice of Proposed Amendment, April 2015. Accessed 20 July 2017. https://www.easa.europa.eu/system/files/dfu/NPA%202015-13.pdf
   Google Scholar
• Elfering, A., and S. Grebner. 2008. “Stress and patient safety.” In the handbook of stress and burnout in Health Care, edited by J.R.B. Halbesleben, 173–186. New York: Nova Science Publishers.
   Google Scholar
• Ferrari, F., K.P.C. Spillmann, C.P. Knecht, K. Bektas, and C.M. Muehlethaler. 2018. “Improved Pilot Training using Head and Eye Tracking System.” Paper presented at the 3rd International Workshop on Eye Tracking for Spatial Research, Zurich, January 14. doi:10.3929/ethz-b-000222482.
   Google Scholar
• Gawron, V.J. 2002. “Aircraft upset training evaluation report.” National Aeronautics and Space Administration (NASA): NAS2‐99070. Accessed 20 July 2017. https://ntrs.nasa.gov/archive/nasa/casi.ntrs.nasa.gov/20020068969.pdf
   Google Scholar
• Hankins, T.C., and G.F. Wilson. 1998. “A Comparison of Heart Rate, Eye Activity, EEG and Subjective Measures of Pilot Mental Workload During Flight.” Aviation, Space, and Environmental Medicine 69 (4): 360–367.
   PubMed Web of Science ®Google Scholar
• Harris, D. 2014. “Improving aircraft safety.” The Psychologist 27: 90–95.
   Web of Science ®Google Scholar
• Harris, D., and W-C. Li. 2011. “Cultural Determinants of Error on the Flight Deck.” In the Handbook of Human-Machine Interaction: A Human-Centred Design Approach, edited by G.A. Boy, 399–416. Farnham: Ashgate.
   Google Scholar
• Hart, S.G., and L.E. Staveland. 1988. “Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research.” Advances in Psychology 52: 139–183. doi:10.1016/S0166-4115(08)62386-9.
   Google Scholar
• Haslbeck, A., and K. Bengler. 2016. “Pilots’ Gaze Strategies and Manual Control Performance Using Occlusion as a Measurement Technique During a Simulated Manual Flight Task.” Cognition, Technology and Work 18 (3): 529–540. doi:10.1007/s10111-016-0382-2.
   Web of Science ®Google Scholar
• Haslbeck, A., E. Schubert, P. Gontar, and K. Bengler. 2012. “The Relationship Between Pilots' Manual Flying Skills and Their Visual Behavior: A Flight Simulator Study Using Eye Tracking.” In Advances in Human Aspects of Aviation (Advances in Human Factors and Ergonomics), edited by S. Laundry, G. Salvendy, and W. Karwowski, 561–568. Boca Raton: CRC Press.
   Google Scholar
• Hendy, K.C., K.M. Hamilton, and L.N. Landry. 1993. “Measuring Subjective Workload: When is One Scale Better Than Many?.” Human Factors 35 (4): 579–601. doi:10.1177/001872089303500401.
   Web of Science ®Google Scholar
• Holmqvist, K., M. Nyström, R. Andersson, R. Dewhurst, H. Jarodzka, and J. Van de Weijer. 2011. Eye Tracking: A Comprehensive Guide to Methods and Measures. Oxford: OUP.
   Google Scholar
• ICAO. 2014. “Manual on aeroplane upset and prevention recovery training.” ICAO Doc 10011 AN/506. Accessed 20 July 2017. https://www.icao.int/Meetings/LOCI/Documents/10011_draft_en.pdf
   Google Scholar
• Jarodzka, H., T. van Gog, M. Dorr, K. Scheiter, and P. Gerjets. 2013. “Learning to See: Guiding Students' Attention Via a Model's Eye Movements Fosters Learning. “Learning and Instruction 25: 62–70. doi: 10.1016/j.learninstruc.2012.11.004.
   Web of Science ®Google Scholar
• Knecht, C.P., C.M. Muehlethaler, and A. Elfering. 2016. “Nontechnical Skills Training in Air Traffic Management Including Computer-Based Simulation Methods.” Aviation Psychology and Applied Human Factors 6 (2): 91–100. doi:10.1027/2192-0923/a000103.
   Google Scholar
• Kontogiannis, T., and S. Malakis. 2009. “A Proactive Approach to Human Error Detection and Identification in Aviation and Air Traffic Control.” Safety Science 47: 693–706. doi:10.1016/j.ssci.2008.09.007.
   Web of Science ®Google Scholar
• Ledegang, W.D., and E.L. Groen. 2015. “Stall Recovery in a Centrifuge-Based Flight Simulator With an Extended Aerodynamic Model.” The International Journal of Aviation Psychology 25 (2): 122–140. doi: 10.1080/10508414.2015.1131085.
   Web of Science ®Google Scholar
• Leland, R., R.O. Rogers, A. Boquet, and S. Glaser. 2009. “An Experiment to Evaluate Transfer of Upset-recovery Training Conducted Using Two Different Flight Simulation Devices (No. DOT-FAA-AM-09-17).” Environmental Tectonics Corporation Southampton PA. Accessed 20 July 2017. http://www.dtic.mil/get-tr-doc/pdf?AD=ADA506409
   Google Scholar
• Lin, Y., W.J. Zhang, and L.G. Watson. 2003. “Using Eye Movement Parameters for Evaluating Human–Machine Interface Frameworks Under Normal Control Operation and Fault Detection Situations.” International Journal of Human-Computer Studies 59 (6): 837–873. doi:10.1016/S1071-5819(03)00122-8.
   Web of Science ®Google Scholar
• Martin, W.L., P.S. Murray, P.R. Bates, and P.S. Lee. 2015. “Fear-Potentiated Startle: A Review From an Aviation Perspective.” The International Journal of Aviation Psychology 25 (2): 97–107. doi: 10.1016/j.ijpsycho.2015.02.025.
   Web of Science ®Google Scholar
• Muczyński, B., M. Gucma, M. Bilewski, and P. Zalewski. 2013. “Using Eye Tracking Data for Evaluation and Improvement of Training Process on Ship’s Navigational Bridge Simulator.” Zeszyty Naukowe/Akademia Morska w Szczecinie 33 (105): 75–78.
   Google Scholar
• Peysakhovich, V., M. Causse, S. Scannella, and F. Dehais. 2015. “Frequency Analysis of a Task-Evoked Pupillary Response: Luminance-Independent Measure of Mental Effort.” International Journal of Psychophysiology 97 (1): 30–37.
   PubMed Web of Science ®Google Scholar
• Peysakhovich, V., and C. Hurter. 2018. “Scanpath Visualization and Comparison Using Visual Aggregation Techniques.” Journal of Eye Movement Research 10 (5): 1–14. doi:10.16910/jemr.10.5.9.
   Google Scholar
• Peysakhovich, V., O. Lefrançois, F. Dehais, and M. Causse. 2018. “The Neuroergonomics of Aircraft Cockpits: The Four Stages of Eye-Tracking Integration to Enhance Flight Safety.” Safety 4 (1): 8. doi:10.3390/safety4010008.
   Web of Science ®Google Scholar
• Rivera, J., A.B. Talone, C.T. Boesser, F. Jentsch, and M. Yeh. 2014. “Startle and surprise on the flight deck: Similarities, differences, and prevalence.” Paper presented at Proceedings of the Human Factors and Ergonomics Society Annual Meeting. Los Angeles: SAGE Publications.
   Google Scholar
• Robinski, M., and M. Stein. 2013. “Tracking Visual Scanning Techniques in Training Simulation for Helicopter Landing.” Journal of Eye Movement Research 6 (2): 1–17. doi:10.16910/jemr.6.2.3.
   Web of Science ®Google Scholar
• Rosch, J.L., and J.J. Vogel-Walcutt. 2012. “A Review of Eye-Tracking Applications as Tools for Training.” Cognition, Technology and Work 15 (3): 313–327. doi:10.1007/s10111-012-0234-7.
   Web of Science ®Google Scholar
• Roscoe, A.H. 1992. “Assessing Pilot Workload. Why Measure Heart Rate, HRV and Respiration?.” Biological Psychology 34 (2): 259–287.doi:10.1016/0301-0511(92)90018-P.
   PubMed Web of Science ®Google Scholar
• Rummler, G.A., and A.P. Brache. 1995. Improving Performance: How to Manage the White Space on the Organization Char. CA: Jossey-Bass Publishers.
   Google Scholar
• Sarter, N.B., R.J. Mumaw, and C.D. Wickens. 2007. “Pilots' Monitoring Strategies and Performance on Automated Flight Decks: An Empirical Study Combining Behavioral and Eye-Tracking Data.” Human Factors 49 (3): 347–357. doi:10.1518/001872007X196685.
   PubMed Web of Science ®Google Scholar
• Schnell, T., Y. Kwon, S. Merchant, and T. Etherington. 2004. “Improved Flight Technical Performance in Flight Decks Equipped With Synthetic Vision Information System Displays.” The International Journal of Aviation Psychology 14 (1): 79–102. doi:10.1207/s15327108ijap1401_5.
   Web of Science ®Google Scholar
• Schriver, A.T., D.G. Morrow, C.D. Wickens, and D.A. Talleur. 2008. “Expertise Differences in Attentional Strategies Related to Pilot Decision Making.” Human Factors 50 (6): 864–878. doi:10.1518/001872008X374974.
   PubMed Web of Science ®Google Scholar
• Sullivan, J., J.H. Yang, M. Day, and Q. Kennedy. 2011. “Training Simulation for Helicopter Navigation by Characterizing Visual Scan Patterns.” Aviation, Space, and Environmental Medicine 82 (9): 871–878. doi:10.3357/ASEM.2947.2011.
   PubMedGoogle Scholar
• Svensson, E.A., and G.F. Wilson. 2002. “Psychological and Psychophysiological Models of Pilot Performance for Systems Development and Mission Evaluation.” The International Journal of Aviation Psychology 12 (1): 95–110. doi:10.1207/S15327108IJAP1201_8.
   Web of Science ®Google Scholar
• Tichon, J.G., G. Wallis, S. Riek, and T. Mavin. 2014. “Physiological Measurement of Anxiety to Evaluate Performance in Simulation Training.” Cognition, Technology and Work 16 (2): 203–210. doi:10.1007/s10111-013-0257-8.
   Web of Science ®Google Scholar
• Tien, T., P.H. Pucher, M.H. Sodergren, K. Sriskandarajah, G.Z. Yang, and A. Darzi. 2014. “Eye Tracking for Skills Assessment and Training: A Systematic Review.” Journal of Surgical Research 191 (1): 169–178. doi:10.1016/j.jss.2014.04.032.
   PubMed Web of Science ®Google Scholar
• Van de Merwe, K., H. van Dijk, and R. Zon. 2012. “Eye Movements as an Indicator of Situation Awareness in a Flight Simulator Experiment.” The International Journal of Aviation Psychology 22 (1): 78–95. doi:10.1080/10508414.2012.635129.
   Web of Science ®Google Scholar
• Van Dijk, H., K. van de Merwe, and R. Zon. 2011. “A Coherent Impression of the Pilots' Situation Awareness: Studying Relevant Human Factors Tools.” The International Journal of Aviation Psychology 21 (4): 343–256. doi:10.1080/10508414.2011.606747.
   PubMedGoogle Scholar
• Waniek, J., and K. Ewald. 2008. “Cognitive Costs of Navigation Aids in Hypermedia Learning.” Journal of Educational Computing Research 39 (2): 185–204. doi:10.2190/EC.39.2.e.
   Web of Science ®Google Scholar
• Wetzel, P.A., G.M. Anderson, and B.A. Barelka. 1998. “Instructor Use of Eye Position Based Feedback for Pilot Training.” In Proceedings of the human factors and ergonomics society annual meeting. Los Angeles: SAGE Publications.
   Google Scholar
• Wilson, G.F. 2002. “An Analysis of Mental Workload in Pilots During Flight Using Multiple Psychophysiological Measures.” The International Journal of Aviation Psychology 12 (1): 3–18. doi:10.1207/S15327108IJAP1201_2.
   Web of Science ®Google Scholar