Gaming experience predicts UAS operator performance and workload in simulated search and rescue missions

References

• Angelov, P. (Ed.). 2012. Sense and Avoid in UAS: research and Applications. Chichester, West Sussex, UK: John Wiley & Sons.
   Google Scholar
• Bavelier, D., R. L. Achtman, M. Mani, and J. Föcker. 2012. “Neural Bases of Selective Attention in Action Video Game Players.” Vision Research 61: 132–143.
   PubMed Web of Science ®Google Scholar
• Carretta, T. R., M. R. Rose, and K. T. Bruskiewicz. 2016. “Selection Methods for Operators of Remotely Piloted Aircraft Systems.” Remotely Piloted Aircraft Systems 1: 137–163.
   Google Scholar
• Chappelle, W., J. Swearingen, T. Goodman, S. Cowper, L. Prince, and W. Thompson. 2014. Occupational Health Screenings of US Air Force Remotely Piloted Aircraft (Drone) Operators. OH, USA: School of Aerospace Medicine, Wright-Patterson AFB.
   Google Scholar
• Chen, J. Y., and M. J. Barnes. 2012. “Supervisory Control of Multiple Robots: Effects of Imperfect Automation and Individual Differences.” Human Factors 54 (2): 157–174.
   PubMed Web of Science ®Google Scholar
• Chiappe, D., M. Conger, J. Liao, J. L. Caldwell, and K. P. L. Vu. 2013. “Improving Multi-Tasking Ability through Action Videogames.” Applied Ergonomics 44 (2): 278–284.
   PubMed Web of Science ®Google Scholar
• Department of Defense (U.S.). 2005. Department of defense human factors analysis and classification system. A mishap investigation and data analysis tool. https://www.uscg.mil/hr/cg113/docs/pdf/hfacs.pdf
   Google Scholar
• Federal Aviation Administration. 2013. Final Report of the Performance-Based Operations Aviation Rulemaking Committee/Commercial Aviation Safety Team Flight Deck Automation Working Group. Washington, DC: Federal Aviation Administration.
   Google Scholar
• Ferguson, C. J. 2007. “The Good, the Bad and the Ugly: A Meta-Analytic Review of Positive and Negative Effects of Violent Video Games.” The Psychiatric Quarterly 78 (4): 309–316. doi:10.1007/s11126-007-9056-9.
   PubMed Web of Science ®Google Scholar
• Ferraro, J., N. Christy, and M. Mouloua. 2017. “Stealth Adapt: Assessing UAS Operator Workload during Simulated Search and Rescue.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 61 (1): 1124–1128. doi:10.1177/1541931213601765.
   Google Scholar
• Ferraro, J. C., and M. Mouloua. 2021. “Effects of Automation Reliability on Error Detection and Attention to Auditory Stimuli in a Multi-Tasking Environment.” Applied Ergonomics 91: 103303. doi:10.1016/j.apergo.2020.103303.
   PubMed Web of Science ®Google Scholar
• Finomore, V., G. Matthews, T. Shaw, and J. Warm. 2009. “Predicting Vigilance: A Fresh Look at an Old Problem.” Ergonomics 52 (7): 791–808. doi:10.1080/00140130802641627.
   PubMed Web of Science ®Google Scholar
• Frischmann, T. B., M. Mouloua, and K. Procci. 2015. “3-D Gaming Environment Preferences: Inversion of the Y-Axis.” Ergonomics 58 (11): 1792–1799.
   PubMed Web of Science ®Google Scholar
• Gilson, R., Mouloua, M., and Richardson, C. 1999. (Eds.). Unmanned Autonomous Vehicles: Human Factors Guidelines. Washington, DC: Defense Advanced Research Projects Agency.
   Google Scholar
• Gough, C. 2020, October. Global ESports Market Revenue 2023. Statista. www.statista.com/statistics/490522/global-esports-market-revenue/.
   Google Scholar
• Green, C. S., M. A. Sugarman, K. Medford, E. Klobusicky, and D. Bavelier. 2012. “The Effect of Action Video Game Experience on Task-Switching.” Computers in Human Behavior 28 (3): 984–994.
   PubMed Web of Science ®Google Scholar
• Green, C. S., R. Li, and D. Bavelier. 2010. “Perceptual Learning during Action Video Game Playing.” Topics in Cognitive Science 2 (2): 202–216.
   PubMed Web of Science ®Google Scholar
• Hambrick, D. Z., F. L. Oswald, E. S. Darowski, T. A. Rench, and R. Brou. 2010. “Predictors of Multitasking Performance in a Synthetic Work Paradigm.” Applied Cognitive Psychology 24 (8): 1149–1167. doi:10.1002/acp.1624.
   Web of Science ®Google Scholar
• Hancock, P. A., and G. P. Krueger. 2010. Hours of Boredom, Moments of Terror: Temporal Desynchrony in Military and Security Force Operations. Washington DC: National Defense University, Washington DC Center for Technology and National Security Policy.
   Google Scholar
• Hancock, P. A., D. A. Vincenzi, J. A. Wise, and M. Mouloua. 2008. Human Factors in Simulation and Training. Boca Raton, FL: CRC Press.
   Google Scholar
• Hart, S. G., and L. E. Staveland. 1988. “Development of NASA TLX (Task Load Index): Results of Empirical and Theoretical Research.” Advances in Psychology 52: 139–183.
   Google Scholar
• Hobbs, A. 2010. “Unmanned Aircraft Systems.” In Human Factors in Aviation, edited by E. Salas and D. Maurino, 505–531. Boston, MA: Academic Press.
   Google Scholar
• Lin, J., G. Matthews, R. W. Wohleber, G. J. Funke, G. L. Calhoun, H. A. Ruff, J. Szalma, and P. Chiu. 2020. “Overload and Automation-Dependence in a Multi-UAS Simulation: Task Demand and Individual Difference Factors.” Journal of Experimental Psychology: Applied 26 (2): 218–235.
   PubMed Web of Science ®Google Scholar
• Lin, J., G. Matthews, L. Reinerman-Jones, and R. Wohleber. 2018, July. “Assessing Operator Psychological States and Performance in UAS Operations.” In International Conference on Augmented Cognition, edited by D. D. Schmorrow and C. M. Fidopiastis, 131–147. Cham: Springer.
   Google Scholar
• Lin, J., G. Matthews, R. Wohleber, C. Y. P. Chiu, G. Calhoun, G. Funke, and H. Ruff. 2016. “Automation Reliability and Other Contextual Factors in multi-UAV Operator Selection.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 60 (1): 846–850. doi:10.1177/1541931213601193.
   Google Scholar
• Lin, J., R. Wohleber, G. Matthews, P. Chiu, G. Calhoun, H. Ruff, and G. Funke. 2015. “Video Game Experience and Gender as Predictors of Performance and Stress During Supervisory Control of Multiple Unmanned Aerial Vehicles.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 59 (1): 746–750. doi:10.1177/1541931215591175.
   Google Scholar
• Mangos, P. 2016. Stealth Adapt [Computer Software]. Tampa, FL: Adaptive Immersion Technologies.
   Google Scholar
• Matthews, G. 2016. “Multidimensional Profiling of Task Stress States for Human Factors: A Brief Review.” Human Factors 58 (6): 801–813. doi:10.1177/0018720816653688.
   PubMed Web of Science ®Google Scholar
• Matthews, G., S. E. Campbell, S. Falconer, L. A. Joyner, J. Huggins, K. Gilliland, R. Grier, and J. S. Warm. 2002. “Fundamental Dimensions of Subjective State in Performance Settings: Task Engagement, Distress, and Worry.” Emotion 2 (4): 315–340. doi:10.1037/1528-3542.2.4.315.
   PubMed Web of Science ®Google Scholar
• Matthews, G., L. Joyner, K. Gilliland, S. Campbell, S. Falconer, and J. Huggins. 1999. “Validation of a Comprehensive Stress State Questionnaire: Towards a State Big Three.” Personality Psychology in Europe 7: 335–350.
   Google Scholar
• Matthews, G., A. R. Panganiban, A. Wells, R. W. Wohleber, and L. E. Reinerman-Jones. 2019. “Metacognition, Hardiness, and Grit as Resilience Factors in Unmanned Aerial Systems (UAS) Operations: A Simulation Study.” Frontiers in Psychology 10: 640.
   PubMed Web of Science ®Google Scholar
• Matthews, G., L. E. Reinerman-Jones, D. J. Barber, G. Teo, R. W. Wohleber, J. Lin, and A. R. Panganiban. 2016, August. “Resilient Autonomous Systems: Challenges and Solutions.” In 2016 Resilience Week (RWS), 208–213, IEEE.
   Google Scholar
• McKinley, A. R., L. K. McIntire, and M. A. Funke. 2009. Operator Selection for Unmanned Aerial Vehicle Operators: A Comparison of Video Game Players and Manned Aircraft Pilots (AFRL-RH-WP-TR-2010-0057). Wright-Patterson Air Force Base, OH. Air Force Research Laboratory.
   Google Scholar
• McKinley, R. A., L. K. McIntire, and M. A. Funke. 2011. “Operator Selection for Unmanned Aerial Systems: comparing Video Game Players and Pilots.” Aviation, Space, and Environmental Medicine 82 (6): 635–642. doi:10.3357/asem.2958.2011.
   PubMedGoogle Scholar
• Mouloua, M.,. J. Ferraro, A. Kaplan, P. Mangos, and P. A. Hancock. 2019. “Human Factors Issues regarding Trust in UAS Operation, Selection, and Training.”. In Human Performance in Automated and Autonomous Systems: Current Theory and Methods, edited by M. Mouloua and P. A. Hancock. Boca Raton, FL: CRC Press.
   Google Scholar
• Mouloua, S. A., J. Ferraro, M. Mouloua, and P. A. Hancock. 2018. “Trend Analysis of Unmanned Aerial Vehicles (UAVs) Research Published in the HFES Proceedings.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 62 (1): 1067–1071. doi:10.1177/1541931218621245.
   Google Scholar
• Mouloua, M., R. Gilson, and P. Hancock. 2003. “Human-Centered Design of Unmanned Aerial Vehicles.” Ergonomics in Design 11 (1): 6–11. doi:10.1177/106480460301100103.
   Google Scholar
• Mouloua, M., R. Gilson, J. Kring, and P. Hancock. 2001, October. “Workload, Situation Awareness, and Teaming Issues for UAV/UCAV Operations.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 45 (2): 162–165. doi:10.1177/154193120104500235.
   Google Scholar
• Panganiban, A. R., and G. Matthews. 2014, September. “Executive Functioning Protects against Stress in UAV Simulation.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 58 (1): 994–998. doi:10.1177/1541931214581208.
   Google Scholar
• Pavlas, D., C.S. Burke, S.M. Fiore, E. Salas, R. Jensen, and D. Fu. 2009. “Enhancing Unmanned Aerial System Training: A Taxonomy of Knowledge, Skills, Attitudes, and Methods.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 53 (26): 1903–1907. doi:10.1177/154193120905302604.
   Google Scholar
• Rupp, M. A., P. Oppold, and D. S. McConnell. 2015. “Evaluating Input Device Usability as a Function of Task Difficulty in a Tracking Task.” Ergonomics 58 (5): 722–735. doi:10.1080/00140139.2014.988755.
   PubMed Web of Science ®Google Scholar
• Sailer, M., and L. Homner. 2020. “The Gamification of Learning: A Meta-Analysis.” Educational Psychology Review 32 (1): 77–112. doi:10.1007/s10648-019-09498-w.
   Web of Science ®Google Scholar
• Sauer, J., S. Schmutz, A. Sonderegger, and N. Messerli. 2019. “Social Stress and Performance in Human-Machine Interaction: A Neglected Research Field.” Ergonomics 62 (11): 1377–1391.
   PubMed Web of Science ®Google Scholar
• Scerbo, M. W., and M. E. Mouloua. 1999. “Automation Technology and Human Performance: Current Research and Trends.” Conference on Automation Technology and Human Performance, Lawrence Erlbaum Associates Publishers, Norfolk, VA, US, March 3, 1998.
   Google Scholar
• Scott, M., B. Peng, M. Chili, T. Nigam, F. Pascual, C. Matuszek, and M. E. Taylor. 2015, September. “On the Ability to Provide Demonstrations on a UAS: Observing 90 Untrained Participants Abusing a Flying Robot.” In 2015 AAAI Fall Symposium Series. Arlington, VA.
   Google Scholar
• Spence, I., and J. Feng. 2010. “Video Games and Spatial Cognition.” Review of General Psychology 14 (2): 92–104. doi:10.1037/a0019491.
   Web of Science ®Google Scholar
• Spence, I., J. J. Yu, J. Feng, and J. Marshman. 2009. “Women Match Men When Learning a Spatial Skill.” Journal of Experimental Psychology. Learning, Memory, and Cognition 35 (4): 1097–1103.
   PubMed Web of Science ®Google Scholar
• Strauch, B. 2017. “The Automation-by-Expertise-by-Training Interaction: Why Automation-Related Accidents Continue to Occur in Sociotechnical Systems.” Human Factors 59 (2): 204–228. doi:10.1177/0018720816665459.
   PubMed Web of Science ®Google Scholar
• Terlecki, M., J. Brown, L. Harner-Steciw, J. Irvin-Hannum, N. Marchetto-Ryan, L. Ruhl, and J. Wiggins. 2011. “Sex Differences and Similarities in Video Game Experience, Preferences, and Self-Efficacy: Implications for the Gaming Industry.” Current Psychology 30 (1): 22–33. doi:10.1007/s12144-010-9095-5.
   Web of Science ®Google Scholar
• Verde, P., L. Piccardi, F. Bianchini, P. Trivelloni, C. Guariglia, and E. Tomao. 2013. “Gender Effects of Mental Rotation in Pilots vs. Nonpilots.” Aviation, Space, and Environmental Medicine 84 (7): 726–729.
   PubMedGoogle Scholar
• Vincenzi, D. A., Mouloua, M., & Hancock, P. A. (Eds.). 2004. Human Performance, Situation Awareness and Automation: Current Research and Trends: HPSAA II, Vol. 2. Mahwah, NJ: L. Erlbaum Associates.
   Google Scholar
• Waraich, Q. R., T. A. Mazzuchi, S. Sarkani, and D. F. Rico. 2013. “Minimizing Human Factors Mishaps in Unmanned Aircraft Systems.” Ergonomics in Design 21 (1): 25–32. doi:10.1177/1064804612463215.
   Google Scholar
• Warm, J. S., G. Matthews, and V. S. Finomore. Jr. 2008. “Vigilance, Workload, and Stress.” In Performance under Stress edited by P. A. Hancock and J. L. Szalma,115–141. Burlington, VT: Ashgate.
   Google Scholar
• Wohleber, R. W., G. Matthews, J. Lin, J. L. Szalma, G. L. Calhoun, G. J. Funke, C.-Y. P. Chiu, and H. A. Ruff. 2019. “Vigilance and Automation Dependence in Operation of Multiple Unmanned Aerial Systems (UAS): A Simulation Study.” Human Factors 61 (3): 488–505.
   PubMed Web of Science ®Google Scholar