211
Views
0
CrossRef citations to date
0
Altmetric
Research Article

Biometrically Measured Affect for Screen-Based Drone Pilot Skill Acquisition

Received 27 Nov 2022, Accepted 20 Apr 2023, Published online: 17 May 2023

References

  • Abdelrahman, Y., Velloso, E., Dingler, T., Schmidt, A., & Vetere, F. (2017). Cognitive heat: Exploring the usage of thermal imaging to unobtrusively estimate cognitive load. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 1(3), 1–20. https://doi.org/10.1145/3130898
  • Ahern, S., & Beatty, J. (1979). Pupillary responses during information processing vary with Scholastic Aptitude Test scores. Science, 205(4412), 1289–1292. https://doi.org/10.1126/science.472746
  • Albeaino, G., Eiris, R., Gheisari, M., & Issa, R. R. (2022). DroneSim: A VR-based flight training simulator for drone-mediated building inspections. Construction Innovation, 22(4), 831–848. https://doi.org/10.1108/CI-03-2021-0049
  • Andreassi, J. L. (2010). Psychophysiology: Human behavior and physiological response. Psychology Press.
  • Astolfi, L., Cincotti, F., Babiloni, C., Carducci, F., Basilisco, A., Rossini, P. M., Salinari, S., Mattia, D., Cerutti, S., Dayan, D. B., Ding, L., Ni, Y., He, B., & Babiloni, F. (2005). Estimation of the cortical connectivity by high-resolution EEG and structural equation modeling: Simulations and application to finger tapping data. IEEE Transactions on Bio-Medical Engineering, 52(5), 757–768. https://doi.org/10.1109/TBME.2005.845371
  • Backs, R. W., & Walrath, L. C. (1992). Eye movement and pupillary response indices of mental workload during visual search of symbolic displays. Applied Ergonomics, 23(4), 243–254. https://doi.org/10.1016/0003-6870(92)90152-l
  • Baddeley, A. D., & Hitch, G. (1974). Working memory (Psychology of learning and motivation) (Vol. 8, pp. 47–89). Elsevier.
  • Basile, L. F., Anghinah, R., Ribeiro, P., Ramos, R. T., Piedade, R., Ballester, G., & Brunetti, E. P. (2007). Interindividual variability in EEG correlates of attention and limits of functional mapping. International Journal of Psychophysiology, 65(3), 238–251. https://doi.org/10.1016/j.ijpsycho.2007.05.001
  • Berka, C., Levendowski, D. J., Westbrook, P., Davis, G., Lumicao, M. N., Olmstead, R. E., Popovic, M., Zivkovic, V. T., & Ramsey, C. K. (2005). EEG quantification of alertness: Methods for early identification of individuals most susceptible to sleep deprivation. In Biomonitoring for Physiological and Cognitive Performance during Military Operations. https://doi.org/10.1117/12.597503
  • Besserve, M., Philippe, M., Florence, G., Laurent, F., Garnero, L., & Martinerie, J. (2008). Prediction of performance level during a cognitive task from ongoing EEG oscillatory activities. Clinical Neurophysiology, 119(4), 897–908. https://doi.org/10.1016/j.clinph.2007.12.003
  • Bo, J., Borza, V., & Seidler, R. D. (2009). Age-related declines in visuospatial working memory correlate with deficits in explicit motor sequence learning. Journal of Neurophysiology, 102(5), 2744–2754. https://doi.org/10.1152/jn.00393.2009
  • Brown, S., & Bennett, E. (2002). The role of practice and automaticity in temporal and nontemporal dual-task performance. Psychological Research, 66(1), 80–89. https://doi.org/10.1007/s004260100076
  • Buszard, T., Farrow, D., Verswijveren, S. J., Reid, M., Williams, J., Polman, R., Ling, F. C. M., & Masters, R. S. (2017). Working memory capacity limits motor learning when implementing multiple instructions. Frontiers in Psychology, 8, 1350. https://doi.org/10.3389/fpsyg.2017.01350
  • Cardona-Reyes, H., Trujillo-Espinoza, C., Arevalo-Mercado, C., & Muñoz-Arteaga, J. (2021). Training of drone pilots through virtual reality environments under the gamification approach in a university context.
  • Chen, D., Wang, M., He, C., Luo, Q., Iravantchi, Y., Sample, A., Shin, K. G., & Wang, X. (2021). MagX: Wearable, untethered hands tracking with passive magnets. In Proceedings of the 27th Annual International Conference on Mobile Computing and Networking. https://doi.org/10.1145/3447993.3511175
  • Cole, D. T., Thompson, P., Göktoğan, A. H., & Sukkarieh, S. (2010). System development and demonstration of a cooperative UAV team for mapping and tracking. The International Journal of Robotics Research, 29(11), 1371–1399. https://doi.org/10.1177/0278364910364685
  • Comolli, F., Gobbi, M., & Mastinu, G. (2020). Study on the driver/steering wheel interaction in emergency situations. Applied Sciences, 10(20), 7055. https://doi.org/10.3390/app10207055
  • Congress, S. S., Puppala, A. J., & Lundberg, C. L. (2018). Total system error analysis of UAV-CRP technology for monitoring transportation infrastructure assets. Engineering Geology, 247, 104–116. https://doi.org/10.1016/j.enggeo.2018.11.002
  • Conway, A. R., Cowan, N., Bunting, M. F., Therriault, D. J., & Minkoff, S. R. (2002). A latent variable analysis of working memory capacity, short-term memory capacity, processing speed, and general fluid intelligence. Intelligence, 30(2), 163–183. https://doi.org/10.1016/S0160-2896(01)00096-4
  • Corichi, E. Z., Carranza, J. M., Garca, C. A. R., & Pineda, L. V. (2017). Real-time prediction of altered states in Drone pilots using physiological signals. In 2017 Workshop on Research, Education and Development of Unmanned Aerial Systems (RED-UAS). https://doi.org/10.1109/RED-UAS.2017.8101674
  • Crandall, J. W., Goodrich, M. A., Olsen, D. R., & Nielsen, C. W. (2005). Validating human–robot interaction schemes in multitasking environments. IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans, 35(4), 438–449. https://doi.org/10.1109/TSMCA.2005.850587
  • Dalenogare, L. S., Benitez, G. B., Ayala, N. F., & Frank, A. G. (2018). The expected contribution of Industry 4.0 technologies for industrial performance. International Journal of Production Economics, 204, 383–394. https://doi.org/10.1016/j.ijpe.2018.08.019
  • De Cecilio de Carlos, R. (2019). Pupil size manipulation in covert attention to red and blue contrasts: Study and application in a human computer interface.
  • De Gennaro, L., Ferrara, M., & Bertini, M. (2001). The boundary between wakefulness and sleep: Quantitative electroencephalographic changes during the sleep onset period. Neuroscience, 107(1), 1–11. https://doi.org/10.1016/s0306-4522(01)00309-8
  • Donges, E. (1978). A two-level model of driver steering behavior. Human Factors: The Journal of the Human Factors and Ergonomics Society, 20(6), 691–707. https://doi.org/10.1177/001872087802000607
  • Du, X., Zhang, Y., Tian, Y., Huang, W., Wu, B., & Zhang, J. (2015). The influence of spatial ability and experience on performance during spaceship rendezvous and docking. Frontiers in Psychology, 6, 955. https://doi.org/10.3389/fpsyg.2015.00955
  • Economic Report (2017). Association for Unmanned Vehicle Systems International. Retrieved August 26, from https://www.auvsi.org/our-impact/economic-report
  • Eiris, R., Albeaino, G., Gheisari, M., Benda, W., & Faris, R. (2021). InDrone: A 2D-based drone flight behavior visualization platform for indoor building inspection. Smart and Sustainable Built Environment, 10(3), 438–456. https://doi.org/10.1108/SASBE-03-2021-0036
  • Engle, R. W. (2002). Working memory capacity as executive attention. Current Directions in Psychological Science, 11(1), 19–23. https://doi.org/10.1111/1467-8721.00160
  • Farina, D., Stegeman, D., & Merletti, R. (2016). Biophysics of the generation of EMG signals. Surface Electromyography: Physiology, Engineering, and Applications, 1–24.
  • Fitts, P. M., & Posner, M. I. (1967). Human performance. Brooks/Cole.
  • Fletcher, K., Neal, A., & Yeo, G. (2017). The effect of motor task precision on pupil diameter. Applied Ergonomics, 65, 309–315. https://doi.org/10.1016/j.apergo.2017.07.010
  • Fong, W., Ong, S., & Nee, A. (2008). Methods for in-field user calibration of an inertial measurement unit without external equipment. Measurement Science and Technology, 19(8), 085202. https://doi.org/10.1088/0957-0233/19/8/085202
  • Forte, G., Favieri, F., & Casagrande, M. (2019). Heart rate variability and cognitive function: A systematic review. Frontiers in Neuroscience, 13, 710. https://doi.org/10.3389/fnins.2019.00710
  • Furley, P. A., & Memmert, D. (2010). The role of working memory in sport. International Review of Sport and Exercise Psychology, 3(2), 171–194. https://doi.org/10.1080/1750984X.2010.526238
  • Gevins, A., & Smith, M. E. (2000). Neurophysiological measures of working memory and individual differences in cognitive ability and cognitive style. Cerebral Cortex, 10(9), 829–839. https://doi.org/10.1093/cercor/10.9.829
  • Girden, E. R. (1992). ANOVA: Repeated measures. Sage.
  • Gonzalez, C. (2005). Task workload and cognitive abilities in dynamic decision making. Human Factors, 47(1), 92–101. https://doi.org/10.1518/0018720053653767
  • Goodie, J. L., Larkin, K. T., & Schauss, S. (2000). Validation of Polar heart rate monitor for assessing heart rate during physical and mental stress. Journal of Psychophysiology, 14(3), 159–164. https://doi.org/10.1027//0269-8803.14.3.159
  • Gu, H., Yao, Q., Chen, H., Ding, Z., Zhao, X., Liu, H., Feng, Y., Li, C., & Li, X. (2022). The effect of mental schema evolution on mental workload measurement: An EEG study with simulated quadrotor UAV operation. Journal of Neural Engineering, 19(2), 026058. https://doi.org/10.1088/1741-2552/ac6828
  • Hajcak, G., MacNamara, A., & Olvet, D. M. (2010). Event-related potentials, emotion, and emotion regulation: An integrative review. Developmental Neuropsychology, 35(2), 129–155. https://doi.org/10.1080/87565640903526504
  • Hess, R., & Modjtahedzadeh, A. (1990). A control theoretic model of driver steering behavior. IEEE Control Systems Magazine, 10(5), 3–8. https://doi.org/10.1109/37.60415
  • Hultman, E., & Sjöholm, H. (1983). Electromyogram, force and relaxation time during and after continuous electrical stimulation of human skeletal muscle in situ. The Journal of Physiology, 339(1), 33–40. https://doi.org/10.1113/jphysiol.1983.sp014700
  • Intelligence, I. (2021). Drone technology uses and applications for commercial, industrial and military drones in 2021 and the future. Business Insider. Retrieved August 26, from https://www.businessinsider.com/drone-technology-uses-applications
  • Ishii, R., Canuet, L., Ishihara, T., Aoki, Y., Ikeda, S., Hata, M., Katsimichas, T., Gunji, A., Takahashi, H., Nakahachi, T., Iwase, M., & Takeda, M. (2014). Frontal midline theta rhythm and gamma power changes during focused attention on mental calculation: An MEG beamformer analysis. Frontiers in Human Neuroscience, 8, 406. https://doi.org/10.3389/fnhum.2014.00406
  • Jao, P.-K., Chavarriaga, R., Dell’Agnola, F., Arza, A., Atienza, D., & Millan, J. d R. (2021). EEG correlates of difficulty levels in dynamical transitions of simulated flying and mapping tasks. IEEE Transactions on Human–Machine Systems, 51(2), 99–108. https://doi.org/10.1109/THMS.2020.3038339
  • Jaquess, K. J., Lo, L.-C., Oh, H., Lu, C., Ginsberg, A., Tan, Y. Y., Lohse, K. R., Miller, M. W., Hatfield, B. D., & Gentili, R. J. (2018). Changes in mental workload and motor performance throughout multiple practice sessions under various levels of task difficulty. Neuroscience, 393, 305–318. https://doi.org/10.1016/j.neuroscience.2018.09.019
  • Javaid, M., Khan, I. H., Singh, R. P., Rab, S., & Suman, R. (2022). Exploring contributions of drones towards Industry 4.0. Industrial Robot: The International Journal of Robotics Research and Application, 49(3), 476–490. https://doi.org/10.1108/IR-09-2021-0203
  • Kaczorowska, M., Plechawska-Wojcik, M., Tokovarov, M., Dmytruk, R. (2017). Comparison of the ICA and PCA methods in correction of EEG signal artefacts [Paper presentation]. 2017 10th International Symposium on Advanced Topics in Electrical Engineering (ATEE). https://doi.org/10.1109/ATEE.2017.7905095
  • Kadir, B. A., Broberg, O., & da Conceicao, C. S. (2019). Current research and future perspectives on human factors and ergonomics in Industry 4.0. Computers & Industrial Engineering, 137, 106004. https://doi.org/10.1016/j.cie.2019.106004
  • Kamiński, J., Brzezicka, A., Gola, M., & Wróbel, A. (2012). Beta band oscillations engagement in human alertness process. International Journal of Psychophysiology, 85(1), 125–128. https://doi.org/10.1016/j.ijpsycho.2011.11.006
  • Kang, H., Li, H., Zhang, J., Lu, X., & Benes, B. (2018). Flycam: Multitouch gesture controlled drone gimbal photography. IEEE Robotics and Automation Letters, 3(4), 3717–3724. https://doi.org/10.1109/LRA.2018.2856271
  • Kerick, S. E., Douglass, L. W., & Hatfield, B. D. (2004). Cerebral cortical adaptations associated with visuomotor practice. Medicine and Science in Sports and Exercise, 36(1), 118–129. https://doi.org/10.1249/01.MSS.0000106176.31784.D4
  • Kong, F. (2019). Development of metric method and framework model of integrated complexity evaluations of production process for ergonomics workstations. International Journal of Production Research, 57(8), 2429–2445. https://doi.org/10.1080/00207543.2018.1519266
  • Kopp, T., Baumgartner, M., & Kinkel, S. (2021). Success factors for introducing industrial human–robot interaction in practice: An empirically driven framework. The International Journal of Advanced Manufacturing Technology, 112(3–4), 685–704. https://doi.org/10.1007/s00170-020-06398-0
  • Kramer, M. (2004). Automatic model selection in the mixed models framework [Paper presentation]. Proceedings, 16th Annual Kansas State University Conference on Applied Statistics in Agriculture. https://doi.org/10.4148/2475-7772.1155
  • Krejtz, K., Duchowski, A. T., Niedzielska, A., Biele, C., & Krejtz, I. (2018). Eye tracking cognitive load using pupil diameter and microsaccades with fixed gaze. PLOS One, 13(9), e0203629. https://doi.org/10.1371/journal.pone.0203629
  • Kruijff, G.-J M., Pirri, F., Gianni, M., Papadakis, P., Pizzoli, M., Sinha, A., Tretyakov, V., Linder, T., Pianese, E., & Corrao, S. (2012). Rescue robots at earthquake-hit Mirandola, Italy: A field report. In 2012 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR). https://doi.org/10.1109/SSRR.2012.6523866
  • Land, M. F. (1998). The visual control of steering. Vision and Action, 28, 168–180.
  • Lehtonen, E., Lappi, O., Koirikivi, I., & Summala, H. (2014). Effect of driving experience on anticipatory look-ahead fixations in real curve driving. Accident; Analysis and Prevention, 70, 195–208. https://doi.org/10.1016/j.aap.2014.04.002
  • Li, L. (2022). Reskilling and upskilling the future-ready workforce for Industry 4.0 and beyond. Information Systems Frontiers, 1–16. https://doi.org/10.1007/s10796-022-10308-y
  • Li, L., Chen, R., & Chen, J. (2016). Playing action video games improves visuomotor control. Psychological Science, 27(8), 1092–1108. https://doi.org/10.1177/0956797616650300
  • Li, L., Sweet, B. T., & Stone, L. S. (2005). Effect of contrast on the active control of a moving line. Journal of Neurophysiology, 93(5), 2873–2886. https://doi.org/10.1152/jn.00200.2004
  • Liu, Y., & Wickens, C. D. (1994). Mental workload and cognitive task automaticity: An evaluation of subjective and time estimation metrics. Ergonomics, 37(11), 1843–1854. https://doi.org/10.1080/00140139408964953
  • Lohani, M., Payne, B. R., & Strayer, D. L. (2019). A review of psychophysiological measures to assess cognitive states in real-world driving. Frontiers in Human Neuroscience, 13, 57. https://doi.org/10.3389/fnhum.2019.00057
  • Luinge, H. J., & Veltink, P. H. (2005). Measuring orientation of human body segments using miniature gyroscopes and accelerometers. Medical & Biological Engineering & Computing, 43(2), 273–282. https://doi.org/10.1007/BF02345966
  • Manka, M. (2022). Developing an efficient real-time terrestrial infrastructure inspection system using autonomous drones and deep learning.
  • Markkula, G., Benderius, O., & Wahde, M. (2014). Comparing and validating models of driver steering behaviour in collision avoidance and vehicle stabilisation. Vehicle System Dynamics, 52(12), 1658–1680. https://doi.org/10.1080/00423114.2014.954589
  • MatLab, P. (2020). 9.9. 0.1495850 (R2020b). The MathWorks Inc.
  • Maza, I., Caballero, F., Molina, R., Peña, N., & Ollero, A. (2010). Multimodal interface technologies for UAV ground control stations: A comparative analysis. In Selected Papers from the 2nd International Symposium on UAVs, Reno, Nevada, USA June 8–10, 2009 (pp. 371–391). Springer.
  • Merceron, A., Blikstein, P., & Siemens, G. (2016). Learning analytics: From big data to meaningful data. Journal of Learning Analytics, 2(3), 4–8. https://doi.org/10.18608/jla.2015.23.2
  • Mole, C. D., Kountouriotis, G., Billington, J., & Wilkie, R. M. (2016). Optic flow speed modulates guidance level control: New insights into two-level steering. Journal of Experimental Psychology: Human Perception and Performance, 42(11), 1818. https://doi.org/10.1037/xhp0000256
  • Mu, S., Cui, M., & Huang, X. (2020). Multimodal data fusion in learning analytics: A systematic review. Sensors, 20(23), 6856. https://doi.org/10.3390/s20236856
  • Nakano, H., Osumi, M., Ueta, K., Kodama, T., & Morioka, S. (2013). Changes in electroencephalographic activity during observation, preparation, and execution of a motor learning task. The International Journal of Neuroscience, 123(12), 866–875. https://doi.org/10.3109/00207454.2013.813509
  • Olivares-Figueroa, J. D., Cruz-Vega, I., Ramírez-Cortés, J., Gómez-Gil, P., & Martínez-Carranza, J. (2021). A compact approach for emotional assessment of drone pilots using BCI.
  • Pacaux-Lemoine, M.-P., & Trentesaux, D. (2019). Ethical risks of human–machine symbiosis in industry 4.0: Insights from the human–machine cooperation approach. IFAC-PapersOnLine, 52(19), 19–24. https://doi.org/10.1016/j.ifacol.2019.12.077
  • Park, J., Park, J., Shin, D., & Choi, Y. (2021). A BCI based alerting system for attention recovery of UAV operators. Sensors, 21(7), 2447. https://doi.org/10.3390/s21072447
  • Peißl, S., Wickens, C. D., & Baruah, R. (2018). Eye-tracking measures in aviation: A selective literature review. The International Journal of Aerospace Psychology, 28(3–4), 98–112. https://doi.org/10.1080/24721840.2018.1514978
  • Peng, X., Stone, L. S., & Li, L. (2010). Humans can control heading independent of visual path information. Journal of Vision, 8(6), 1160–1160. https://doi.org/10.1167/8.6.1160
  • Peysakhovich, V., Vachon, F., Vallières, B. R., Dehais, F., & Tremblay, S. (2015). Pupil dilation and eye movements can reveal upcoming choice in dynamic decision-making. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting. https://doi.org/10.1177/1541931215591043
  • Pfeiffer, C., & Scaramuzza, D. (2021). Human-piloted drone racing: Visual processing and control. IEEE Robotics and Automation Letters, 6(2), 3467–3474. https://doi.org/10.1109/LRA.2021.3064282
  • Pham, T., Tezza, D., & Andujar, M. (2020). Enhancing drone pilots’ engagement through a brain-computer interface. In International Conference on Human–Computer Interaction.
  • Plazak, J., DiGiovanni, D. A., Collins, D. L., & Kersten-Oertel, M. (2019). Cognitive load associations when utilizing auditory display within image-guided neurosurgery. International Journal of Computer Assisted Radiology and Surgery, 14(8), 1431–1438. https://doi.org/10.1007/s11548-019-01970-w
  • Poldrack, R. A., Sabb, F. W., Foerde, K., Tom, S. M., Asarnow, R. F., Bookheimer, S. Y., & Knowlton, B. J. (2005). The neural correlates of motor skill automaticity. The Journal of Neuroscience, 25(22), 5356–5364. https://doi.org/10.1523/JNEUROSCI.3880-04.2005
  • Polfreman, R. (2018). Hand posture recognition: IR, sEMG and IMU. In Proceedings of the Conference on New Interfaces for Musical Expression 2018, Blacksburg, VA, 6.
  • Posner, M. I. (1975). Psychobiology of attention. In M. S. Gazzaniga & C. Blakemore (Eds.), Handbook of psychobiology (pp. 441–480). Academic Press.
  • Qiao, H., Tahara, A., Nakphu, N., & Iramina, K. (2022). Using mean pupil diameter change to analyze behavioral performance in multitasking training game. In 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC). https://doi.org/10.1109/EMBC48229.2022.9871751
  • Ramautar, J. R., Romeijn, N., Gómez-Herrero, G., Piantoni, G., & Van Someren, E. J. (2013). Coupling of infraslow fluctuations in autonomic and central vigilance markers: Skin temperature, EEG beta power and ERP P300 latency. International Journal of Psychophysiology, 89(2), 158–164. https://doi.org/10.1016/j.ijpsycho.2013.01.001
  • Razafimahazo, E., De Saqui-Sannes, P., Vingerhoeds, R. A., Baron, C., Soulax, J., & Mège, R. (2021). Mastering complexity for indoor inspection drone development. in 2021 IEEE International Symposium on Systems Engineering (ISSE). https://doi.org/10.1109/ISSE51541.2021.9582483
  • Ribeiro, R., Ramos, J., Safadinho, D., Reis, A., Rabadão, C., Barroso, J., & Pereira, A. (2021). Web AR solution for UAV pilot training and usability testing. Sensors, 21(4), 1456. https://doi.org/10.3390/s21041456
  • Rioult-Pedotti, M.-S., Friedman, D., & Donoghue, J. P. (2000). Learning-induced LTP in neocortex. Science, 290(5491), 533–536. https://doi.org/10.1126/science.290.5491.533
  • Rizzi, E., Jagacinski, R. J., & Bloom, B. J. (2021). Spatio-temporal flexibility of attention inferred from drivers’ steering movements. Journal of Motor Behavior, 53(6), 758–769. https://doi.org/10.1080/00222895.2020.1868968
  • Rode, C., Robson, R., Purviance, A., Geary, D. C., & Mayr, U. (2014). Is working memory training effective? A study in a school setting. PLOS One, 9(8), e104796. https://doi.org/10.1371/journal.pone.0104796
  • Rohde, T. E., & Thompson, L. A. (2007). Predicting academic achievement with cognitive ability. Intelligence, 35(1), 83–92. https://doi.org/10.1016/j.intell.2006.05.004
  • Roldán-Gómez, J. J., González-Gironda, E., & Barrientos, A. (2021). A survey on robotic technologies for forest firefighting: Applying drone swarms to improve firefighters’ efficiency and safety. Applied Sciences, 11(1), 363. https://doi.org/10.3390/app11010363
  • Roy, R. N., Bovo, A., Gateau, T., Dehais, F., & Chanel, C. P. C. (2016). Operator engagement during prolonged simulated UAV operation. IFAC-PapersOnLine, 49(32), 171–176. https://doi.org/10.1016/j.ifacol.2016.12.209
  • Rupp, M. A., Oppold, P., & McConnell, D. S. (2013). Comparing the performance, workload, and usability of a gamepad and joystick in a complex task. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting. https://doi.org/10.1177/1541931213571398
  • Sakib, M. N., Chaspari, T., & Behzadan, A. H. (2021). Physiological data models to understand the effectiveness of drone operation training in immersive virtual reality. Journal of Computing in Civil Engineering, 35(1), 04020053. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000941
  • Salvucci, D. D., & Gray, R. (2004). A two-point visual control model of steering. Perception, 33(10), 1233–1248. https://doi.org/10.1068/p5343
  • Sano, A., Taylor, S., McHill, A. W., Phillips, A. J., Barger, L. K., Klerman, E., & Picard, R. (2018). Identifying objective physiological markers and modifiable behaviors for self-reported stress and mental health status using wearable sensors and mobile phones: Observational study. Journal of Medical Internet Research, 20(6), e210. https://doi.org/10.2196/jmir.9410
  • Schmidt, R., Schadow, J., Eißfeldt, H., & Pecena, Y. (2022). Insights on remote pilot competences and training needs of civil drone pilots. Transportation Research Procedia, 66, 1–7. https://doi.org/10.1016/j.trpro.2022.12.001
  • Schmidt, E. A., Schrauf, M., Simon, M., Fritzsche, M., Buchner, A., & Kincses, W. E. (2009). Drivers’ misjudgement of vigilance state during prolonged monotonous daytime driving. Accident; Analysis and Prevention, 41(5), 1087–1093. https://doi.org/10.1016/j.aap.2009.06.007
  • Schwab, K., & Zahidi, S. (2020). The future of jobs report 2020. Retrieved from https://www3.weforum.org/docs/WEF_Future_of_Jobs_2020.pdf
  • Senoussi, M., Verdiere, K. J., Bovo, A., Chanel, C. P. C., Dehais, F., & Roy, R. N. (2017). Pre-stimulus antero-posterior EEG connectivity predicts performance in a UAV monitoring task. In 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).
  • Sheikholeslami, C., Yuan, H., He, E. J., Bai, X., Yang, L., & He, B. (2007). A high resolution EEG study of dynamic brain activity during video game play. In 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. https://doi.org/10.1109/IEMBS.2007.4352833
  • Shipstead, Z., Redick, T. S., & Engle, R. W. (2012). Is working memory training effective? Psychological Bulletin, 138(4), 628–654. https://doi.org/10.1037/a0027473
  • Sibley, C., Coyne, J., & Baldwin, C. (2011). Pupil dilation as an index of learning. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting. https://doi.org/10.1177/1071181311551049
  • Sibley, C., Coyne, J., Cole, A., Gibson, G., Baldwin, C., Roberts, D., & Barrow, J. (2010). Adaptive training in an unmanned aerial vehicle: Examination of several candidate realtime metrics. In Applied human factors and ergonomics. Taylor & Francis.
  • Smith, M. E., McEvoy, L. K., & Gevins, A. (1999). Neurophysiological indices of strategy development and skill acquisition. Brain Research. Cognitive Brain Research, 7(3), 389–404. https://doi.org/10.1016/s0926-6410(98)00043-3
  • Tanaka, H., Hayashi, M., & Hori, T. (1996). Statistical features of hypnagogic EEG measured by a new scoring system. Sleep, 19(9), 731–738. https://doi.org/10.1093/sleep/19.9.731
  • Tanaka, H., Hayashi, M., & Hori, T. (1997). Topographical characteristics and principal component structure of the hypnagogic EEG. Sleep, 20(7), 523–534. https://doi.org/10.1093/sleep/20.7.523
  • Tezza, D., Laesker, D., & Andujar, M. (2021). The learning experience of becoming a FPV drone pilot. In Companion of the 2021 ACM/IEEE International Conference on Human–Robot Interaction. https://doi.org/10.1145/3434074.3447167
  • Tichon, J. G., Mavin, T., Wallis, G., Visser, T. A., & Riek, S. (2014). Using pupillometry and electromyography to track positive and negative affect during flight simulation. Aviation Psychology and Applied Human Factors, 4(1), 23–32. https://doi.org/10.1027/2192-0923/a000052
  • TobiiConnect (2022). How to calibrate and validate in Tobii Pro Lab. Retrieved from https://connect.tobii.com/s/article/how-to-calibrate-and-validate-in-tobii-pro-lab?language=en_US
  • Travis, F., & Shear, J. (2010). Focused attention, open monitoring and automatic self-transcending: Categories to organize meditations from Vedic, Buddhist and Chinese traditions. Consciousness and Cognition, 19(4), 1110–1118. https://doi.org/10.1016/j.concog.2010.01.007
  • Unsworth, N., Heitz, R. P., Schrock, J. C., & Engle, R. W. (2005). An automated version of the operation span task. Behavior Research Methods, 37(3), 498–505. https://doi.org/10.3758/bf03192720
  • Van de Pol, M., & Wright, J. (2009). A simple method for distinguishing within-versus between-subject effects using mixed models. Animal Behaviour, 77(3), 753–758. https://doi.org/10.1016/j.anbehav.2008.11.006
  • van der Wel, P., & van Steenbergen, H. (2018). Pupil dilation as an index of effort in cognitive control tasks: A review. Psychonomic Bulletin & Review, 25(6), 2005–2015. https://doi.org/10.3758/s13423-018-1432-y
  • Van Dongen, H. P., Olofsen, E., Dinges, D. F., & Maislin, G. (2004). Mixed-model regression analysis and dealing with interindividual differences. Methods in Enzymology, 384, 139–171. https://doi.org/10.1016/S0076-6879(04)84010-2
  • van Winsum, W., De Waard, D., & Brookhuis, K. A. (1999). Lane change manoeuvres and safety margins. Transportation Research Part F: Traffic Psychology and Behaviour, 2(3), 139–149. https://doi.org/10.1016/S1369-8478(99)00011-X
  • Weiss, A., Wortmeier, A.-K., & Kubicek, B. (2021). Cobots in Industry 4.0: A roadmap for future practice studies on human–robot collaboration. IEEE Transactions on Human–Machine Systems, 51(4), 335–345. https://doi.org/10.1109/THMS.2021.3092684
  • Willingham, D. B. (1999). The neural basis of motor-skill learning. Current Directions in Psychological Science, 8(6), 178–182. https://doi.org/10.1111/1467-8721.00042
  • Wong, S. W., Chan, R. H., & Mak, J. N. (2014). Spectral modulation of frontal EEG during motor skill acquisition: A mobile EEG study. International Journal of Psychophysiology, 91(1), 16–21. https://doi.org/10.1016/j.ijpsycho.2013.09.004
  • Zhang, C., Zou, Y., Wang, F., del Rey Castillo, E., Dimyadi, J., & Chen, L. (2022). Towards fully automated unmanned aerial vehicle-enabled bridge inspection: Where are we at? Construction and Building Materials, 347, 128543. https://doi.org/10.1016/j.conbuildmat.2022.128543
  • Zhao, Y., Chevrel, P., Claveau, F., & Mars, F. (2020, October). Towards a driver model to clarify cooperation between drivers and haptic guidance systems. In 2020 IEEE International Conference on Systems, Man, and Cybernetics (SMC) (pp. 1731–1737). IEEE. https://doi.org/10.1109/SMC42975.2020.9283101
  • Zhu, F. F., Maxwell, J. P., Hu, Y., Zhang, Z. G., Lam, W., Poolton, J. M., & Masters, R. S. (2010). EEG activity during the verbal-cognitive stage of motor skill acquisition. Biological Psychology, 84(2), 221–227. https://doi.org/10.1016/j.biopsycho.2010.01.015

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.