EEG and fNIRS are associated with situation awareness (hazard) prediction during a driving task

References

• Bari, V., P. Calcagnile, E. Molteni, R. Re, D. Contini, L. Spinelli, M. Caffini, A. Torricelli, R. Cubeddu, and S. Cerutti. 2011. “Study of Neurovascular and Autonomic Response in a Divided Attention Test by Means of EEG, ECG and NIRS Signals.” 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 1403–1406. https://ieeexplore.ieee.org/abstract/document/6090330/
   Google Scholar
• Bazanova, O.M., and D. Vernon. 2014. “Interpreting EEG Alpha Activity.” Neuroscience & Biobehavioral Reviews 44: 94–110. doi:10.1016/j.neubiorev.2013.05.007.
   PubMed Web of Science ®Google Scholar
• Berka, C., D.J. Levendowski, M.N. Lumicao, A. Yau, G. Davis, V.T. Zivkovic, R.E. Olmstead, P.D. Tremoulet, and P.L. Craven. 2007. “EEG Correlates of Task Engagement and Mental Workload in Vigilance, Learning, and Memory Tasks.” Aviation, Space, and Environmental Medicine 78 (5 Suppl): B231–B244.
   PubMedGoogle Scholar
• Bolstad, C.A., and M.R. Endsley. 2003. “Measuring Shared and Team Situation Awareness in the Army’s Future Objective Force.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 47 (3): 369–373. doi:10.1177/154193120304700325.
   Google Scholar
• Catherwood, D., G.K. Edgar, D. Nikolla, C. Alford, D. Brookes, S. Baker, and S. White. 2014. “Mapping Brain Activity during Loss of Situation Awareness: An EEG Investigation of a Basis for Top-Down Influence on Perception.” Human Factors 56 (8): 1428–1452. doi:10.1177/0018720814537070.
   PubMed Web of Science ®Google Scholar
• Cavanagh, J.F., and M.J. Frank. 2014. “Frontal Theta as a Mechanism for Cognitive Control.” Trends in Cognitive Sciences 18 (8): 414–421. doi:10.1016/j.tics.2014.04.012.
   PubMed Web of Science ®Google Scholar
• Chikhi, S., N. Matton, and S. Blanchet. 2022. “EEG Power Spectral Measures of Cognitive Workload: A Meta‐Analysis.” Psychophysiology 59 (6): e14009. doi:10.1111/psyp.14009.
   PubMed Web of Science ®Google Scholar
• Crundall, D. 2016. “Hazard Prediction Discriminates between Novice and Experienced Drivers.” Accident Analysis & Prevention 86: 47–58. doi:10.1016/j.aap.2015.10.006.
   PubMed Web of Science ®Google Scholar
• Crundall, D., and V. Kroll. 2018. “Prediction and Perception of Hazards in Professional Drivers_Does Hazard Perception Skill Differ between Safe and Less-Safe Fire-Appliance Drivers? | Elsevier Enhanced Reader.” Accident Analysis & Prevention 121: 335–346. doi:10.1016/j.aap.2018.05.013.
   PubMed Web of Science ®Google Scholar
• Crundall, D., E. Van Loon, T. Baguley, and V. Kroll. 2021. “A Novel Driving Assessment Combining Hazard Perception, Hazard Prediction and Theory Questions.” Accident Analysis & Prevention 149: 105847. doi:10.1016/j.aap.2020.105847.
   PubMed Web of Science ®Google Scholar
• Currie, L. 1969. “The Perception of Danger in a Simulated Driving Task.” Ergonomics 12 (6): 841–849. doi:10.1080/00140136908931101.
   PubMed Web of Science ®Google Scholar
• Delorme, A., and S. Makeig. 2004. “EEGLAB: An Open Source Toolbox for Analysis of Single-Trial EEG Dynamics Including Independent Component Analysis.” Journal of Neuroscience Methods 134 (1): 9–21. doi:10.1016/j.jneumeth.2003.10.009.
   PubMed Web of Science ®Google Scholar
• Endsley, M.R. 1988. “Design and Evaluation for Situation Awareness Enhancement.” Proceedings of the Human Factors Society Annual Meeting 32 (2): 97–101. doi:10.1177/154193128803200221.
   Google Scholar
• Endsley, M.R. 1993. “Situation Awareness and Workload-Flip Sides of the Same Coin.” 7th International Symposium on Aviation Psychology, Columbus, OH, USA, 906–911.
   Google Scholar
• Endsley, M.R. 1995a. “Measurement of Situation Awareness in Dynamic Systems.” Human Factors 37 (1): 65–84.
   Web of Science ®Google Scholar
• Endsley, M.R. 1995b. “Toward a Theory of Situation Awareness in Dynamic Systems.” Human Factors 37 (1): 32–64. doi:10.1518/001872095779049543.
   Web of Science ®Google Scholar
• Endsley, M.R. 2013. “Situation Awareness-Oriented Design.” In The Oxford Handbook of Cognitive Engineering, edited by J.D. Lee and A. Kirlik, 272–285. New York: Oxford University Press. https://books.google.com/books?hl=en&lr=&id=13KlHVBoNRAC&oi=fnd&pg=PP2&dq=The+Oxford+Handbook+of+Cognitive+Engineering+&ots=o-jSzV-lfU&sig=r64j-Wzmmh8cqCQz-RDWy7wgecI
   Google Scholar
• Endsley, M.R. 2015. “Situation Awareness Misconceptions and Misunderstandings.” Journal of Cognitive Engineering and Decision Making 9 (1): 4–32. doi:10.1177/1555343415572631.
   Web of Science ®Google Scholar
• Endsley, M.R. 2021a. “A Systematic Review and Meta-Analysis of Direct Objective Measures of Situation Awareness: A Comparison of SAGAT and SPAM.” Human Factors 63 (1): 124–150.
   PubMed Web of Science ®Google Scholar
• Endsley, M.R. 2021b. Situation Awareness Measurement: How to Measure Situation Awareness in Individuals and Teams. Washington, DC: Human Factors and Ergonomics Society.
   Google Scholar
• Gola, M., M. Magnuski, I. Szumska, and A. Wróbel. 2013. “EEG Beta Band Activity is Related to Attention and Attentional Deficits in the Visual Performance of Elderly Subjects.” International Journal of Psychophysiology 89 (3): 334–341. doi:10.1016/j.ijpsycho.2013.05.007.
   PubMed Web of Science ®Google Scholar
• Greenlee, E.T., P.R. DeLucia, and D.C. Newton. 2018. “Driver Vigilance in Automated Vehicles: Hazard Detection Failures Are a Matter of Time.” Human Factors 60 (4): 465–476. doi:10.1177/0018720818761711.
   PubMed Web of Science ®Google Scholar
• Hankins, T.C., and G.F. Wilson. 1998. “A Comparison of Heart Rate, Eye Activity, EEG and Subjective Measures of Pilot Mental Workload during Flight.” Aviation, Space, and Environmental Medicine 69 (4): 360–367.
   PubMed Web of Science ®Google Scholar
• Harmony, T., T. Fernández, J. Silva, J. Bernal, L. Díaz-Comas, A. Reyes, E. Marosi, M. Rodríguez, and M. Rodríguez. 1996. “EEG delta activity: an indicator of attention to internal processing during performance of mental tasks.” International Journal of Psychophysiology 24 (1-2): 161–171. https://doi.org/10.1016/S0167-8760(96)00053-0.
   Google Scholar
• Hasan, M.M., C.N. Watling, and G.S. Larue. 2022. “Physiological Signal-Based Drowsiness Detection Using Machine Learning: Singular and Hybrid Signal Approaches.” Journal of Safety Research 80: 215–225. doi:10.1016/j.jsr.2021.12.001.
   PubMed Web of Science ®Google Scholar
• Hasan, M.M., C.N. Watling, and G.S. Larue. 2024. “Validation and Interpretation of a Multimodal Drowsiness Detection System Using Explainable Machine Learning.” Computer Methods and Programs in Biomedicine 243: 107925. doi:10.1016/j.cmpb.2023.107925.
   PubMed Web of Science ®Google Scholar
• Hirshfield, L., M. Costa, D. Bandara, and S. Bratt. 2015. “Measuring Situational Awareness Aptitude Using Functional near-Infrared Spectroscopy.” International Conference on Augmented Cognition, 244–255.
   Google Scholar
• Horswill, M.S., and F.P. McKenna. 2004. “Drivers’ Hazard Perception Ability: Situation Awareness on the Road.” In A Cognitive Approach to Situation Awareness: Theory and Application, edited by S. Banbury & S. Tremblay, 155–175. Aldershot, UK: Ashgate Publishing.
   Google Scholar
• Jones, D.G., E.M. Quoetone, J.T. Ferree, M.A. Magsig, and W.F. Bunting. 2003. “An Initial Investigation into the Cognitive Processes Underlying Mental Projection.” Proceedings of the Human Factors and Ergonomics Society Annual Meeting 47 (3): 596–600. doi:10.1177/154193120304700372.
   Google Scholar
• Kästle, J.L., B. Anvari, J. Krol, and H.A. Wurdemann. 2021. “Correlation between Situational Awareness and EEG Signals.” Neurocomputing 432: 70–79. doi:10.1016/j.neucom.2020.12.026.
   Web of Science ®Google Scholar
• Kaur, A., R. Chaujar, and V. Chinnadurai. 2020. “Effects of Neural Mechanisms of Pretask Resting EEG Alpha Information on Situational Awareness: A Functional Connectivity Approach.” Human Factors 62 (7): 1150–1170. doi:10.1177/0018720819869129.
   PubMed Web of Science ®Google Scholar
• Kecklund, G., and T. Akerstedt. 1993. “Sleepiness in Long Distance Truck Driving: An Ambulatory EEG Study of Night Driving.” Ergonomics 36 (9): 1007–1017. doi:10.1080/00140139308967973.
   PubMed Web of Science ®Google Scholar
• Klimesch, W. 1999. “EEG Alpha and Theta Oscillations Reflect Cognitive and Memory Performance: A Review and Analysis.” Brain Research. Brain Research Reviews 29 (2–3): 169–195. doi:10.1016/S0165-0173(98)00056-3.
   PubMed Web of Science ®Google Scholar
• Kohlmorgen, J., G. Dornhege, M.L. Braun, B. Blankertz, K.-R. Müller, G. Curio, K. Hagemann, A. Bruns, M. Schrauf, and W.E. Kincses. 2007. Improving Human Performance in a Real Operating Environment through Real-Time Mental Workload Detection. https://direct.mit.edu/books/edited-volume/chapter-pdf/2290028/9780262256049_cax.pdf
   Google Scholar
• Konstantopoulos, P., P. Chapman, and D. Crundall. 2010. “Driver’s Visual Attention as a Function of Driving Experience and Visibility. Using a Driving Simulator to Explore Drivers’ Eye Movements in Day, Night and Rain Driving.” Accident Analysis & Prevention 42 (3): 827–834. doi:10.1016/j.aap.2009.09.022.
   PubMed Web of Science ®Google Scholar
• Li, Q., K.K. Ng, C.M. Simon, C.Y. Yiu, and M. Lyu. 2023. “Recognising Situation Awareness Associated with Different Workloads Using EEG and Eye-Tracking Features in Air Traffic Control Tasks.” Knowledge-Based Systems 260: 110179. doi:10.1016/j.knosys.2022.110179.
   Web of Science ®Google Scholar
• Liu, Z., M. Zhang, G. Xu, C. Huo, Q. Tan, Z. Li, and Q. Yuan. 2017. “Effective Connectivity Analysis of the Brain Network in Drivers during Actual Driving Using Near-Infrared Spectroscopy.” Frontiers in Behavioral Neuroscience 11: 211. doi:10.3389/fnbeh.2017.00211.
   PubMed Web of Science ®Google Scholar
• Maris, E., and R. Oostenveld. 2007. “Nonparametric Statistical Testing of EEG-and MEG-Data.” Journal of Neuroscience Methods 164 (1): 177–190. doi:10.1016/j.jneumeth.2007.03.024.
   PubMed Web of Science ®Google Scholar
• Mars, R.B., S. Debener, T.E. Gladwin, L.M. Harrison, P. Haggard, J.C. Rothwell, and S. Bestmann. 2008. “Trial-by-Trial Fluctuations in the Event-Related Electroencephalogram Reflect Dynamic Changes in the Degree of Surprise.” Journal of Neuroscience 28 (47): 12539–12545.
   PubMed Web of Science ®Google Scholar
• McKenna, F.P., and J.L. Crick. 1991. Hazard Perception in Drivers: A Methodology for Testing and Training. Reading, UK: University of Reading, Transport and Road Research Laboratory.
   Google Scholar
• Molle, M., L. Marshall, R. Pietrowsky, W. Lutzenberger, H.L. Fehm, and J. Born. 1995. “Dimensional Complexity of the EEG Indicates a Right Fronto-Cortical Locus of Attentional Control.” Journal of Psychophysiology 9 (1): 45–55.
   Web of Science ®Google Scholar
• Muela, I., A.B. Chica, P. Garcia-Fernandez, and C. Castro. 2021. “Visual Attention in Realistic Driving Situations: Attentional Capture and Hazard Prediction.” Applied Ergonomics 90: 103235. doi:10.1016/j.apergo.2020.103235.
   PubMed Web of Science ®Google Scholar
• Oostenveld, R., P. Fries, E. Maris, and J.-M. Schoffelen. 2011. “FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data.” Computational Intelligence and Neuroscience 2011: 156869. doi:10.1155/2011/156869.
   PubMed Web of Science ®Google Scholar
• Orino, Y., K. Yoshino, N. Oka, K. Yamamoto, H. Takahashi, and T. Kato. 2015. “Brain Activity Involved in Vehicle Velocity Changes in a Sag Vertical Curve on an Expressway: Vector-Based Functional near-Infrared Spectroscopy Study.” Transportation Research Record: Journal of the Transportation Research Board 2518 (1): 18–26. doi:10.3141/2518-03.
   Google Scholar
• Papadelis, C., Z. Chen, C. Kourtidou-Papadeli, P.D. Bamidis, I. Chouvarda, E. Bekiaris, and N. Maglaveras. 2007. “Monitoring Sleepiness with on-Board Electrophysiological Recordings for Preventing Sleep-Deprived Traffic Accidents.” Clinical Neurophysiology 118 (9): 1906–1922. doi:10.1016/j.clinph.2007.04.031.
   PubMed Web of Science ®Google Scholar
• Parmet, Y., A. Borowsky, O. Yona, and T. Oron-Gilad. 2015. “Driving Speed of Young Novice and Experienced Drivers in Simulated Hazard Anticipation Scenes.” Human Factors 57 (2): 311–328. doi:10.1177/0018720814548220.
   PubMed Web of Science ®Google Scholar
• Pelz, D.C., and E. Krupat. 1974. “Caution Profile and Driving Record of Undergraduate Males.” Accident Analysis & Prevention 6 (1): 45–58. doi:10.1016/0001-4575(74)90015-3.
   Google Scholar
• Schacter, D.L. 1977. “EEG Theta Waves and Psychological Phenomena: A Review and Analysis.” Biological Psychology 5 (1): 47–82. doi:10.1016/0301-0511(77)90028-x.
   PubMed Web of Science ®Google Scholar
• Schier, M.A. 2000. “Changes in EEG Alpha Power during Simulated Driving: A Demonstration.” International Journal of Psychophysiology 37 (2): 155–162. doi:10.1016/S0167-8760(00)00079-9.
   PubMed Web of Science ®Google Scholar
• Schmidt, E.A., M. Schrauf, M. Simon, M. Fritzsche, A. Buchner, and W.E. Kincses. 2009. “Drivers’ Misjudgement of Vigilance State during Prolonged Monotonous Daytime Driving.” Accident Analysis & Prevention 41 (5): 1087–1093. doi:10.1016/j.aap.2009.06.007.
   PubMed Web of Science ®Google Scholar
• Schwab, D., M. Benedek, I. Papousek, E.M. Weiss, and A. Fink. 2014. “The Time-Course of EEG Alpha Power Changes in Creative Ideation.” Frontiers in Human Neuroscience 8: 310. doi:10.3389/fnhum.2014.00310.
   PubMed Web of Science ®Google Scholar
• Sciaraffa, N., G. Di Flumeri, D. Germano, A. Giorgi, A. Di Florio, G. Borghini, A. Vozzi, V. Ronca, R. Varga, M. van Gasteren, F. Babiloni, and P. Aricò. 2022. “Validation of a Light EEG-Based Measure for Real-Time Stress Monitoring during Realistic Driving.” Brain Sciences 12 (3): 304. doi:10.3390/brainsci12030304.
   PubMed Web of Science ®Google Scholar
• Sheth, S.A., M. Nemoto, M.W. Guiou, M.A. Walker, and A.W. Toga. 2005. “Spatiotemporal Evolution of Functional Hemodynamic Changes and Their Relationship to Neuronal Activity.” Journal of Cerebral Blood Flow & Metabolism 25 (7): 830–841. doi:10.1038/sj.jcbfm.9600091.
   PubMed Web of Science ®Google Scholar
• Shimizu, S., N. Takahashi, H. Inoue, H. Nara, F. Miwakeichi, N. Hirai, S. Kikuchi, E. Watanabe, and S. Kato. 2011. “Basic Study for a New Assistive System Based on Brain Activity Associated with Spatial Perception Task during Car Driving.” 2011 IEEE International Conference on Robotics and Biomimetics, 2884–2889. https://ieeexplore.ieee.org/abstract/document/6181743/
   Google Scholar
• Simon, M., E.A. Schmidt, W.E. Kincses, M. Fritzsche, A. Bruns, C. Aufmuth, M. Bogdan, W. Rosenstiel, and M. Schrauf. 2011. “EEG Alpha Spindle Measures as Indicators of Driver Fatigue under Real Traffic Conditions.” Clinical Neurophysiology 122 (6): 1168–1178. doi:10.1016/j.clinph.2010.10.044.
   PubMed Web of Science ®Google Scholar
• Ahn Son, L., H. Aoki, F. Murase, and K. Ishida. 2018. “A Novel Method for Classifying Driver Cognitive Distraction under Naturalistic Conditions with Information from Near-Infrared Spectroscopy.” Frontiers in Human Neuroscience 12: 431. doi:10.3389/fnhum.2018.00431.
   Web of Science ®Google Scholar
• Sonnleitner, A., M.S. Treder, M. Simon, S. Willmann, A. Ewald, A. Buchner, and M. Schrauf. 2014. “EEG Alpha Spindles and Prolonged Brake Reaction Times during Auditory Distraction in an On-Road Driving Study.” Accident Analysis & Prevention 62: 110–118. doi:10.1016/j.aap.2013.08.026.
   PubMed Web of Science ®Google Scholar
• Stavrinos, D., K. Heaton, S.C. Welburn, B. McManus, R. Griffin, and P.R. Fine. 2016. “Commercial Truck Driver Health and Safety: Exploring Distracted Driving Performance and Self-Reported Driving Skill.” Workplace Health & Safety 64 (8): 369–376. doi:10.1177/2165079915620202.
   PubMed Web of Science ®Google Scholar
• Ventsislavova, P., D. Crundall, T. Baguley, C. Castro, A. Gugliotta, P. Garcia-Fernandez, W. Zhang, Y. Ba, and Q. Li. 2019. “A Comparison of Hazard Perception and Hazard Prediction Tests across China, Spain and the UK.” Accident Analysis & Prevention 122: 268–286. doi:10.1016/j.aap.2018.10.010.
   PubMed Web of Science ®Google Scholar
• Vidulich, M.A., and P.S. Tsang. 2015. “The Confluence of Situation Awareness and Mental Workload for Adaptable Human–Machine Systems.” Journal of Cognitive Engineering and Decision Making 9 (1): 95–97. doi:10.1177/1555343414554805.
   Web of Science ®Google Scholar
• Watling, C.N., M.M. Hasan, and G.S. Larue. 2021. “Sensitivity and Specificity of the Driver Sleepiness Detection Methods Using Physiological Signals: A Systematic Review.” Accident Analysis & Prevention 150: 105900. doi:10.1016/j.aap.2020.105900.
   PubMed Web of Science ®Google Scholar
• Wilson, G.F. 2000. “Strategies for Psychophysiological Assessment of Situation Awareness.” In Situation Awareness Analysis and Measurement, edited by M. R. Endsley & D. J. Garland, 175–188. CRC press.
   Google Scholar
• Wundersitz, L. 2019. “Driver Distraction and Inattention in Fatal and Injury Crashes: Findings from In-Depth Road Crash Data.” Traffic Injury Prevention 20 (7): 696–701. doi:10.1080/15389588.2019.1644627.
   PubMed Web of Science ®Google Scholar
• Yamamoto, K., H. Takahashi, T. Sugimachi, K. Nakano, Y. Suda, and T. Kato. 2018. “The Study of Driver’s Brain Activity and Behavior Using fNIRS during Actual Car Driving.” 2018 11th International Conference on Human System Interaction (HSI), 418–424. https://ieeexplore.ieee.org/abstract/document/8431026/ doi:10.1109/HSI.2018.8431026.
   Google Scholar
• Yoshino, K., N. Oka, K. Yamamoto, H. Takahashi, and T. Kato. 2013a. “Correlation of Prefrontal Cortical Activation with Changing Vehicle Speeds in Actual Driving: A Vector-Based Functional near-Infrared Spectroscopy Study.” Frontiers in Human Neuroscience 7: 895. doi:10.3389/fnhum.2013.00895.
   PubMed Web of Science ®Google Scholar
• Yoshino, K., N. Oka, K. Yamamoto, H. Takahashi, and T. Kato. 2013b. “Functional Brain Imaging Using near-Infrared Spectroscopy during Actual Driving on an Expressway.” Frontiers in Human Neuroscience 7: 882. doi:10.3389/fnhum.2013.00882.
   PubMed Web of Science ®Google Scholar
• Zhou, Y., S. Huang, Z. Xu, P. Wang, X. Wu, and D. Zhang. 2021. “Cognitive Workload Recognition using EEG Signals and Machine Learning: A Review.” IEEE Transactions on Cognitive and Developmental Systems 14 (3): 799–818.
   Web of Science ®Google Scholar