Measuring mental workload with the NASA-TLX needs to examine each dimension rather than relying on the global score: an example with driving

References

• Amalberti, R. 1996. La Conduite des Systèmes à Risques  [The Conduct of Risk Systems]. Paris: Presses Universitaires de France.
   Google Scholar
• Bradley, J. H., R. Paul, and E. Seeman. 2006. “Analyzing the Structure of Expert Knowledge.” Information and Management 43 (1): 77–91.10.1016/j.im.2004.11.009
   Web of Science ®Google Scholar
• Campagne, A., T. Pebayle, and A. Muzet. 2004. “Correlation between Driving Errors and Vigilance Level: Influence of the Driver’s Age.” Physiology & Behavior 80 (4): 515–524.10.1016/j.physbeh.2003.10.004
   PubMed Web of Science ®Google Scholar
• Cegarra, J., and A. Chevalier. 2008. “The use of Tholos Software for Combining Measures of Mental Workload: Toward Theoretical and Methodological Improvements.” Behavior Research Methods 40 (4): 988–1000.10.3758/BRM.40.4.988
   PubMed Web of Science ®Google Scholar
• Cegarra, J., and J.-M. Hoc. 2006. “Cognitive Styles as an Explanation of Experts’ Individual Differences: A Case Study in Computer-assisted Troubleshooting Diagnosis.” International Journal of Human-Computer Studies 64 (2): 123–136.10.1016/j.ijhcs.2005.06.003
   Web of Science ®Google Scholar
• Chanquoy, L., A. Tricot, and J. Sweller. 2007. La Charge Cognitive: Théories et Applications  [The Cognitive Load: Theories and Applications]. Paris: Armand Colin.
   Google Scholar
• Collet, C., P. Averty, and A. Dittmar. 2009. “Autonomic Nervous System and Subjective Ratings of Strain in Air-traffic Control.” Applied Ergonomics 40: 23–32.
   PubMed Web of Science ®Google Scholar
• Collet, C., C. Petit, A. Priez, and A. Dittmar. 2005. “Stroop Color–word Test, Arousal, Electrodermal Activity and Performance in a Critical Driving Situation.” Biological Psychology 69 (2): 195–203.10.1016/j.biopsycho.2004.07.003
   PubMed Web of Science ®Google Scholar
• Damm, L., C. Nachtergaële, M. Meskali, and C. Berthelon. 2011. “The Evaluation of Traditional and Early Driver Training with Simulated Accident Scenarios.” Human Factors: The Journal of the Human Factors and Ergonomics Society 53 (4): 323–337.10.1177/0018720811413765
   PubMed Web of Science ®Google Scholar
• Debue, N., and C. van de Leemput. 2014. “What Does Germane Load Mean? An Empirical Contribution to the Cognitive Load Theory.” Frontiers in Psychology 5: 1099.
   PubMed Web of Science ®Google Scholar
• De Craen, S., D. A. M. Twisk, M. P. Hagenzieker, H. Elffers, and K. A. Brookhuis. 2008. “The Development of a Method to Measure Speed Adaptation to Traffic Complexity: Identifying Novice, Unsafe, and Overconfident Drivers.” Accident Analysis and Prevention 40 (4): 1524–1530.10.1016/j.aap.2008.03.018
   PubMed Web of Science ®Google Scholar
• De Waard, D. 1996. “The Measurement of Drivers’ Mental Workload.” PhD diss., University of Gröningen.
   Google Scholar
• Endsley, M. R. 1995. “Toward a Theory of Situation Awareness in Dynamic Systems.” Human Factors: The Journal of the Human Factors and Ergonomics Society 37 (1): 32–64.10.1518/001872095779049543
   Web of Science ®Google Scholar
• Espié S., P. Gauriat and M. Duraz. 2005. “Driving Simulators Validation: The Issue of Transferability of Results Acquired on Simulator.” In National Advanced Driving Simulator, University of Iowa (Eds) Proc. Driving Simulation Conference DSC North-America’2005, october 30–november 2, 149–156. Orlando, FL: Center for Advanced Transportation Systems Simulation.
   Google Scholar
• Fastenmeier, W. 1995. “Die Verkehrssituation als Analyseeinheit im Verkehrssystem.” [The road traffic situation as analysis unit in the road traffic system.] In Autofahrer und Verkehrssituation Neue Wege zur Bewertung von Sicherheit und Zuverlässigkeit moderner Straßenverkehrssysteme, edited by W. Fastenmeier, 27–78. Cologne: Verlag TÜV Rheinland.
   Google Scholar
• Frieling, E., and C. G. Hoyos. 1978. Fragebogen zur Arbeitsanalyse (FAA) (German version of the Position Analysis Questionnaire). Bern: Huber.
   Google Scholar
• Gaillard, A. W. K. 1993. “Comparing the Concepts of Mental Load and Stress.” Ergonomics 36: 991–1005.10.1080/00140139308967972
   PubMed Web of Science ®Google Scholar
• Galy, E., M. Cariou, and C. Mélan. 2012. “What is the Relationship between Mental Workload Factors and Cognitive Load Types?” International Journal of Psychophysiology 83: 269–275.10.1016/j.ijpsycho.2011.09.023
   PubMed Web of Science ®Google Scholar
• Galy, E., C. Lapalus, J. Paxion, and J. Rivière. 2011. “Quelles Sont les Relations Entre Vigilance, Tension, Charge de Travail Effective et Charge de Travail Subjective Chez des Travailleurs Postés? [What are the Relationships Between Alertness, Tension, Effective Workload, and Subjective Workload by Shiftworkers?]” Paper presented at the Journées d’Etudes en Psychologie Ergonomique (EPIQUE), Nantes, September 5–7.
   Google Scholar
• Galy, E., and C. Mélan. 2015. “Effects of Cognitive Appraisal and Mental Workload Factors on Performance in an Arithmetic Task.” Applied Psychophysiology and Biofeedback 40: 313–325.10.1007/s10484-015-9302-0
   PubMed Web of Science ®Google Scholar
• van Gog, T., F. G. W. C. Paas, and J. J. G. van Merriënboer. 2005. “Uncovering Expertise-related Differences in Troubleshooting Performance: Combining Eye Movement and Concurrent Verbal Protocol Data.” Applied Cognitive Psychology 19 (2): 205–221.10.1002/acp.v19:2
   Web of Science ®Google Scholar
• Hadj-Mabrouk, A., H. Hadj-Mabrouk, and M. Dogui. 2001. “Chronobiologie de la Vigilance Approche d’Application dans le Domaine de la Sécurité Routière [Chronobiology of Alertness: Application Approach in Field of Road Safety].” Recherche-Transports-Sécurité 73: 3–26.10.1016/S0761-8980(01)90035-4
   Google Scholar
• Hart, S. G., and L. E. Staveland. 1988. “Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research.” In Human Mental Workload, edited by P. A. Hancock and N. Meshkati, 139–183. Amsterdam: Elsevier.10.1016/S0166-4115(08)62386-9
   Google Scholar
• Hung, S. Y. 2003. “Expert Versus Novice Use of the Executive Support Systems: An Empirical Study.” Information and Management 40: 1777–1189.
   Web of Science ®Google Scholar
• Koscec, A., and B. Radosević-Vidacek. 2004. “Circadian Components in Energy and Tension and their Relation to Physiological Activation and Performance.” Chronobiology International 21: 673–690.10.1081/CBI-200025980
   PubMed Web of Science ®Google Scholar
• Leplat, J. 2002. “Eléments Pour une Histoire de la Notion de Charge Mentale.” In Charge Mentale: Notion Floue et Vrai Problème [Elements for a Story of mental load. In Mental Load: Fuzzy Concept and Real Problem], edited by M. Jourdan and J. Theureau, 27–40. Toulouse: Octarès.
   Google Scholar
• Leppink, J., F. Paas, C. P. van der Vleuten, T. van Gog, and J. J. van Merrïenboer. 2013. “Development of an Instrument for Measuring Different Types of Cognitive Load.” Behavior Research Methods 45 (4): 1058–1072.10.3758/s13428-013-0334-1
   PubMed Web of Science ®Google Scholar
• Luczak, H., and M. Göbel. 2000. “Signal Processing and Analysis in Application.” In Engineering Psychophysiology: Issues and Applications, edited by R. W. Backs and W. Boucsein, 79–110. Mahwah, NJ: Lawrence Erlbaum Associates.
   Google Scholar
• Matthews, G., D. M. Jones, and A. Graham Chamberlain. 1990. “Refining the Measurement of Mood: The UWIST Mood Adjective Checklist.” British Journal of Psychology 81: 17–42.10.1111/bjop.1990.81.issue-1
   Web of Science ®Google Scholar
• Mazur, L., P. R. Mosaly, M. Jackson, S. X. Chang, K. Deschesne Burkhardt, R. D. Adams, E. L. Jones, et al. 2012. “Quantitative Assessment of Workload and Stressors in Clinical Radiation Oncology.” International Journal of Radiation Oncology Biology Physics 83 (5): 571–576.10.1016/j.ijrobp.2012.01.063
   Web of Science ®Google Scholar
• Meister, D. 1976. Behavioral Foundations of System Development. New York: Wiley.
   Google Scholar
• Mélan, C., and N. Cascino. 2014. “A Multidisciplinary Approach of Workload Assessment in Real-Job Situations: Investigation in the Field of Aerospace Activities.” Frontiers in Psychology 5: 964.
   PubMed Web of Science ®Google Scholar
• Mélan, C., N. Cascino, B. Barthe, and E. Galy. 2012. “Mesurer la Charge de Travail: Une Approche Pluridisciplinaire [Estimating the Workload: A Pluridisciplinary Approach].” In Risques du Travail, la Santé Négociée [In Work Risks, Nagociated Health], edited by C. Courtet and M. Gollac, 189–204. Paris: Editions la Découverte.
   Google Scholar
• Miyake, S. 2001. “Multivariate Workload Evaluation Combining Physiological and Subjective Measures.” International Journal of Psychophysiology 40: 233–238.10.1016/S0167-8760(00)00191-4
   PubMed Web of Science ®Google Scholar
• Paas, F. G. W. C., A. Renkl, and J. Sweller. 2003. “Cognitive Load Theory and Instructional Design: Recent Developments.” Educational Psychologist 38 (1): 1–4.10.1207/S15326985EP3801_1
   Web of Science ®Google Scholar
• Paxion, J., E. Galy, and C. Berthelon. 2015. “Overload Depending on Driving Experience and Situation Complexity: Which Strategies Faced with a Pedestrian Crossing?” Applied Ergonomics 51: 343–349.10.1016/j.apergo.2015.06.014
   PubMed Web of Science ®Google Scholar
• Philip, P., P. Sagaspe, N. Moore, J. Taillard, A. Charles, C. Guilleminault, and B. Bioulac. 2005. “Fatigue, Sleep Restriction and Driving Performance.” Accident Analysis and Prevention 37 (3): 473–478.10.1016/j.aap.2004.07.007
   PubMed Web of Science ®Google Scholar
• Pouliquen-Lardy, L., I. Milleville-Pennel, F. Guillaume, and F. Mars. 2016. “Remote Collaboration in Virtual Reality: Asymmetrical Effects of Task Distribution on Spatial Processing and Mental Workload.” Virtual Reality 20: 213–220.10.1007/s10055-016-0294-8
   Web of Science ®Google Scholar
• Prichard, J. S., R. J. Stratford, and L. A. Bizo. 2011. “Evaluating the Effects of Team-skills Training on subjective workload.” Learning and Instruction 21 (3): 429–440.10.1016/j.learninstruc.2010.06.003
   Web of Science ®Google Scholar
• Reid, G. B., and T. E. Nygren. 1988. “The Subjective Workload Assessment Technique: A Scaling Procedure for Measuring Mental Workload.” In Human Mental Workload, edited by P. A. Hancock and N. Meshkati, 185–218. Amsterdam: Elsevier.10.1016/S0166-4115(08)62387-0
   Google Scholar
• Schnotz, W., and C. Kürschner. 2007. “A Reconsideration of Cognitive Load Theory.” Educational Psychology Review 19: 469–508.10.1007/s10648-007-9053-4
   Web of Science ®Google Scholar
• Schlegel, R. E. 1993. “Driver Mental Workload.” In Automotive Ergonomics, edited by B. Peacock, and W. karwowski, 359–382. London: Taylor & Francis.
   Google Scholar
• Sweller, J. 1988. “Cognitive Load During Problem Solving: Effects on Learning.” Cognitive Science 12: 257–285.10.1207/s15516709cog1202_4
   Web of Science ®Google Scholar
• Sweller, J. 1994. “Cognitive Load Theory, Learning Difficulty, and Instructional Design.” Learning and Instruction 4: 295–312.10.1016/0959-4752(94)90003-5
   Google Scholar
• Sweller, J., J. J. G. van Merriënboer, and F. G. W. C. Paas. 1998. “Cognitive Architecture and Instructional Design.” Educational Psychology Review 10: 251–296.10.1023/A:1022193728205
   Web of Science ®Google Scholar
• Thayer, R. E. 1986. “Activation–Deactivation Adjective Check List: Current Overview and Structural Analysis.” Psychological Reports 58: 607–614.                                                                                                                                                                                                  10.2466/pr0.1986.58.2.607
   Web of Science ®Google Scholar
• Thayer, R. E. 1987. “Problem Perception, Optimism, and Related States as a Function of Time of Day (Diurnal Rhythm) and Moderated Exercise: Two Arousal Systems in Interaction.” Motivation and Emotion 11 (1): 19–36.
   Web of Science ®Google Scholar
• Ucelli, M., C. Mélan, M. Cariou, N. Cascino, and E. Galy. 2011. “Contrôle de Satellite: Relations entre Activité de Travail et Perception de la Charge de Travail en Horaires Atypiques [Control of Satellites: Relationships Between Work Activity and Workload Perception In a Typical Schedules].” Paper presented at the Congrès de la Société Française de Psychologie, Metz, September 7–9.
   Google Scholar
• Verwey, W. B. 2000. “On-line Driver Workload Estimation. Effects of Road Situation and Age on Secondary Task Measures.” Ergonomics 43 (2): 187–209.10.1080/001401300184558
   PubMed Web of Science ®Google Scholar
• Vessey, I. 1994. “The Effect of Information Presentation on Decision Making: A Cost-benefit Analysis.” Information and Management 27: 103–119.10.1016/0378-7206(94)90010-8
   Web of Science ®Google Scholar
• Wickens, C. D. 2002. “Multiple Resources and Performance Prediction.” Theoretical Issues in Ergonomics Science 3: 159–177.10.1080/14639220210123806
   Google Scholar
• Young, M. S., K. A. Brookhuis, C. D. Wickens, and P. A. Hancock. 2015. “State of Science: Mental Workload in Ergonomics.” Ergonomics 58 (1): 1–17.10.1080/00140139.2014.956151
   PubMed Web of Science ®Google Scholar
• Young, M. S., and N. A. Stanton. 2005. “Mental Workload.” In Handbook of Human Factors and Ergonomics Methods, edited by N. A. Stanton, A. Hedge, K. Brookhuis, E. Salas, and H. W. Hendrick. Chap. 39, 343–351. London: Taylor & Francis.
   Google Scholar
• Young, J. Q., R. M. Wachter, O. ten Cate, P. S. O’Sullivan, and D. M. Irby. 2016. “Advancing the Next Generation of Handover Research and Practice with Cognitive Load Theory.” BMJ Quality and Safety 25: 66–70.10.1136/bmjqs-2015-004181
   PubMed Web of Science ®Google Scholar
• Zheng, Y., T. Yin, D. Dong, and S. Fu. 2011. “Using NASA-TLX to Evaluate the Flight Deck Design in Design Phase of Aircraft.” Procedia Engineering 17: 77–83.10.1016/j.proenv.2011.12.013
   Google Scholar