A microworld simulation of dynamic cognition as a test of executive function

References

• Alderman, N., Burgess, P. W., Knight, C., & Henman, C. (2003). Ecological validity of a simplified version of the multiple errands shopping test. Journal of the International Neuropsychological Society, 9(1), 32–44. https://doi.org/10.1017/S1355617703910046
   Web of Science ®Google Scholar
• Andrés, P. (2003). Frontal cortex as the central executive of working memory: Time to revise our view. Cortex, 39(4–5), 871–895. https://doi.org/10.1016/S0010-9452(08)70868-2
   PubMed Web of Science ®Google Scholar
• Andrés, P., & Van der Linden, M. (2002). Are central executive functions working in patients with focal frontal lesions? Neuropsychologia, 40(7), 835–845. https://doi.org/10.1016/S0028-3932(01)00182-8
   PubMed Web of Science ®Google Scholar
• Baddeley, A. D. (1996). Exploring the central executive. Quarterly Journal of Experimental Psychology, 49A, 49(1), 5–28. https://doi.org/10.1080/713755608
   Web of Science ®Google Scholar
• Baggetta, P., & Alexander, P. A. (2016). Conceptualization and operationalization of executive function. Mind, Brain, and Education, 10(1), 10–33. http://dx.doi.org/10.1111/mbe.12100
   Web of Science ®Google Scholar
• Banich, M. T. (2009). Executive function: The search for an integrated account. Current Directions in Psychological Science, 18(2), 89–94. https://doi.org/10.1111/j.1467-8721.2009.01615.x
   Web of Science ®Google Scholar
• Boone, K. B., Ponton, M. O., Gorsuch, R. L., Gonzalez, J. J., & Miller, B. L. (1998). Factor Analysis of four measures of prefrontal lobe functioning. Archives of Clinical Neuropsychology, 13(7), 585–595. https://doi.org/10.1093/arclin/13.7.585
   PubMed Web of Science ®Google Scholar
• Borgnis, F., Baglio, F., Pedroli, E., Rossetto, F., Uccellatore, L., Oliveira, J. A. G., Riva, G., & Cipresso, P. (2022). Available virtual reality-based tools for executive functions: A systematic review. Frontiers in Psychology, 13, 833136. https://doi.org/10.3389/fpsyg.2022.833136
   PubMed Web of Science ®Google Scholar
• Brehmer, B. (1992). Dynamic decision making: Human control of complex systems. Acta Psychologica, 81(3), 211–241. https://doi.org/10.1016/0001-6918(92)90019-A
   PubMed Web of Science ®Google Scholar
• Brehmer, B. (1996). Man as stabilizer of systems: From static snapshots of judgement processes to dynamic decision making. Thinking and Reasoning, 2(2–3), 225–238. https://doi.org/10.1080/135467896394528
   Google Scholar
• Brehmer, B., & Dörner, D. (1993). Experiments with computer-simulated microworlds: Escaping both the narrow straits of the laboratory and the deep blue sea of the field study. Computers in Human Behavior, 9(2–3), 171–184. https://doi.org/10.1016/0747-5632(93)
   Web of Science ®Google Scholar
• Busemeyer, J., & Townsend, J. T. (1993). Decision field theory: A dynamic-cognitive approach to decision making. Psychological Review, 100(3), 432–459. https://doi.org/10.1037/0033-295X.100.3.432
   PubMed Web of Science ®Google Scholar
• Chicchi Giglioli, I. A., Bermejo Vidal, C., & Alcañiz Raya, M. (2019). A virtual versus an augmented reality cooking task based-tools: A behavioral and physiological study on the assessment of executive functions. Frontiers in Psychology, 10, 2529. https://doi.org/10.3389/fpsyg.2019.02529
   PubMedGoogle Scholar
• Conners, C. K. (2000). Conners continuous performance test. Multi-Health Systems Inc.
   Google Scholar
• Conway, A. R. A., Cowan, N., Bunting, M. F., Therriault, D., & Minkoff, S. (2002). A latent variable analysis of working memory capacity, short term memory capacity, processing speed, and general fluid intelligence. Intelligence, 30(2), 163–183. https://doi.org/10.1016/S0160-2896(01)00096-4
   Web of Science ®Google Scholar
• Danner, D., Hagemann, D., Holt, D. V., Hager, M., Schankin, A., Wüstenberg, S., & Funke, J. (2011). Measuring performance in dynamic decision making. Reliability and validity of the Tailorshop simulation. Journal of Individual Differences, 32(4), 225–233. https://doi.org/10.1027/1614-0001/a000055
   Web of Science ®Google Scholar
• Dörner, D., & Güss, C. D. (2022). Computers in Human Behavior Reports, 7, 100222. https://doi.org/10.1016/j.chbr.2022.100222
   Google Scholar
• Duncan, J. (2010). The multiple-demand (MD) system of the primate brain: Mental programs for intelligent behaviour. Trends in Cognitive Sciences, 14(4), 172–179. https://doi.org/10.1016/j.tics.2010.01.004
   PubMed Web of Science ®Google Scholar
• Duncan, J., Emslie, H., Williams, P., Johnson, R., & Freer, C. (1996). Intelligence and the frontal lobe: The organization of goal-directed behavior. Cognitive Psychology, 30(3), 257–303. https://doi.org/10.1006/cogp.1996.0008
   PubMed Web of Science ®Google Scholar
• Edwards, W. (1962). Dynamic decision theory and probabilistic information processing. Human Factors, 4(2), 59–73. https://doi.org/10.1177/001872086200400201
   Web of Science ®Google Scholar
• Engle, R. W., Kane, M. J., & Tuholski, S. W. (1999). Individual differences in working memory capacity and what they tell us about controlled attention, general fluid intelligence, and functions of the prefrontal cortex. In A. Miyake & P. Shah (Eds.), Models of working memory: Mechanisms of active maintenance and executive control (pp. 102–134). Cambridge University Press.
   Google Scholar
• Fournier-Vicente, S., Larigauderie, P., & Gaonac’h, D. (2008). More dissociations and interactions within central executive functioning: A comprehensive latent-variable analysis. Acta Psychologica, 129(1), 32–48. https://doi.org/10.1016/j.actpsy.2008.04.004
   PubMed Web of Science ®Google Scholar
• Frias, C. M., Dixon, R. A., & Strauss, E. (2006). Structure of four executive functioning tests in healthy older adults. Neuropsychology, 20(2), 206–214. https://doi.org/10.1037/0894-4105.20.2.206
   PubMed Web of Science ®Google Scholar
• Funke, J. (2021). It requires more than intelligence to solve consequential world problems. Journal of Intelligence, 9(3), 38. https://doi.org/10.3390/jintelligence9030038
   PubMed Web of Science ®Google Scholar
• Funke, J., Fischer, A., & Holt, D. V. (2018). Competencies for complexity: Problem solving in the 21st century. In E. Care, P. Griffin, & M. Wilson (Eds.), Assessment and teaching of 21st century skills: Research and applications (pp. 41–53). Springer.
   Google Scholar
• Golden, C. J. (1978). Stroop Color and Word Test. Stoelting.
   Google Scholar
• Gonzalez, C. (2005a). Decision support for real-time, dynamic decision-making tasks. Organizational Behavior and Human Decision Processes, 96(2), 142–154. https://doi.org/10.1016/j.obhdp.2004.11.002
   Web of Science ®Google Scholar
• Gonzalez, C. (2005b). Task workload and cognitive abilities in dynamic decision making. Human Factors, 47(1), 92–101. https://doi.org/10.1518/0018720053653767
   PubMed Web of Science ®Google Scholar
• Gonzalez, C., Vanyukov, P., & Martin, M. K. (2005). The use of microworlds to study dynamic decision making. Computers in Human Behavior, 21(2), 273–286. https://doi.org/10.1016/j.chb.2004.02.014
   Web of Science ®Google Scholar
• Granlund, R., & Johansson, B. (2004). Monitoring distributed collaboration in the C3 Fire microworld. In S. G. Dans, L. R. Schifflet, E. Elliott, Salas, & M. D. Coovert (Eds.), Scaled Worlds: Development, Validation and Application (pp. 37–48). Ashgate.
   Google Scholar
• Granlund, R., Johansson, B., Trnka, J., & Granlund, H. (2009). Investigating the impact of geographical information system in a municipality crisis management organization. Proceedings of the 9th International Conference on Naturalistic Decision Making, London, UK.
   Google Scholar
• Gray, W. D. (2002). Simulated task environments: The role of high-fidelity simulations, scaled worlds, synthetic environments, and laboratory tasks in basic and applied cognitive research. Cognitive Science Quarterly, 2, 205–227.
   Google Scholar
• Hagemann, V., & Kluge, A. (2017). Complex Problem Solving in Teams: The Impact of Collective Orientation on Team Process Demands. Frontiers in Psychology, 8, 1730. https://doi.org/10.3389/fpsyg.2017.01730
   PubMed Web of Science ®Google Scholar
• Hambrick, D., Burgoyne, A., & Altmann, E. (2020). Problem-solving and intelligence. In R. J. Sternberg (Ed.), Cambridge handbook of intelligence (2nd) ed., pp. 553–579). Cambridge University Press.
   Google Scholar
• Heaton, R. K., Chelune, G. K., Talley, J. L., Kay, G. G., & Curtiss, G. (1993). Wisconsin Card Sorting Test manual: Revised and expanded. Psychological Assessment Resources Inc.
   Google Scholar
• Hull, R., Martin, R. C., Beier, M. E., Lane, D., & Hamilton, A. C. (2008). Executive function in older adults: A structural equation modeling approach. Neuropsychology, 22(4), 508–522. https://doi.org/10.1037/0894-4105.22.4.508
   PubMed Web of Science ®Google Scholar
• Iverson, G. L., Karr, J. E., Terry, D. P., Garcia-Barrera, M. A., Holdnack, J. A., Ivins, B. J., & Silverberg, N. D. (2020). Developing an executive functioning composite score for research and clinical trials. Archives of Clinical Neuropsychology, 35(3), 312–325. https://doi.org/10.1093/arclin/acz070
   PubMed Web of Science ®Google Scholar
• Jansari, A., Devlin, A., Agnew, R., Akesson, K., Murphy, L., & Leadbetter, T. (2014). Ecological assessment of executive functions. A New Virtual Reality Paradigm. Brain Impairment, 15, 71–87. https://doi.org/10.1017/BrImp.2014.14
   Google Scholar
• Jurado, M. B., & Rosselli, M. (2007). The elusive nature of executive functions: A review of our current understanding. Neuropsychology Review, 17(3), 213–233. https://doi.org/10.1007/s11065-007-9040-z
   PubMed Web of Science ®Google Scholar
• Kane, M. J., Bleckley, M. K., Conway, A. R. A., & Engle, R. W. (2001). A controlled-attention view of working memory capacity. Journal of Experimental Psychology: General, 130(2), 169–183. https://doi.org/10.1037/0096-3445.130.2.169
   PubMed Web of Science ®Google Scholar
• Kane, M. J., & Engle, R. W. (2002). The role of prefrontal cortex in working memory capacity, executive attention, and general fluid intelligence: An individual-differences perspective. Psychonomic Bulletin & Review, 9, 637–671. https://doi.org/10.3758/bf03196323
   PubMed Web of Science ®Google Scholar
• Karr, J. E., Areshenkoff, C. N., Rast, P., Hofer, S. M., Iverson, G. L., & Garcia-Barrera, M. A. (2018). The unity and diversity of executive functions: A systematic review and reanalysis of latent variable studies. Psychological Bulletin, 144(11), 1147–1185. https://doi.org/10.1037/bul0000160
   PubMed Web of Science ®Google Scholar
• Kimberg, D. Y., & Farah, M. J. (1993). A unified account of cognitive impairments following frontal lobe damage: The role of working memory in complex organized behaviour. Journal of Experimental Psychology: General, 122(4), 411–428. https://doi.org/10.1037/0096-3445.122.4.411
   PubMed Web of Science ®Google Scholar
• Koechlin, E., & Summerfield, C. (2007). An information theoretical approach to prefrontal executive function. Trends in Cognitive Sciences, 11(6), 229–235. https://doi.org/10.1016/j.tics.2007.04.005
   PubMed Web of Science ®Google Scholar
• Kovacs, K., & Conway, A. R. A. (2019). A unified cognitive/differential approach to human intelligence: Implications for IQ testing. Journal of Applied Research on Memory and Cognition, 8(3), 255–272. https://doi.org/10.1016/j.jarmac.2019.05.003
   Web of Science ®Google Scholar
• Lafond, D., DuCharme, M., Gagnon, J., & Tremblay, S. (2012). Support requirements for cognitive readiness in complex operations. Journal of Cognitive Engineering and Decision Making, 6(4), 393–426. https://doi.org/10.1177/1555343412446193
   Google Scholar
• Lezak, M. D. (1995). Neuropsychological Assessment (3rd) ed.). Oxford University Press.
   Google Scholar
• Logan, G. D. (1994). On the ability to inhibit thought and action: A user’s guide to the stop signal paradigm. In D. Dagenbach & T. H. Carr (Eds.), Inhibitory processes in attention, memory, and language (pp. 189–239). Academic Press.
   Google Scholar
• Long, D. L., & Prat, C. S. (2002). Working memory and Stroop interference: An individual differences investigation. Memory & Cognition, 30(2), 294–301. https://doi.org/10.3758/BF03195290
   PubMed Web of Science ®Google Scholar
• McCabe, D. P., Roediger, H. L., McDaniel, M. A., Balota, D. A., & Hambrick, D. Z. (2010). The relationship between working memory capacity and executive functioning: Evidence for a common executive attention construct. Neuropsychology, 24(2), 222–243. https://doi.org/10.1037/a0017619
   PubMed Web of Science ®Google Scholar
• Miller, J. B., & Barr, W. B. (2017). The technology crisis in neuropsychology. Archives of Clinical Neuropsychology: The Official Journal of the National Academy of Neuropsychologists, 32(5), 541–554. https://doi.org/10.1093/arclin/acx050
   PubMed Web of Science ®Google Scholar
• Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D. (2000). The unity and diversity of executive functions and their contributions to complex frontal lobes tasks: A latent variable analysis. Cognitive Psychology, 41(1), 49–100. https://doi.org/10.1006/cogp.1999.0734
   PubMed Web of Science ®Google Scholar
• Miyake, A., & Shah, P. (1999). Toward unified theories of working memory: Emerging general consensus, unresolved theoretical issues, and future research directions. In A. Miyake & P. Shah (Eds.), Models of working memory: Mechanisms of active maintenance and executive control (pp. 442–481). Cambridge University Press.
   Google Scholar
• Nir-Hadad, S. Y., Weiss, P. L., Waizman, A., Schwartz, N., & Kizony, R. (2017). A virtual shopping task for the assessment of executive functions: Validity for people with stroke. Neuropsychological Rehabilitation, 27(5), 808–833. https://doi.org/10.1080/09602011.2015.1109523
   PubMed Web of Science ®Google Scholar
• Norris, G., & Tate, R. L. (2000). The Behavioral Assessment of the Dysexecutive Syndrome (BADS): Ecological, concurrent and construct validity. Neuropsychological Rehabilitation, 10(1), 33–45. https://doi.org/10.1080/096020100389282
   Web of Science ®Google Scholar
• Owen, A. M., Downes, J. J., Sahakian, B. J., Polkey, C. E., & Robbins, T. W. (1990). Neuropsychologia, 28, 1021–1034. https://doi.org/10.1016/0028-3932(90)90137-d
   PubMed Web of Science ®Google Scholar
• Packwood, S., Hodgetts, H. M., & Tremblay, S. (2011). A multiperspective approach to the conceptualization of executive functions. Journal of Clinical and Experimental Neuropsychology, 24, 1–15. https://doi.org/10.1080/13803395.2010.533157
   Google Scholar
• Petrides, M., & Milner, B. (1982). Deficits on subject-ordered tasks after frontal and temporal-lobe lesions in man. Neuropsychologia, 20(3), 249–262. https://doi.org/10.1016/0028-3932(82)90100-2
   PubMed Web of Science ®Google Scholar
• Porteus, S. D. (1965). Porteus Maze Test: Fifty years Application. Pacific Books.
   Google Scholar
• Rand, D., Rukan, S. B. A., Weiss, P. L., & Katz, N. (2009). Validation of the virtual MET as an assessment tool for executive functions. Neuropsychological Rehabilitation, 19(4), 583–602. https://doi.org/10.1080/09602010802469074
   PubMed Web of Science ®Google Scholar
• Rapoport, A. (1975). Research paradigms for the study of dynamic decision behavior. In D. Wendt & C. Vlek (Eds.), Utility, probability and human decision making (pp. 349–369). Reidel.
   Google Scholar
• Ratcliff, R., & McKoon, G. (2022). Can neuropsychological testing be improved with model-based approaches? Trends in Cognitive Sciences, 26(11), 899–901. https://doi.org/10.1016/j.tics.2022.08.015
   Web of Science ®Google Scholar
• Renison, B., Ponsford, J., Testa, R., Richardson, B., & Brownfield, K. (2012). The ecological and construct validity of a newly developed measure of executive function: The virtual library task. Journal of the International Neuropsychological Society, 18(3), 440–450. https://doi.org/10.1017/S1355617711001883
   PubMed Web of Science ®Google Scholar
• Rigas, G., Carling, E., & Brehmer, B. (2002). Reliability and validity of performance measures in microworlds. Intelligence, 30(5), 463–480. https://doi.org/10.1016/S0160-2896(02)00121-6
   Web of Science ®Google Scholar
• Salthouse, T. A., Atkinson, T. M., & Berish, D. E. (2003). Executive functioning as a potential mediator of age-related cognitive decline in normal adults. Journal of Experimental Psychology: General, 132(4), 566–594. https://doi.org/10.1037/0096-3445.132.4.566
   PubMed Web of Science ®Google Scholar
• Schmand, B. (2019). Why are neuropsychologists so reluctant to embrace modern assessment techniques?. The Clinical Neuropsychologist, 33(2), 209–219. https://doi.org/10.1080/13854046.2018.1523468
   PubMed Web of Science ®Google Scholar
• Schubert, A.-L., & Rey-Mermet, A. (2019). Does process overlap theory replace the issues of general intelligence with the issues of attentional control? Journal of Applied Research in Memory and Cognition, 8(3), 277–283. https://doi.org/10.1016/j.jarmac.2019.06.004
   Web of Science ®Google Scholar
• Shallice, T. (1982). Specific impairment of planning. Philosophical Transaction of the Royal Society of London, B, (298), 199–209. https://doi.org/10.1098/rstb.1982.0082
   Google Scholar
• Shallice, T. (1988). From neuropsychology to mental structure. Cambridge University Press.
   Google Scholar
• Shallice, T., & Burgess, P. (1996). The domain of supervisory processes and temporal organization of behaviour. Philosophical Transactions of the Royal Society of London, 351, 1405–1411. https://doi.org/10.1098/rstb.1996.0124
   PubMedGoogle Scholar
• Shallice, T., & Burgess, P. W. (1991). Deficits in strategy application following frontal lobe damage in man. Brain, 114(2), 727–741. https://doi.org/10.1093/brain/114.2.727
   PubMed Web of Science ®Google Scholar
• Sherry, A., & Henson, R. K. (2005). Conducting and interpreting canonical correlation analysis in personality research: A user-friendly primer. Journal of Personality Assessment, 84(1), 37–48. https://doi.org/10.1207/s15327752jpa8401_09
   PubMed Web of Science ®Google Scholar
• Spearman, C. (1904). “General intelligence,” objectively determined and measured. The American Journal of Psychology, 15, 201–292.
   Web of Science ®Google Scholar
• Stroop, J. R. (1935). Studies of interference in serial verbal reactions. Journal of Experimental Psychology, 18(6), 643–662. https://doi.org/10.1037/h0054651
   Google Scholar
• Suchy, Y. (2009). Executive functioning: Overview, assessment, and research issues for non-neuropsychologists. Annals of Behavioral Medicine, 37(2), 106–116. https://doi.org/10.1007/s12160-009-9097
   PubMed Web of Science ®Google Scholar
• Tabachnick, B. G., & Fidell, L. S. (2007). Using Multivariate Statistics (5e éd) ed.). Pearson Education, Inc.
   Google Scholar
• Tremblay, S., Lafond, D., Gagnon, J.-F., Rousseau, V., & Granlund, R. (2010). Extending the capabilities of the C3Fire microworld as a testing platform for emergency response management. Proceedings of the 7th International ISCRAM Conference, Seattle.
   Google Scholar
• Tremblay, S., Vachon, F., Lafond, D., & Hodgetts, H. M. (2010). Does teaming up make you less vulnerable to task interruption? Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 54, 1605–1609.
   Google Scholar
• Tremblay, S., Vachon, F., Lafond, D., & Kramer, C. (2012). Dealing with task interruptions in complex dynamic environments: Are two heads better than one? Human Factors, 54(1), 70–83. https://doi.org/10.1177/0018720811424896
   PubMed Web of Science ®Google Scholar
• Uttal, W. R. (2001). The new Phrenology: The limits of Localizing Cognitive Processes in the Brain. Massachusetts: The MIT Press.
   Google Scholar
• Wechsler, D. (1997). WAIS-III administration and scoring manual. The Psychological Corporation.
   Google Scholar