Using Virtual Reality to investigate multitasking ability in individuals with frontal lobe lesions

References

• Anderson, C. V., Bigler, E. D., & Blatter, D. D. (1995). Frontal lobe lesions, diffuse damage, and neuropsychological functioning in traumatic brain-injured patients. Journal of Clinical and Experimental Neuropsychology, 17, 900–908. doi: 10.1080/01688639508402438
   PubMed Web of Science ®Google Scholar
• Army, U. (1944). Army individual test battery. Manual of directions and scoring.
   Google Scholar
• Baddeley, A. (1986). Working memory. Oxford: Oxford University Press.
   Google Scholar
• Bisiacchi, P. S., Sgaramella, T. M., & Farinello, C. (1998). Planning strategies and control mechanisms: Evidence from closed head injury and aging. Brain and Cognition, 37, 113–116.
   Web of Science ®Google Scholar
• Bramham, J., Morris, R. G., Hornak, J., Bullock, P., & Polkey, C. E. (2009). Social and emotional functioning following bilateral and unilateral neurosurgical prefrontal cortex lesions. Journal of Neuropsychology, 3, 125–143. doi: 10.1348/174866408X293994
   PubMed Web of Science ®Google Scholar
• Brewer, G. A., Marsh, R. I., Clark-Foos, A., Thadeus Meeks, J., Cook, G. I., & Hicks, J. L. (2011). A comparison of activity-based to event-based prospective memory. Applied Cognitive Psychology, 25, 632–640. doi: 10.1002/acp.1733
   Web of Science ®Google Scholar
• Brodmann, K. (1909). Vergleichende Lokalisationslehre der Großhirnrinde in ihren Prinzipien dargestellt auf Grund des Zellenbaues. Leipzig: Barth. English translation available in Garey, L. J. Brodmann’s Localization in the Cerebral Cortex (Smith Gordon, London, 1994).
   Google Scholar
• Burgess, P., Alderman, N., Evans, J., Emslie, H., & Wilson, B. (1998). The ecological validity of tests of executive function. Journal of the International Neuropsychological Society, 4, 547–558. doi: 10.1017/S1355617798466037
   PubMed Web of Science ®Google Scholar
• Burgess, P. W., Alderman, N., Forbes, C., Costello, A., Coates, L. M. A., Dawson, D. R., … Channon, S. (2006). The case for the development and use of “ecologically valid” measures of executive function in experimental and clinical neuropsychology. Journal of the International Neuropsychological Society, 12, 194–209. doi: 10.1017/S1355617706060310
   PubMed Web of Science ®Google Scholar
• Burgess, P. W., & Shallice, T. (1997). The Hayling and Brixton tests. Bury St. Edmunds: Thames Valley Test Company.
   Google Scholar
• Burgess, P. W., Simons, J. S., Dumontheil, I., & Gilbert, S. J. (2005). The gateway hypothesis of rostral pre frontal cortex (area 10) function. In J. Duncan, P. McLeod, & L. Phillips (Eds.), Measuring the mind: Speed, control and age (pp. 215–246). Oxford: Oxford University Press.
   Google Scholar
• Burgess, P. W., Veitch, E., Costello, A., & Shallice, T. (2000). The cognitive and neuroanatomical correlates of multitasking. Neuropsychologia, 38, 848–863. doi: 10.1016/S0028-3932(99)00134-7
   PubMed Web of Science ®Google Scholar
• Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 155–159. doi: 10.1037/0033-2909.112.1.155
   PubMed Web of Science ®Google Scholar
• Crépeau, F., Belleville, S., & Duchesne, G. (1996). Disorganisation of behavior in a multiple subgoals scheduling task following traumatic brain injury. Brain and Cognition, 32, 266–268.
   Web of Science ®Google Scholar
• Delis, D. C., Kaplan, E., & Kramer, J. H. (2001). Delis-Kaplan executive function system (D-KEFS). San Antonio, TX: The Psychological Corporation.
   Google Scholar
• Einstein, G. O., & McDaniel, M. A. (1990). Normal aging and prospective memory. Journal of Experimental Psychology: Learning, Memory, and Cognition, 16, 717–726.
   PubMed Web of Science ®Google Scholar
• Elliott, R. (2003). Executive functions and their disorders. Imaging in clinical neuroscience. British Medical Bulletin, 65(1), 49–59. doi: 10.1093/bmb/65.1.49
   PubMed Web of Science ®Google Scholar
• Ellis, J. (1996). Prospective memory or the realization of delayed intentions: A conceptual framework for research. In M. Brandimonte, G. O. Einstein, & M. A. McDaniel (Eds.), Prospective memory: Theory and applications (pp. 1–22). Mahwah, NJ: Lawrence Erlbaum Associates.
   Google Scholar
• Ellis, J., & Freeman, J. E. (2008). Ten years on: Realizing delayed intentions. In M. Kliegel, M. A. McDaniel, & G. O. Einstein (Eds.), Prospective memory: Cognitive, neuroscience, developmental, and applied perspectives (pp. 1–27). New York: Lawrence Erlbaum Associates.
   Google Scholar
• Eslinger, P. J., & Damasio, A. R. (1985). Severe disturbance of higher cognition after bilateral frontal lobe ablation: Patient EVR. Neurology, 35, 1731–1731. doi: 10.1212/WNL.35.12.1731
   PubMed Web of Science ®Google Scholar
• Fischer, R., & Plessow, F. (2015). Efficient multitasking: Parallel versus serial processing of multiple tasks. Frontiers in Psychology, 6(1366), 1–11.
   PubMedGoogle Scholar
• Florkowski, C. M. (2008). Sensitivity, specificity, receiver-operating characteristic (ROC) curves and likelihood ratios: Communicating the performance of diagnostic tests. The Clinical Biochemist Reviews, 29, S83–S87.
   PubMedGoogle Scholar
• Funahashi, S. (2001). Neuronal mechanisms of executive control by the prefrontal cortex. Neuroscience Research, 39, 147–165. doi: 10.1016/S0168-0102(00)00224-8
   PubMed Web of Science ®Google Scholar
• Goldstein, L. H., Bernard, S., Fenwick, P. B., Burgess, P. W., & McNeill, J. (1993). Unilateral frontal lobectomy can produce strategy application disorder. Journal of Neurology, Neurosurgery and Psychiatry, 56(3), 274–276. doi: 10.1136/jnnp.56.3.274
   PubMed Web of Science ®Google Scholar
• Grace, J., & Malloy, P.F. (2001). FrSBe. Frontal systems behavior scale. Professional manual. Lutz, FL: Psychological Assessment Resources.
   Google Scholar
• Grace, J., Stout, J. C., & Malloy, P. F. (1999). Assessing frontal lobe behavioral syndromes with the frontal lobe personality scale. Assessment, 6, 269–284. doi: 10.1177/107319119900600307
   PubMed Web of Science ®Google Scholar
• Gregg, N., Arber, A., Ashkan, K., Brazil, L., Bhangoo, R., Beaney, R., … Yaguez, L. (2014). Neurobehavioural changes in patients following brain tumour: Patients and relatives perspective. Supportive Care in Cancer, 22, 2965–2972. doi: 10.1007/s00520-014-2291-3
   PubMed Web of Science ®Google Scholar
• Hajian-Tilaki, K. (2013). Receiver operating characteristic (ROC) curve analysis for medical diagnostic test evaluation. Caspian Journal of Internal Medicine, 4(2), 627–635.
   PubMedGoogle Scholar
• Harris, M., & Taylor, M. (2014). Medical statistics made easy (3rd ed.). Banbury: Scion Publishing Ltd. Ian Potter Library.
   Google Scholar
• Heaton, R. K. (1981). The Wisconsin card sorting test manual. Odessa, FL: Psychological Assessment Resources.
   Google Scholar
• Hornak, J., O'Doherty, J., Bramham, J., Rolls, E. T., Morris, R. G., Bullock, P. R., & Polkey, C. E. (2004). Reward-related reversal learning after surgical excisions in orbito-frontal or dorsolateral prefrontal cortex in humans. Journal of Cognitive Neuroscience, 16(3), 463–478. doi: 10.1162/089892904322926791
   PubMed Web of Science ®Google Scholar
• Hosenbocus, S., & Chalhal, R. (2012). A review of executive function deficits and pharmacological management in children and adolescents. Journal of the Canadian Academy of Child and Adolescent Psychiatry, 21(3), 223–229.
   PubMedGoogle Scholar
• Hsu, W., Zanto, T. P., Anguera, J. A., Lin, Y., & Gazzaley, A. (2015). Delayed enhancement of multitasking performance: Effects of anodal transcranial direct current stimulation on the prefrontal cortex. Cortex, 69, 175–185. doi: 10.1016/j.cortex.2015.05.014
   PubMed Web of Science ®Google Scholar
• Jansari, A. (2014). JEF©-The Jansari assessment of executive functions manual. Unpublished.
   Google Scholar
• Jansari, A., Devlin, A., Agnew, R., Akesson, K., Murphy, L., & Leadbetter, T. (2014). Ecological assessment of executive functions: A new virtual reality paradigm. Brain Impairment, 15(2), 71–87. doi: 10.1017/BrImp.2014.14
   Web of Science ®Google Scholar
• Jansari, A. S., Froggatt, D., Edginton, T., & Dawkins, L. (2013). Investigating the impact of nicotine on executive functions using a novel virtual reality assessment. Addiction, 108(5), 977–984. doi: 10.1111/add.12082
   PubMed Web of Science ®Google Scholar
• Jovanovski, D., Zakzanis, K., Campbell, Z., Erb, S., & Nussbaum, D. (2012). Development of a novel, ecologically oriented virtual reality measure of executive function: The multitasking in the city test. Applied Neuropsychology, 19(3), 171–182. doi: 10.1080/09084282.2011.643955
   PubMed Web of Science ®Google Scholar
• Kvavilashvili, L., & Ellis, J. (1996). Varieties of intention: Some distinctions and classifications. In M. Brandimonte, G. O. Einstein, & M. A. McDaniel (Eds.), Prospective memory: Theory and applications (pp. 23–52). Mahwah, NJ: Lawrence Erlbaum.
   Google Scholar
• Lengenfelder, J., Arjunman, A., Chiaravalloti, N., Smith, A., & Deluca, J. (2015). Assessing frontal behavioral syndromes and cognitive functions in traumatic brain injury. Applied Neuropsychology: Adult, 22, 7–15. doi: 10.1080/23279095.2013.816703
   PubMed Web of Science ®Google Scholar
• Liu, L., Miyazaki, M., & Watson, B. (1999). Norms and validity of the DriVR: A virtual reality driving assessment for persons with head injuries. Cyberpsychology and Behavior, 2, 53–67. doi: 10.1089/cpb.1999.2.53
   PubMedGoogle Scholar
• Lo Priore, C., Castelnuovo, G., Liccione, D., & Liccione, D. (2003). Experience with V-STORE: Considerations on presence in virtual environments for effective neuropsychological rehabilitation of executive functions. Cyberpsychology and Behavior, 6, 281–287. doi: 10.1089/109493103322011579
   PubMedGoogle Scholar
• LovStad, M., Funderud, I., Endestad, T., Due-Tonnessen, P., Meling, T. R., Lindgren, M., … Solbakk, A. K. (2012). Executive functions after orbital or lateral prefrontal lesions: Neuropsychological profiles and self-reported executive functions in everyday living. Brain Injury, 26, 1586–1598. doi: 10.3109/02699052.2012.698787
   PubMed Web of Science ®Google Scholar
• Mateer, C. A. (1999). The rehabilitation of executive disorders. In D. T. Stuss, G. Winocur, & I. H. Robertson (Eds.), Cognitive neurorehabilitation (pp. 314–332). Cambridge: Cambridge University Press.
   Google Scholar
• Manes, F., Sahakian, B., Clark, L., Rogers, R., Antoun, N., Aitken, M., & Robbins, T. (2002). Decision-making processes following damage to the prefrontal cortex. Brain, 125(3), 624–639. doi: 10.1093/brain/awf049
   PubMed Web of Science ®Google Scholar
• Manly, T., Hawkins, K., Evans, J., Woldt, R., & Robertson, I. H. (2002). Rehabilitation of executive function: Facilitation of effective goal management on complex tasks using periodic auditory alerts. Neuropsychologia, 40, 271–281. doi: 10.1016/S0028-3932(01)00094-X
   PubMed Web of Science ®Google Scholar
• Marcotte, T. D., Scott, J. C., Kamat, R., & Heaton, R. K. (2010). Neuropsychology and the prediction of everyday functioning. In T. D. Marcotte & I. Grant (Eds.), Neuropsychology of everyday functioning (pp. 5–38). New York: The Guilford Press.
   Google Scholar
• Marin, R. S., Biedrzycki, R. C., & Firinciogullari, S. (1991). Reliability and validity of the Apathy Evaluation Scale. Psychiatry Research, 38, 143–162. doi: 10.1016/0165-1781(91)90040-V
   PubMed Web of Science ®Google Scholar
• Montgomery, C., Ashmore, K., & Jansari, A. (2011). The effects of a modest dose of alcohol on executive functioning and prospective memory. Human Psychopharmacology: Clinical and Experimental, 26, 208–215.
   PubMed Web of Science ®Google Scholar
• Montgomery, C., Hatton, N. P., Fisk, J. E., Ogden, R. S., & Jansari, A. S. (2010). Assessing the functional significance of ecstasy-related memory deficits using a virtual paradigm. Human Psychopharmacology: Clinical and Experimental, 25(4), 318–325. doi: 10.1002/hup.1119
   PubMed Web of Science ®Google Scholar
• Montgomery, C., Seddon, A. L., Fisk, J. E., Murphy, P. N., & Jansari, A. S. (2012). Cannabis-related deficits in real-world memory. Human Psychopharmacology: Clinical and Experimental, 27(2), 217–225. doi: 10.1002/hup.1273
   PubMed Web of Science ®Google Scholar
• Morris, R. G. (2005). Virtual reality in brain damage rehabilitation: Commentary. Cyber-Psychology and Behaviour, 8(3), 267–268.
   Google Scholar
• Morris, R. G., Kotitsa, M., Bramham, J., Brooks, B. M., & Rose, F. D. (2002). Virtual reality investigation of strategy formation, rule breaking and prospective memory in patients with focal prefrontal neurosurgical lesions. ICDVRAT, 4, 101–108.
   Google Scholar
• Neulinger, K., Oram, J., Tinson, H., O'Gorman, J., & Shum, D. (2016). Prospective memory and frontal lobe function. Aging, Neuropsychology, and Cognition, 23(2), 171–183. doi: 10.1080/13825585.2015.1069252
   PubMed Web of Science ®Google Scholar
• Nyhus, E., & Barcelo, F. (2009). The wisconsin card sorting test and the cognitive assessment of prefrontal executive functions: A critical update. Brain and Cognition, 71(3), 437–451. doi: 10.1016/j.bandc.2009.03.005
   PubMed Web of Science ®Google Scholar
• Okuda, J., Fuji, T., Yamadori, A., Kawashima, R., Tsukiura, T., Fukatsu, R., … Fukuda, H. (1998). Participation of the prefrontal cortices in prospective memory: Evidence from a PET study in humans. Neuroscience letters, 253, 127–130. doi: 10.1016/S0304-3940(98)00628-4
   PubMed Web of Science ®Google Scholar
• Parsons, T. (2015). Virtual reality for enhanced ecological validity and experimental control in the clinical affective and social neurosciences. Frontiers in Human Neuroscience, 9, 120. doi: 10.3389/fnhum.2015.00660
   PubMed Web of Science ®Google Scholar
• Penn, P. R., Rose, F. D., & Johnson, D. A. (2008). The use of virtual reality in the assessment and rehabilitation of executive dysfunction. In M. Oddy & A. W. Worthington (Eds.), The Rehabilitation of executive disorders a guide to theory and practice (pp. 255–268). Oxford University Press.
   Google Scholar
• Pullen, E., Morris, R., Kerr, S., Bullock, P. R., & Selway, R. P. (2006). Exploration of social rule violation in patients with focal prefrontal neurosurgical lesions using a virtual reality simulation. International Journal of Disabilities and Human Development, 5(2), 141–146.
   Google Scholar
• Reitan, R. M. (1992). Trail making test: Manual for administration and scoring. South Tuscon, AZ: Reitan Neuropsychology Laboratory.
   Google Scholar
• Renison, B., Ponsford, J., Testa, R., & Jansari, A. S. (2008). The use of virtual reality in assessment of executive function following traumatic brain injury. Brain Impairment, 9(1), 47–57.
   Google Scholar
• Rizzo, A. A., Schultheis, M. T., Kerns, K., & Mateer, C. (2004). Analysis of assets for virtual reality applications in neuropsychology. Neuropsychological Rehabilitation, 14, 207–239. doi: 10.1080/09602010343000183
   Web of Science ®Google Scholar
• Robertson, I. H., Manly, T., Andrade, J., Baddeley, B. T., & Yiend, J. (1997). “Oops!”: Performance correlates of everyday attentional failures in traumatic brain injured and normal subjects. Neuropsychologia, 35, 747–758. doi: 10.1016/S0028-3932(97)00015-8
   PubMed Web of Science ®Google Scholar
• Rowe, A. D., Bullock, P. R., Polkey, C. E., & Morris, R. G. (2001). “Theory of mind” impairments and their relationship to executive functioning following frontal lobe excisions. Brain, 124, 101–117. doi: 10.1093/brain/124.3.600
   Web of Science ®Google Scholar
• Schultheis, M. T., & Rizzo, A. A. (2001). The application of virtual reality technology in rehabilitation. Rehabilitation Psychology, 46, 296–311. doi: 10.1037/0090-5550.46.3.296
   Web of Science ®Google Scholar
• Shallice, T. (1982). Specific impairments of planning. Philosophical Transactions of the Royal Society B: Biological Sciences, 298, 199–209. doi: 10.1098/rstb.1982.0082
   PubMed Web of Science ®Google Scholar
• Shallice, T., Burgess, P., & Robertson, I. (1996). The domain of supervisory processes and temporal organization of behaviour [and discussion]. Philosophical Transactions of the Royal Society B: Biological Sciences, 351, 1405–1412. doi: 10.1098/rstb.1996.0124
   PubMed Web of Science ®Google Scholar
• Shallice, T., & Burgess, P. W. (1991). Deficits in strategy application following frontal lobe damage in man. Brain, 114, 727–741. doi: 10.1093/brain/114.2.727
   PubMed Web of Science ®Google Scholar
• Shum, D., Valentine, M., & Cutmore, T. (1999). Performance of individuals with severe long-term traumatic brain injury on time-, event-, and activity-based prospective memory tasks. Journal of Clinical and Experimental Neuropsychology (Neuropsychology, Development and Cognition: Section A), 21(1), 49–58. doi: 10.1076/jcen.21.1.49.943
   Google Scholar
• Simblett, S. K., Ring, H., & Bateman, A. (2016). The dysexecutive questionnaire revised (DEX-R): An extended measure of everyday dysexecutive problems after acquired brain injury. Neuropsychological Rehabilitation, 21, 1–18. doi: 10.1080/09602011.2010.531216
   Web of Science ®Google Scholar
• Soar, K., Chapman, E., Sivakuma, N., Jansari, A., & Turner, J. J. D. (2016). Investigating the effects of caffeine on executive functions using traditional Stroop and a new ecologically-valid virtual reality task, the Jansari assessment of executive functions (JEF ©). Appetite, 105, 156–163. doi: 10.1016/j.appet.2016.05.021
   PubMed Web of Science ®Google Scholar
• Streiner, D. L., & Norman, G. R. (2008). Health measurement scales: A practical guide to their development and use (4th ed.). New York, NY: Oxford University Press.
   Google Scholar
• Stuss, D. T., & Alexander, M. P. (2007). Is there a dysexecutive syndrome?. Philosophical Transactions of the Royal Society B: Biological Sciences, 362, 901–915. doi: 10.1098/rstb.2007.2096
   PubMed Web of Science ®Google Scholar
• Stuss, D. T., & Benson, D. F. (1986). The frontal lobes. New York: Raven Press.
   Google Scholar
• Sweeney, S., Kersel, D., Morris, R. G., Manly, T., & Evans, J. (2010). The sensitivity of a virtual reality task to planning and prospective memory impairments: Group differences and the efficacy of periodic alerts on performance. Neuropsychological Rehabilitation, 20(2), 239–263. doi: 10.1080/09602010903080531
   PubMed Web of Science ®Google Scholar
• Wechsler, D. (1997). Wechsler memory scale (3rd ed.). San Antonio, TX: Psychological Corporation.
   Google Scholar
• Wechsler, D. (2009). Wechsler memory scale (4th ed.). San Antonio, TX: Pearson.
   Google Scholar
• Wechsler, D. (2011a). Manual for the test of premorbid functioning. New York: The Psychological Corporation.
   Google Scholar
• Wechsler, D. (2011b). Wechsler abbreviated scale of intelligence, second edition (WASI-II). San Antonio, TX: NCS Pearson.
   Google Scholar
• Wilson, B. A., Alderman, N., Burgess, P. W., Emslie, H., & Evans, J. (1996). Behavioural assessment of the dysexecutive syndrome (BADS). London: Thames Valley Test Company.
   Google Scholar
• Yesavage, J., Hoblyn, J., Friedman, L., Mumenthaler, M., Schneider, B., & O’Hara, R. (2007). Should one use medications in combination with cognitive training? If so, which ones? The Journals of Gerontology: Series B, 62(1), 11–18. doi: 10.1093/geronb/62.special_issue_1.11
   Google Scholar
• Zhang, L., Abreu, B. C., Seale, G. S., Masel, B., Christiansen, C. H., & Ottenbacher, K. J. (2003). A virtual reality environment for evaluation of a daily living skill in brain injury rehabilitation: Reliability and validity11No commercial party having a direct financial interest in the results of the research supporting this article has or will confer a benefit upon the author(s) or upon any organization with which the author(s) is/are associated. Archives of Physical Medicine and Rehabilitation, 84(8), 1118–1124. doi: 10.1016/S0003-9993(03)00203-X
   PubMed Web of Science ®Google Scholar
• Zigmond, A. S., & Snaith, R. P. (1983). The hospital anxiety and depression scale. Acta Psychiatrica Scandinavica, 67(6), 361–370. doi: 10.1111/j.1600-0447.1983.tb09716.x
   PubMed Web of Science ®Google Scholar