The potential of function-led virtual environments for ecologically valid measures of executive function in experimental and clinical neuropsychology

References

• Adams, R., Finn, P., Moes, E., Flannery, K., & Rizzo, A. (2009). Distractibility in attention/deficit/hyperactivity disorder (ADHD): The virtual reality classroom. Child Neuropsychology, 15, 120–135. doi: 10.1080/09297040802169077
   PubMed Web of Science ®Google Scholar
• Alderman, N., Burgess, P. W., Knight, C., & Henman, C. (2003). Ecological validity of a simplified version of the multiple errands shopping test. Journal of the International Neuropsychological Society, 9, 31–44. doi: 10.1017/S1355617703910046
   PubMed Web of Science ®Google Scholar
• Allen, A. J., Shashwath, A. M., Skudlarski, P., Calhoun, V., Astur, R., Ruopp, K. C., & Pearlson, G. D. (2009). Effects of alcohol on performance of distraction task during simulated driving. Alcoholism: Clinical and Experimental Research, 33, 617–625. doi: 10.1111/j.1530-0277.2008.00876.x
   PubMed Web of Science ®Google Scholar
• Armstrong, C., Reger, G., Edwards, J., Rizzo, A., Courtney, C., & Parsons, T. (2013). Validity of the virtual reality stroop task (VRST) in active duty military. Journal of Clinical and Experimental Neuropsychology, 35, 113–123. doi: 10.1080/13803395.2012.740002
   PubMed Web of Science ®Google Scholar
• Asimakopulos, J., Boychuck, Z., Sondergaard, D., Poulin, V., Ménard, I., & Korner-Bitensky, N. (2012). Assessing executive function in relation to fitness to drive: A review of tools and their ability to predict safe driving. Australian Occupational Therapy Journal, 59, 402–427. doi: 10.1111/j.1440-1630.2011.00963.x
   PubMed Web of Science ®Google Scholar
• Attree, E. A., Brooks, B. M., Rose, F. D., Andrews, T. K., Leadbetter, A. G., & Clifford, B. R. (1996, July). Memory processes and virtual environments: I can't remember what was there, but I can remember how I got there. Implications for people with disabilities. In ECDVRAT: 1st European Conference on Disability, Virtual Reality and Associated Technologies. Reading, UK (Vol. 118).
   Google Scholar
• Avis, K., Gamble, K., & Schwebel, D. (2014). Does excessive daytime sleepiness affect children's pedestrian safety? SLEEP, 37, 283–287. doi: 10.5665/sleep.3398
   PubMed Web of Science ®Google Scholar
• Bailey, P. E., Henry, J. D., Rendell, P. G., Phillips, L. H., & Kliegel, M. (2010). Dismantling the “age–prospective memory paradox”: The classic laboratory paradigm simulated in a naturalistic setting. The Quarterly Journal of Experimental Psychology, 63(4), 646–652. doi: 10.1080/17470210903521797
   PubMed Web of Science ®Google Scholar
• Barkley, R. A., Anderson, D. L., & Kruesi, M. (2007). A pilot study of the effects of atomoxetine on driving performance in adults with ADHD. Journal of Attention Disorders, 10, 306–316. doi: 10.1177/1087054706292122
   PubMedGoogle Scholar
• Barkley, R., Murphy, K., O'connell, T., Anderson, D., & Connor, D. (2006). Effects of two doses of alcohol on simulator driving performance in adults with attention-deficit/hyperactivity disorder. Neuropsychology, 20, 77–87. doi: 10.1037/0894-4105.20.1.77
   PubMed Web of Science ®Google Scholar
• Barkley, R. A., Murphy, K. R., O'Connell, T., & Connor, D. F. (2005). Effects of two doses of methylphenidate on simulator driving performance in adults with attention deficit hyperactivity disorder. Journal of Safety Research, 36, 121–131. doi: 10.1016/j.jsr.2005.01.001
   PubMed Web of Science ®Google Scholar
• Bauer, R. M., Iverson, G. L., Cernich, A. N., Binder, L. M., Ruff, R. M., & Naugle, R. I. (2012). Computerized neuropsychological assessment devices: Joint position paper of the American academy of clinical neuropsychology and the national academy of neuropsychology. The Clinical Neuropsychologist, 26, 177–196. doi: 10.1080/13854046.2012.663001
   PubMed Web of Science ®Google Scholar
• Bedard, M., Parkkari, M., Weaver, B., Riendeau, J., & Dahlquist, M. (2010). Assessment of driving performance using a simulator protocol: Validity and reproducibility. American Journal of Occupational Therapy, 64, 336–340. doi: 10.5014/ajot.64.2.336
   PubMed Web of Science ®Google Scholar
• Bioulac, S., Lallemand, S., Rizzo, A., Philip, P., Fabrigoule, C., & Bouvard, M. P. (2012). Impact of time on task on ADHD patients’ performances in a virtual classroom. European Journal of Paediatric Neurology, 16, 514–521. doi: 10.1016/j.ejpn.2012.01.006
   PubMed Web of Science ®Google Scholar
• Bohil, C. J., Alicea, B., & Biocca, F. A. (2011). Virtual reality in neuroscience research and therapy. Nature Reviews Neuroscience, 12, 752–762.
   PubMed Web of Science ®Google Scholar
• Bottari, C., Dassa, C., Rainville, C., & Dutil, E. (2009). The criterion-related validity of the IADL profile with measures of executive functions, indices of trauma severity and sociodemographic characteristics. Brain Injury, 23, 322–335. doi: 10.1080/02699050902788436
   PubMed Web of Science ®Google Scholar
• Burgess, P. W., Alderman, N., Evans, J., Emslie, H., & Wilson, B. A. (1998). The ecological validity of tests of executive function. The Journal of the International Neuropsychological Society, 4, 547–558. doi: 10.1017/S1355617798466037
   PubMed Web of Science ®Google Scholar
• Burgess, P. W., Alderman, N., Forbes, C., Costello, A., MA COATES, L. A. U. R. E., Dawson, D. R., … Channon, S. (2006). The case for the development and use of “ecologically valid” measures of executive function in experimental and clinical neuropsychology. Journal of the International Neuropsychological Society, 12, 194–209. doi: 10.1017/S1355617706060310
   PubMed Web of Science ®Google Scholar
• Burgess, P. W., & Simons, J. S. (2005). Theories of frontal lobe executive function: Clinical applications. In P. W. Halligan & D. T. Wade (Eds.), Effectiveness of Rehabilitation for Cognitive Deficits (pp. 211–231). Oxford: Oxford University Press.
   Google Scholar
• Buxbaum, L., Dawson, A., & Linsley, D. (2012). Reliability and validity of the virtual reality lateralized attention test in assessing hemispatial neglect in right-hemisphere stroke. Neuropsychology, 26, 430–441. doi: 10.1037/a0028674
   PubMed Web of Science ®Google Scholar
• Calhoun, V. D., & Pearlson, G. D. (2012). A selective review of simulated driving studies: Combining naturalistic and hybrid paradigms, analysis approaches, and future directions. NeuroImage, 59, 25–35. doi: 10.1016/j.neuroimage.2011.06.037
   PubMed Web of Science ®Google Scholar
• Campbell, Z., Zakzanis, K. K., Jovanovski, D., Joordens, S., Mraz, R., & Graham, S. J. (2009). Utilizing virtual reality to improve the ecological validity of clinical neuropsychology: An FMRI case study elucidating the neural basis of planning by comparing the tower of London with a three-dimensional navigation task. Applied Neuropsychology, 16, 295–306. doi: 10.1080/09084280903297891
   PubMed Web of Science ®Google Scholar
• Cao, X., Douguet, A. S., Fuchs, P., & Klinger, E. (2010). Designing an ecological virtual task in the context of executive functions: A preliminary study. In P. Sharkey & J. Sanchez (Eds.), Proceedings of the 8th International Conference Disability, Virtual Reality and Associated Technologies (pp. 71–78). Chile: Vi˜na del Mar/Valparaiso.
   Google Scholar
• Carelli, L., Morganti, F., Weiss, P. L., Kizony, R., & Riva, G. (2008). A virtual reality paradigm for the assessment and rehabilitation of executive function deficits post stroke: Feasibility study. Virtual Rehabilitation, 2008, 99–104.
   Google Scholar
• Chan, R. C., Shum, D., Toulopoulou, T., & Chen, E. Y. (2008). Assessment of executive functions: Review of instruments and identification of critical issues. Archives of Clinical Neuropsychology, 23, 201–216. doi: 10.1016/j.acn.2007.08.010
   PubMed Web of Science ®Google Scholar
• Chaytor, N., & Schmitter-Edgecombe, M. (2003). The ecological validity of neuropsychological tests: A review of the literature on everyday cognitive skills. Neuropsychology Review, 13, 181–197. doi: 10.1023/B:NERV.0000009483.91468.fb
   PubMed Web of Science ®Google Scholar
• Chaytor, N., Schmitter-Edgecombe, M., & Burr, R. (2006). Improving the ecological validity of executive functioning assessment. Archives of Clinical Neuropsychology, 21, 217–227. doi: 10.1016/j.acn.2005.12.002
   PubMed Web of Science ®Google Scholar
• Cipresso, P., La Paglia, F., La Cascia, C., Riva, G., Albani, G., & La Barbera, D. (2013). Break in volition: A virtual reality study in patients with obsessive-compulsive disorder. Experimental Brain Research, 229, 443–449. doi: 10.1007/s00221-013-3471-y
   PubMed Web of Science ®Google Scholar
• Clancy, T. A., Rucklidge, J. J., & Owen, D. (2006). Road-Crossing safety in virtual reality: A comparison of adolescents with and without ADHD. Journal of Clinical Child & Adolescent Psychology, 35, 203–215. doi: 10.1207/s15374424jccp3502_4
   PubMed Web of Science ®Google Scholar
• Cook, L., Hanten, G., Orsten, K., Chapman, S., Li, X., Wilde, E., Schnelle, K. P., Levin, H. (2013). Effects of moderate to severe traumatic brain injury on anticipating consequences of actions in adults: A preliminary study. Journal of the International Neuropsychological Society, 19, 508–517. doi: 10.1017/S1355617712001452
   PubMed Web of Science ®Google Scholar
• Cox, D., Moore, M., Burket, R., Merkel, R., Mikami, A., & Kovatchev, B. (2008). Rebound effects with long-acting amphetamine or methylphenidate stimulant medication preparations among adolescent male drivers with attention-deficit/hyperactivity disorder. Journal of Child and Adolescent Psychopharmacology, 18, 1–10. doi: 10.1089/cap.2006.0141
   PubMed Web of Science ®Google Scholar
• Cuberos-Urbano, G., Caracuel, A., Vilar-López, R., Valls-Serrano, C., Bateman, A., & Verdejo-García, A. (2013). Ecological validity of the multiple errands test using predictive models of dysexecutive problems in everyday life. Journal of Clinical and Experimental Neuropsychology, 35, 329–336. doi: 10.1080/13803395.2013.776011
   PubMed Web of Science ®Google Scholar
• Davis, A., Avis, K., & Schwebel, D. (2013). The effects of acute sleep restriction on adolescents’ pedestrian safety in a virtual environment. Journal of Adolescent Health, 53, 785–790. doi: 10.1016/j.jadohealth.2013.07.008
   PubMed Web of Science ®Google Scholar
• Dawson, D. R., Anderson, N. D., Burgess, P., Cooper, E., Krpan, K. M., & Stuss, D. T. (2009). Further development of the multiple errands test: Standardized scoring, reliability, and ecological validity for the baycrest version. Archives of Physical Medicine and Rehabilitation, 90, S41–S51. doi: 10.1016/j.apmr.2009.07.012
   PubMed Web of Science ®Google Scholar
• Diamond, A. (2013). Executive functions. Annual Review of Psychology, 64, 135–168. doi: 10.1146/annurev-psych-113011-143750
   PubMed Web of Science ®Google Scholar
• Diaz-Orueta, U., Garcia-Lopez, C., Crespo-Eguilaz, N., Sanchez-Carpintero, R., Climent, G., & Narbona, J. (2014). AULA virtual reality test as an attention measure: Convergent validity with conners’ continuous performance test. Child Neuropsychology, 20, 328–342. doi: 10.1080/09297049.2013.792332
   PubMed Web of Science ®Google Scholar
• Elkind, J. S., Rubin, E., Rosenthal, S., Skoff, B., & Prather, P. (2001). A simulated reality scenario compared with the computerized Wisconsin card sorting test: An analysis of preliminary results. CyberPsychology & Behavior, 4, 489–496. doi: 10.1089/109493101750527042
   PubMedGoogle Scholar
• Fox, J., Arena, D., & Bailenson, J. N. (2009). Virtual reality: A survival guide for the social scientist. Journal of Media Psychology, 21, 95–113. doi: 10.1027/1864-1105.21.3.95
   Google Scholar
• Franzen, M. D., & Wilhelm, K. L. (1996). Conceptual foundations of ecological validity in neuropsychological assessment. In R. J. Sbordone & C. J. Long (Eds.), Ecological validity of neuropsychological testing (pp. 91–112). Boca Raton, FL: St Lucie Press.
   Google Scholar
• Goldstein, G. (1996). Functional considerations in neuropsychology. In R. J. Sbordone & C. J. Long (Eds.), Ecological validity of neuropsychological testing (pp. 75–89). Delray Beach, FL: GR Press/St. Lucie Press.
   Google Scholar
• Henry, M., Joyal, C. C., & Nolin, P. (2012). Development and initial assessment of a new paradigm for assessing cognitive and motor inhibition: The bimodal virtual-reality stroop. Journal of Neuroscience Methods, 210, 125–131. doi: 10.1016/j.jneumeth.2012.07.025
   PubMed Web of Science ®Google Scholar
• Iriate, Y., Diaz-Orueta, U., Cueto, E., Irazustabarrena, P., Banterla, F., & Climent, G. (2012). AULA – Advanced virtual reality tool for the assessment of attention: Normative study in Spain. Journal of Attention Disorders, 20, 1–27.
   Google Scholar
• Jansari, A. S., Froggatt, D., Edginton, T., & Dawkins, L. (2013). Investigating the impact of nicotine on executive functions using a novel virtual reality assessment. Addiction, 108, 977–984. doi: 10.1111/add.12082
   PubMed Web of Science ®Google Scholar
• Josman, N., Kizony, R., Hof, E., Goldenberg, K., Weiss, P., & Klinger, E. (2014). Using the virtual action planning-supermarket for evaluating executive functions in people with stroke. Journal of Stroke and Cerebrovascular Diseases, 23, 879–887. doi: 10.1016/j.jstrokecerebrovasdis.2013.07.013
   PubMed Web of Science ®Google Scholar
• Josman, N., Schenirderman, A. E., Klinger, E., & Shevil, E. (2009). Using virtual reality to evaluate executive functions among persons with schizophrenia: A validity study. Schizophrenia Research, 115, 270–277. doi: 10.1016/j.schres.2009.09.015
   PubMed Web of Science ®Google Scholar
• Jovanovski, D., Zakzanis, K., Campbell, Z., Erb, S., & Nussbaum, D. (2012). Development of a novel, ecologically oriented virtual reality measure of executive function: The multitasking in the city test. Applied Neuropsychology: Adult, 19, 171–182. doi: 10.1080/09084282.2011.643955
   PubMed Web of Science ®Google Scholar
• Jovanovski, D., Zakzanis, K., Ruttan, L., Campbell, Z., Erb, S., & Nussbaum, D. (2012). Ecologically valid assessment of executive dysfunction using a novel virtual reality task in patients with acquired brain injury. Applied Neuropsychology, 19, 207–220. doi: 10.1080/09084282.2011.643956
   PubMed Web of Science ®Google Scholar
• Jurado, M. B., & Rosselli, M. (2007). The elusive nature of executive functions: A review of our current understanding. Neuropsychology Review, 17, 213–233. doi: 10.1007/s11065-007-9040-z
   PubMed Web of Science ®Google Scholar
• Knight, C., Alderman, N., & Burgess, P. (2002). Development of a simplified version of the multiple errands test for use in hospital settings. Neuropsychological Rehabilitation, 12, 231–255. doi: 10.1080/09602010244000039
   Web of Science ®Google Scholar
• Knouse, L. E., Bagwell, C. L., Barkley, R. A., & Murphy, K. R. (2005). Accuracy of self-evaluation in adults with ADHD: Evidence from a driving study. Journal of Attention Disorders, 8, 221–234. doi: 10.1177/1087054705280159
   PubMedGoogle Scholar
• Lalonde, G., Henry, M., Drouin-Germain, A., Nolin, P., & Beauchamp, M. H. (2013). Assessment of executive function in adolescence: A comparison of traditional and virtual reality tools. Journal of Neuroscience Methods, 219, 76–82. doi: 10.1016/j.jneumeth.2013.07.005
   PubMed Web of Science ®Google Scholar
• Lamberts, K. F., Evans, J. J., & Spikman, J. M. (2010). A real-life, ecologically valid test of executive functioning: The executive secretarial task. Journal of Clinical and Experimental Neuropsychology, 32(1), 56–65. doi: 10.1080/13803390902806550
   PubMed Web of Science ®Google Scholar
• Law, A. S., Trawley, S. L., Brown, L. A., Stephens, A. N., & Logie, R. H. (2013). The impact of working memory load on task execution and online plan adjustment during multitasking in a virtual environment. The Quarterly Journal of Experimental Psychology, 66, 1241–1258. doi: 10.1080/17470218.2012.748813
   PubMed Web of Science ®Google Scholar
• Lee, H. C., Cameron, D., & Lee, A. G. (2003). Assessing the driving performance of older adult drivers: On-road versus simulated driving. Accident Analysis and Prevention, 35, 797–803. doi: 10.1016/S0001-4575(02)00083-0
   PubMed Web of Science ®Google Scholar
• Lee, H. C., Lee, A. H., Cameron, D., & Li-Tsang, C. (2003). Using a driving simulator to identify older drivers at inflated risk of motor vehicle crashes. Journal of Safety Research, 34, 453–459. doi: 10.1016/j.jsr.2003.09.007
   PubMed Web of Science ®Google Scholar
• Levine, B., Dawson, D., Boutet, I., Schwartz, M. L., & Stuss, D. T. (2000). Assessment of strategic self-regulation in traumatic brain injury: Its relationship to injury severity and psychosocial outcome. Neuropsychology, 14, 491–500. doi: 10.1037/0894-4105.14.4.491
   PubMed Web of Science ®Google Scholar
• Liu, L., Miyazaki, M., & Watson, B. (1999). Norms and validity of the drivr: A virtual reality driving assessment for persons with head injuries. Cyberpsychology & Behavior, 2, 53–67. doi: 10.1089/cpb.1999.2.53
   PubMedGoogle Scholar
• Logie, R. H., Trawley, S., & Law, A. (2011). Multitasking: Multiple, domain-specific cognitive functions in a virtual environment. Memory & Cognition, 39, 1561–1574. doi: 10.3758/s13421-011-0120-1
   PubMed Web of Science ®Google Scholar
• Manchester, D., Priestley, N., & Howard, J. (2004). The assessment of executive functions: Coming out of the office. Brain Injury, 18, 1067–1081. doi: 10.1080/02699050410001672387
   PubMed Web of Science ®Google Scholar
• Matheis, R. J., Schultheis, M. T., Tiersky, L. A., DeLuca, J., Millis, S. R., & Rizzo, A. (2007). Is learning and memory different in a virtual environment? The Clinical Neuropsychologist, 21, 146–161. doi: 10.1080/13854040601100668
   PubMed Web of Science ®Google Scholar
• McGeorge, P., Phillips, L. H., Crawford, J. R., Garden, S. E., Sala, S. D., & Milne, A. B. (2001). Using virtual environments in the assessment of executive dysfunction. Presence: Teleoperators and Virtual Environments, 10, 375–383. doi: 10.1162/1054746011470235
   Web of Science ®Google Scholar
• Miller, K. J., Adair, B. S., Pearce, A. J., Said, C. M., Ozanne, E., & Morris, M. M. (2014). Effectiveness and feasibility of virtual reality and gaming system use at home by older adults for enabling physical activity to improve health-related domains: A systematic review. Age and Ageing, 43, 188–195. doi: 10.1093/ageing/aft194
   PubMed Web of Science ®Google Scholar
• Milleville-Pennel, I., Pothier, J., Hoc, J. M., & Mathe, J. F. (2010). Consequences of cognitive impairments following traumatic brain injury: Pilot study on visual exploration while driving. Brain Injury, 24, 678–691. doi: 10.3109/02699051003692159
   PubMed Web of Science ®Google Scholar
• Milner, B. (1963). Effects of different brain lesions on card sorting. Archives of Neurology (Chicago), 9, 90–100. doi: 10.1001/archneur.1963.00460070100010
   Web of Science ®Google Scholar
• Moffat, S. D. (2009). Aging and spatial navigation: What do we know and where do we go? Neuropsychology Review, 19, 478–489. doi: 10.1007/s11065-009-9120-3
   PubMed Web of Science ®Google Scholar
• Montgomery, C., Ashmore, K., & Jansari, A. (2011). The effects of a modest dose of alcohol on executive functioning and prospective memory. Human Psychopharmacology: Clinical and Experimental, 26, 208–215.
   PubMed Web of Science ®Google Scholar
• Morris, R. G., Kotitsa, M., Bramham, J., Brooks, B., & Rose, F. D. (2002). Virtual reality investigation of strategy formation, rule breaking and prospective memory in patients with focal prefrontal neurosurgical lesions. In P. Sharkey, C. S. Lányi, & P. Standen (Eds.), Proceedings of the 4th International Conference on Disability, Virtual Reality & Associated Technologies, Veszprém, Hungary (pp. 101–108). Reading, UK: The University of Reading.
   Google Scholar
• Nagamatsu, L., Voss, M., Neider, M., Gaspar, J., Handy, T., Kramer, A., & Liu-Ambrose, T. (2011). Increased cognitive load leads to impaired mobility decisions in seniors at risk for falls. Psychology and Aging, 26, 253–259. doi: 10.1037/a0022929
   PubMed Web of Science ®Google Scholar
• Norman, D. A., & Shallice, T. (1986). Attention to action: Willed and automatic control of behaviour. In R. J. Davidson, G. E. Schwartz, & D. Shapiro (Eds.), Consciousness and self-regulation: Advances in research and theory (pp. 1–18). New York: Plenum.
   Google Scholar
• Parsey, C. M., & Schmitter-Edgecombe, M. (2013). Applications of technology in neuropsychological assessment. The Clinical Neuropsychologist, 27, 1328–1361. doi: 10.1080/13854046.2013.834971
   PubMed Web of Science ®Google Scholar
• Parsons, T. D. (2011). Neuropsychological assessment using virtual environments: Enhanced assessment technology for improved ecological validity. In Advanced computational intelligence paradigms in healthcare 6. Virtual reality in psychotherapy, rehabilitation, and assessment (pp. 271–289). Berlin Heidelberg: Springer.
   Google Scholar
• Parsons, T. D., Bowerly, T., Buckwalter, J. G., & Rizzo, A. A. (2007). A controlled clinical comparison of attention performance in children with ADHD in a virtual reality classroom compared to standard neuropsychological methods. Child Neuropsychology, 13, 363–381. doi: 10.1080/13825580600943473
   PubMed Web of Science ®Google Scholar
• Parsons, T. D., & Courtney, C. (2014). An initial validation of the virtual reality paced auditory serial addition test in a college sample. Journal of Neuroscience Methods, 222, 15–23. doi: 10.1016/j.jneumeth.2013.10.006
   PubMed Web of Science ®Google Scholar
• Parsons, T. D., Courtney, C. G., & Dawson, M. E. (2013). Virtual reality stroop task for assessment of supervisory attentional processing. Journal of Clinical and Experimental Neuropsychology, 35(8), 812–826. doi: 10.1080/13803395.2013.824556
   PubMed Web of Science ®Google Scholar
• Parsons, T. D., McPherson, S., & Interrante, V. (2013, March). Enhancing neurocognitive assessment using immersive virtual reality. In 1st Workshop on Virtual and Augmented Assistive Technology (VAAT) (pp. 27–34). Orlando, FL: IEEE.
   Google Scholar
• Parsons, T. D., & Rizzo, A. A. (2008). Affective outcomes of virtual reality exposure therapy for anxiety and specific phobias: A meta-analysis. Journal of Behavior Therapy and Experimental Psychiatry, 39, 250–261. doi: 10.1016/j.jbtep.2007.07.007
   PubMed Web of Science ®Google Scholar
• Parsons, T. D., & Rizzo, A. A. (2008). Initial validation of a virtual environment for assessment of memory functioning: Virtual reality cognitive performance assessment test. Cyberpsychology and Behavior, 11, 17–25. doi: 10.1089/cpb.2007.9934
   PubMedGoogle Scholar
• Patil, I., Cogoni, C., Zangrando, N., Chittaro, L., & Silani, G. (2014). Affective basis of judgment-behavior discrepancy in virtual experiences of moral dilemmas. Social Neuroscience, 9(1), 94–107. doi: 10.1080/17470919.2013.870091
   PubMed Web of Science ®Google Scholar
• Pedroli, E., Cipresso, P., Serino, S., Pallavicini, F., Albani, G., & Riva, G. (2013). Virtual multiple errands test: Reliability, usability and possible applications. Annual Review of Cybertherapy and Telemedicine, 191, 48–52.
   Google Scholar
• Pollak, Y., Shomaly, H. B., Weiss, P. L., Rizzo, A. A., & Gross-Tsur, V. (2010). Methylphenidate effect in children with ADHD can be measured by an ecologically valid continuous performance test embedded in virtual reality. CNS Spectrums, 15, 125–130. doi: 10.1017/S109285290002736X
   PubMed Web of Science ®Google Scholar
• Pollak, Y., Weiss, P. L., Rizzo, A. A., Weizer, M., Shriki, L., Shalev, R. S., & Gross-Tsur, V. (2009). The utility of a continuous performance test embedded in virtual reality in measuring ADHD-related deficits. Journal of Developmental & Behavioral Pediatrics, 30, 2–6. doi: 10.1097/DBP.0b013e3181969b22
   PubMed Web of Science ®Google Scholar
• Pugnetti, L., Mendozzi, L., Attree, E. A., Barbieri, E., Brooks, B. M., Cazzullo, C. L., …  Psychol, C. (1998). Probing memory and executive functions with virtual reality: Past and present studies. CyberPsychology and Behavior, 1, 151–161. doi: 10.1089/cpb.1998.1.151
   Google Scholar
• Pugnetti, L., Mendozzi, L., Motta, A., Cattaneo, A., Barbieri, E., & Brancotti, S. (1995). Evaluation and retraining of adults’ cognitive impairments: Which role for virtual reality technology? Computers in Biology and Medicine, 25, 213–227. doi: 10.1016/0010-4825(94)00040-W
   PubMed Web of Science ®Google Scholar
• Rabin, L. A., Burton, L. A., & Barr, W. B. (2007). Utilization rates of ecologically oriented instruments among clinical neuropsychologists. The Clinical Neuropsychologist, 21(5), 727–743. doi: 10.1080/13854040600888776
   PubMed Web of Science ®Google Scholar
• Rand, D., Rukan, S., Weiss, P., & Katz, N. (2009). Validation of the virtual MET as an assessment tool for executive functions. Neuropsychological Rehabilitation, 19, 583–602. doi: 10.1080/09602010802469074
   PubMed Web of Science ®Google Scholar
• Raspelli, S., Carelli, L., Morganti, F., Pedroli, E., Cipresso, P., Poletti, B., … Riva, G. (2012). Validating the Neuro VR-based virtual version of the multiple errands test: Preliminary results. Presence: Teleoperators and Virtual Environments, 21, 31–42. doi: 10.1162/PRES_a_00077
   Web of Science ®Google Scholar
• Renison, B., Ponsford, J., Testa, R., Richardson, B., & Brownfield, K. (2012). The ecological and construct validity of a newly developed measure of executive function: The virtual library task. Journal of the International Neuropsychological Society, 18, 440–450. doi: 10.1017/S1355617711001883
   PubMed Web of Science ®Google Scholar
• Robertson, I. H., Manly, T., Andrade, J., Baddeley, B. T., & Yiend, J. (1997). “Oops!”: Performance correlates of everyday attentional failures in traumatic brain injured and normal subjects. Neuropsychologia, 35, 747–758. doi: 10.1016/S0028-3932(97)00015-8
   PubMed Web of Science ®Google Scholar
• Saidel-Goley, I., Albiero, E., & Flannery, K. (2012). An evaluation of nonclinical dissociation utilizing a virtual environment shows enhanced working memory and attention. Cyberpsychology, Behavior, and Social Networking, 15, 112–116. doi: 10.1089/cyber.2011.0302
   PubMed Web of Science ®Google Scholar
• Sauzéon, H., N'Kaoua, B., Arvind Pala, P., Taillade, M., Auriacombe, S., & Guitton, P. (2014). Everyday-like memory for objects in ageing and Alzheimer's disease assessed in a visually complex environment: The role of executive functioning and episodic memory. Journal of Neuropsychology. doi:10.1111/jnp.12055
   PubMed Web of Science ®Google Scholar
• Sbordone, R. J. (2008). Ecological validity of neuropsychological testing: Critical issues. In A. M. Horton & D. Wedding (Eds.), The neuropsychology handbook (3rd ed., pp. 367–394). New York: Springer.
   Google Scholar
• Schatz, P., & Browndyke, J. (2002). Applications of computer-based neuropsychological assessment. Journal of Head Trauma Rehabilitation, 17, 395–410. doi: 10.1097/00001199-200210000-00003
   PubMed Web of Science ®Google Scholar
• Schultheis, M. T., Himelstein, J., & Rizzo, A. A. (2002). Virtual reality and neuropsychology: Upgrading the current tools. The Journal of Head Trauma Rehabilitation, 17, 378–394. doi: 10.1097/00001199-200210000-00002
   PubMed Web of Science ®Google Scholar
• Schultheis, M. T., & Mourant, R. (2001). Virtual reality and driving: The road to better assessment for cognitively impaired populations. Presence: Teleoperators and Virtual Environments, 10, 431–439. doi: 10.1162/1054746011470271
   Web of Science ®Google Scholar
• Schultheis, M. T., Rebimbas, J., Mourant, R., & Millis, S. R. (2007). Examining the usability of a virtual reality driving simulator. Assistive Technologies, 19, 1–10. doi: 10.1080/10400435.2007.10131860
   PubMed Web of Science ®Google Scholar
• Schultheis, M. T., & Rothbaum, B. O. (2002). Ethical issues for the use of virtual reality in the psychological sciences. In S. Bush & M. Drexler (Eds.), Ethical issues in clinical neuropsychology (pp. 243–280). Lisse, NL: Swets & Zeitlinger.
   Google Scholar
• Shallice, T. I. M., & Burgess, P. W. (1991). Deficits in strategy application following frontal lobe damage in man. Brain, 114, 727–741. doi: 10.1093/brain/114.2.727
   PubMed Web of Science ®Google Scholar
• Spooner, D. M., & Pachana, N. A. (2006). Ecological validity in neuropsychological assessment: A case for greater consideration in research with neurologically intact populations. Archives of Clinical Neuropsychology, 21, 327–337. doi: 10.1016/j.acn.2006.04.004
   PubMed Web of Science ®Google Scholar
• Stuss, D. T., Benson, D. F., Kaplan, E. F., Weir, W. S., Naeser, M. A., Lieberman, I., … Ferrill, D. (1983). The involvement of orbitofrontal cerebrum in cognitive tasks. Neuropsychologia, 21, 235–248. doi: 10.1016/0028-3932(83)90040-4
   PubMed Web of Science ®Google Scholar
• Stuss, D. T., Shallice, T., Alexander, M. P., & Picton, T. W. (1995). A multidisciplinary approach to anterior attentional functions. Annals of the New York Academy of Sciences, 769, 191–212. doi: 10.1111/j.1749-6632.1995.tb38140.x
   PubMed Web of Science ®Google Scholar
• Sweeney, S., Kersel, D., Morris, R. G., Manly, T., & Evans, J. J. (2010). The sensitivity of a virtual reality task to planning and prospective memory impairments: Group differences and the efficacy of periodic alerts on performance. Neuropsychological Rehabilitation, 20, 239–263. doi: 10.1080/09602010903080531
   PubMed Web of Science ®Google Scholar
• Toet, A., & van Schaik, M. G. (2013). Visual attention for a desktop virtual environment with ambient scent. Frontiers in Psychology, 4, 1–11. doi: 10.3389/fpsyg.2013.00883
   PubMed Web of Science ®Google Scholar
• Wald, J., & Liu, L. (2001). Psychometric properties of the driVR: A virtual reality driving assessment. Studies in Health Technology Information, 81, 564–566.
   PubMedGoogle Scholar
• Wald, J. L., Liu, L., & Reil, S. (2000). Concurrent validity of a virtual reality driving assessment in persons with brain injury. Cyberpsychology & Behavior, 3, 643–654. doi: 10.1089/109493100420232
   Google Scholar
• Weigl, E. (1927). Zur psychologie sogenannter abstraktionsprozesse. Zeitschrift fur Psychologie, 103, 2–45. [Translated by M. Rioch and reprinted as: On the psychology of so-called processes of abstraction. Journal of Abnormal and Social Psychology, 36, 3–33, 1948].
   Google Scholar
• Werner, P., Rabinowitz, S., Klinger, E., Korczyn, A., & Josman, N. (2009). Use of the virtual action planning supermarket for the diagnosis of mild cognitive impairment. Dementia and Geriatric Cognitive Disorders, 27, 301–309. doi: 10.1159/000204915
   PubMed Web of Science ®Google Scholar
• Wilson, B. A., Alderman, N., Burgess, P. W., Emslie, H., & Evans, J. J. (1996). Behavioural assessment of the dysexecutive syndrome (BADS). Bury St Edmunds: Thames Valley.
   Google Scholar