2,918
Views
105
CrossRef citations to date
0
Altmetric
Review Article

Virtual reality measures in neuropsychological assessment: a meta-analytic review

, , &
Pages 165-184 | Received 01 May 2015, Accepted 16 Jan 2016, Published online: 29 Feb 2016

References

  • *Adams, R., Finn, P., Moes, E., Flannery, K., & Rizzo, A. A. (2009). Distractibility in attention/deficit/ hyperactivity disorder (ADHD): The virtual reality classroom. Child Neuropsychology, 15, 120–135. doi:10.1080/09297040802169077
  • Albani, G., Pignatti, R., Bertella, L., Priano, L., Semenza, C., Molinari, E., … Mauro, A. (2002). Common daily activities in the virtual environment: A preliminary study in Parkinsonian patients. Neurological Sciences, 23, s49–s50. doi:10.1007/s100720200064
  • Aleman, A., Hijman, R., de Haan, E. H., & Kahn, R. S. (1999). Memory impairment in schizophrenia: A meta-analysis. American Journal of Psychiatry, 156, 1358–1366. Retrieved from http://psychiatryonline.org/doi/pdf/10.1176/ajp.156.9.1358
  • Alvarez, J. A., & Emory, E. (2006). Executive function and the frontal lobes: A meta-analytic review. Neuropsychology Review, 16, 17–42. doi:10.1007/s11065-006-9002-x
  • Armstrong, C. M., Reger, G. M., Edwards, J., Rizzo, A. A., Courtney, C. G., & Parsons, T. D. (2013). Validity of the virtual reality stroop task (VRST) in active duty military. Journal of Clinical and Experimental Neuropsychology, 35, 113–123. doi:10.1080/13803395.2012.740002
  • *Banville, F., Nolin, P., Lalonde, S., Henry, M., Dery, M. P., & Villemure, R. (2010). Multitasking and prospective memory: Can virtual reality be useful for diagnosis? Behavioural Neurology, 23, 209–211. doi:10.3233/BEN20100297
  • Belanger, H. G., Curtiss, G., Demery, J. A., Lebowitz, B. K., & Vanderploeg, R. D. (2005). Factors moderating neuropsychological outcomes following mild traumatic brain injury: A meta-analysis. Journal of the International Neuropsychological Society, 11, 215–227. doi:10.1017/S1355617705050277
  • *Bioulac, S., Lallemand, S., Rizzo, A., Philip, P., Fabrigoule, C., & Bouvard, M. P. (2012). Impact of time on task on ADHD patient’s performances in a virtual classroom. European Journal of Paediatric Neurology, 16, 514–521. doi:10.1016/j.ejpn.2012.01.006
  • Bokat, C. E., & Goldberg, T. E. (2003). Letter and category fluency in schizophrenic patients: A meta-analysis. Schizophrenia Research, 64, 73–78. doi: 10.1016/S0920-9964(02)00282-7
  • Boonstra, A. M., Oosterlaan, J., Sergeant, J. A., & Buitelaar, J. K. (2005). Executive functioning in adult ADHD: A meta-analytic review. Psychological Medicine, 35, 1097–1108. doi:10.1017/S003329170500499X
  • Borenstein, M., Hedges, L. V., Higgins, J. P., & Rothstein, H. R. (2005). Comprehensive meta-analysis version 2. Englewood, NJ: Biostat.
  • Borenstein, M., Hedges, L. V., Higgins, J. P., & Rothstein, H. R. (2009). Introduction to meta-analysis. West Sussex: Wiley.10.1002/9780470743386
  • Bridgett, D. J., & Walker, M. E. (2006). Intellectual functioning in adults with ADHD: A meta-analytic examination of full scale IQ differences between adults with and without ADHD. Psychological Assessment, 18(1), 1–14. doi:10.1037/1040-3590.18.1.1
  • *Broeren, J., Samuelsson, H., Stibrant-Sunnerhagen, K., Blomstrand, C., & Rydmark, M. (2007). Neglect assessment as an application of virtual reality. Acta Neurologica Scandinavica, 116, 157–163. doi:10.1111/j.1600-0404.2007.00821.x
  • Chan, C. L. F., Ngai, E. K. Y., Leung, P. C. H., & Wong, S. (2010). Effect of the adapted virtual reality cognitive training program among Chinese older adults with chronic schizophrenia: A pilot study. International Journal of Geriatric Psychiatry, 25, 643–649. doi:10.1002/gps.2403
  • Chaytor, N., & Schmitter-Edgecombe, M. (2003). The ecological validity of neuropsychological tests: A review of the literature on everyday cognitive skills. Neuropsychology Review, 13, 181–197. doi:10.1023/B:NERV.0000009483.91468.fb
  • Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.
  • Díaz-Orueta, U., Garcia-López, C., Crespo-Eguílaz, N., Sánchez-Carpintero, R., Climent, G., & Narbona, J. (2014). AULA virtual reality test as an attention measure: Convergent validity with Conners’ continuous performance test. Child Neuropsychology, 20, 328–342. doi:10.1080/09297049.2013.792332
  • Diaz-Orueta, U., Alvarado, S., Gutiérrez, D., Climent, G., & Banterla, F. (2012). “Isla Calma”, a novel virtual reality environment for pain and anxiety distraction: Report on usability, acceptability, and subjective experience. Games for Health Journal, 1, 353–361. doi:10.1089/g4h.2012.0037
  • Duval, S., & Tweedie, R. (2000). Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics, 56, 455–463. doi:10.1111/j.0006-341X.2000.00455.x
  • Elkind, J. S. (1998). Use of virtual reality to diagnose and habilitate people with neurological dysfunctions. CyberPsychology & Behavior, 1, 263–273. doi:10.1089/cpb.1998.1.263
  • Elkind, J. S., Rubin, E., Rosenthal, S., Skoff, B., & Prather, P. (2001). A simulated reality scenario compared with the computerized Wisconsin card sorting test: An analysis of preliminary results. CyberPsychology & Behavior, 4, 489–496. doi:10.1089/109493101750527042
  • *Erez, N., Weiss, P. L., Kizony, R., Rand, D. (2013). Comparing performance within a virtual supermarket of children with traumatic brain injury to typically developing children: A pilot study. OTJR: Occupation, Participation & Health, 33, 218–227. doi:10.3928/15394492-20130912-04
  • Forbes, N. F., Carrick, L. A., McIntosh, A. M., & Lawrie, S. M. (2009). Working memory in schizophrenia: A meta-analysis. Psychological Medicine, 39, 889–905. doi:10.1017/S0033291708004558
  • Foreman, N., & Stirk, J. (2005). Commentary on Rose, F.D., Brooks, B.M., & Rizzo, A.A., virtual reality in brain damage rehabilitation: Review. CyberPsychology & Behavior, 8, 263–264. doi:10.1089/cpb.2005.8.263
  • Frazier, T. W., Demaree, H. A., & Youngstrom, E. A. (2004). Meta-analysis of intellectual and neuropsychological test performance in attention-deficit/hyperactivity disorder. Neuropsychology, 18, 543–555. doi:10.1037/0894-4105.18.3.543
  • Frencham, K. A., Fox, A. M., & Maybery, M. T. (2005). Neuropsychological studies of mild traumatic brain injury: A meta-analytic review of research since 1995. Journal of Clinical and Experimental Neuropsychology, 27, 334–351. doi:10.1080/13803390490520328
  • Gamberini, L. (2000). Virtual reality as a new research tool for the study of human memory. CyberPsychology & Behavior, 3, 337–342. doi:10.1089/10949310050078779
  • *Gilboa, Y., Rosenblum, S., Fattal-Valevski, A., Toledano-Alhadef, H., Rizzo, A. S., & Josman, N. (2011). Using a virtual classroom environment to describe the attention deficits profile of children with Neurofibromatosis type 1. Research in Developmental Disabilities, 32, 2608–2613. doi:10.1016/j.ridd.2011.06.014
  • Henry, J. D., & Crawford, J. R. (2004). A meta-analytic review of verbal fluency performance in patients with traumatic brain injury. Neuropsychology, 18, 621–628. doi:10.1037/0894-4105.18.4.621
  • Henry, J. D., Crawford, J. R., & Phillips, L. H. (2004). Verbal fluency performance in dementia of the Alzheimer’s type: A meta-analysis. Neuropsychologia, 42, 1212–1222. doi:10.1016/j.neuropsychologia.2004.02.001
  • Henry, M., Joyal, C. C., & Nolin, P. (2012). Development and initial assessment of a new paradigm for assessing cognitive and motor inhibition: The bimodal virtual-reality Stroop. Journal of Neuroscience Methods, 210, 125–131. doi:10.1016/j.jneumeth.2012.07.025
  • Hervey, A. S., Epstein, J. N., & Curry, J. F. (2004). Neuropsychology of adults with attention-deficit/hyperactivity disorder: A meta-analytic review. Neuropsychology, 18, 485–503. doi:10.1037/0894-4105.18.3.485
  • Homack, S., & Riccio, C. A. (2004). A meta-analysis of the sensitivity and specificity of the Stroop color and word test with children. Archives of Clinical Neuropsychology, 19, 725–743. doi:10.1016/j.acn.2003.09.003
  • Huang-Pollock, C. L., Karalunas, S. L., Tam, H., & Moore, A. N. (2012). Evaluating vigilance deficits in ADHD: A meta-analysis of CPT performance. Journal of Abnormal Psychology, 121, 360–371. doi:10.1037/a0027205
  • Iriarte, Y., Diaz-Orueta, U., Cueto, E., Irazustabarrena, P., Banterla, F., … Climent, G. (2012). AULA – Advanced virtual reality tool for the assessment of attention: Normative study in Spain. Journal of Attention Disorders,XX(X), 1–27. doi:10.1177/1087054712465335
  • *Kang, Y. J., Ku, J., Han, K., Kim, S. I., Yu, T. W., Lee, J. H., & Park, C. I. (2008). Development and clinical trial of virtual reality-based cognitive assessment in people with stroke: Preliminary study. CyberPsychology & Behavior, 11, 329–339. doi:10.1089/cpb.2007.0116
  • *Kim, K., Kim, J., Ku, J., Kim, D. Y., Chang, W. H., Shin, D. I., … Kim, S. I. (2004). A virtual reality assessment and training system for unilateral neglect. CyberPsychology & Behavior, 7, 742–749. doi:10.1089/cpb.2004.7.742
  • *Ku, J., Cho, W., Kim, J. J., Peled, A., Wiederhold, B. K., Wiederhold, M. D., … Kim, S. I. (2003). A virtual environment for investigating schizophrenic patients’ characteristics: Assessment of cognitive and navigation ability. CyberPsychology & Behavior, 6, 397–404. doi:10.1089/109493103322278781
  • Ku, J., Cho, W. G., Kim, J. H., Kim, K. U., Kim, B. N., Hahn, W. Y., … Kim, S. I. (2004). The development of a VR system for the cognitive & behavioral assessment of schizophrenia. In J. D. Westwood et al. (Eds.), Studies in health technology and informatics (pp. 180–182). Amsterdam: IOS Press. doi:10.3233/978-1-60750-942-4-180
  • Lalonde, G., Henry, M., Drouin-Germain, A., Nolin, P., & Beauchamp, M. H. (2013). Assessment of executive function in adolescence: A comparison of traditional and virtual reality tools. Journal of Neuroscience Methods, 219, 76–82. doi:10.1016/j.jneumeth.2013.07.00
  • Lansbergen, M. M., Kenemans, J. L., & van Engeland, H. (2007). Stroop interference and attention-deficit/hyperactivity disorder: A review and meta-analysis. Neuropsychology, 21, 251–262. doi:10.1037/0894-4105.21.2.251
  • Lee, J. H., Ku, J., Cho, W., Hahn, W. Y., Kim, I. Y., Lee, S. M., & Kim, S. I. (2003). A virtual reality system for the assessment and rehabilitation of the activities of daily living. CyberPsychology & Behavior, 6, 383–388. doi:10.1089/109493103322278763
  • Lezak, M. D. (1995). Neuropsychological assessment (3rd ed.). New York, NY: Oxford University Press.
  • Losier, B. J., McGrath, P. J., & Klein, R. M. (1996). Error patterns on the continuous performance test in non-medicated and medicated samples of children with and without ADHD: A meta-analytic review. Journal of Child Psychology and Psychiatry, 37, 971–987. doi:10.1111/j.1469-7610.1996.tb01494.x
  • Mania, K., & Chalmers, A. (2001). The effects of levels of immersion on memory and presence in virtual environments: A reality centered approach. CyberPsychology & Behavior, 4(2), 247–264. doi:10.1089/109493101300117938.
  • Matheis, R. J., Schultheis, M. T., Tiersky, L. A., DeLuca, J., Millis, S.R., & Rizzo, A. (2007). Is learning and memory different in a virtual environment? The Clinical Neuropsychologist, 21, 146–161. doi:10.1080/13854040601100668
  • Mesholam-Gately, R. I., Giuliano, A. J., Goff, K. P., Faraone, S. V., & Seidman, L. J. (2009). Neurocognition in first-episode schizophrenia: A meta-analytic review. Neuropsychology, 23, 315–336. doi:10.1037/a0014708
  • *Moreau, G., Guay, M.-C., Achim, A., Rizzo, A., & Lageix, P. (2006). The virtual classroom: An ecological version of the continuous performance test – A pilot study. In B. C. Wiederhold, S. Bouchard, & G. Riva (Eds.), Annual review of cybertherapy and medicine (Vol. 4, pp. 59–65). San Diego, CA: Interactive Media Institute.
  • Morganti, F. (2004). Virtual interaction in cognitive neuropsychology. Studies in Health Technology and Informatics, 99, 55–70. doi:10.3233/978-1-60750-943-1-55
  • Myers, R. L., & Bierig, T. A. (2000). Virtual reality and left hemineglect: A technology for assessment and therapy. CyberPsychology & Behavior, 3, 465–468. doi:10.1089/10949310050078922
  • Opriş, D., Pintea, S., García-Palacios, A., Botella, C., Szamosközi, Ş., & David, D. (2012). Virtual reality exposure therapy in anxiety disorders: A quantitative meta-analysis. Depression and Anxiety, 29, 85–93. doi:10.1002/da.20910
  • Parsons, T. D., & Rizzo, A. A. (2008). Affective outcomes of virtual reality exposure therapy for anxiety and specific phobias: A meta-analysis. Journal of Behavior Therapy and Experimental Psychiatry, 39, 250–261. doi:10.1016/j.jbtep.2007.07.007
  • Parsons, T. D., Larson, P., Kratz, K., Thiebaux, M., Bluestein, B., Buckwalter, J. G., & Rizzo, A. A. (2004). Sex differences in mental rotation and spatial rotation in a virtual environment. Neuropsychologia, 42, 555–562. doi:10.1016/j.neuropsychologia.2003.08.014
  • *Parsons, T. D., Rizzo, A. A., Bamattre, J., & Brennan, J. (2007). Virtual reality cognitive performance assessment test. Annual Review of CyberTherapy and Telemedicine, 5, 143–149.
  • Parsons, T. D., Courtney, C. G., & Dawson, M. E. (2013). Virtual reality Stroop task for assessment of supervisory attentional processing. Journal of Clinical and Experimental Neuropsychology, 35, 812–826. doi:10.1080/13803395.2013.824556
  • *Pollak, Y., Weiss, P. L., Rizzo, A. A., Weizer, M., Shriki, L., Shalev, R. S., & Gross-Tsur, V. (2009). The utility of a continuous performance test embedded in virtual reality in measuring ADHD-related deficits. Journal of Developmental & Behavioral Pediatrics, 30, 2–6. doi:10.1097/DBP.0b013e3181969b22
  • Powers, M. B., & Emmelkamp, P. M. (2008). Virtual reality exposure therapy for anxiety disorders: A meta-analysis. Journal of Anxiety Disorders, 22, 561–569. doi:10.1016/j.janxdis.2007.04.006
  • *Pugnetti, L., Mendozzi, L., Attree, E. A., Barbieri, E., Brooks, B. M., & Cazzullo, C. L. (1998a). Probing memory and executive functions with virtual reality: Past and present studies. CyberPsychology & Behavior, 1, 151–162. doi:10.1089/cpb.1998.1.151
  • Pugnetti, L., Mendozzi, L., Barbieri, E., & Motta, A. (1998b). VR experience with neurological patients: Basic cost/benefit issues. In G. Riva, B. C. Wiederhold, & E. Molinari (Eds.), Virtual environments in clinical psychology and neuroscience (pp. 243–248). Amsterdam: IOS Press.
  • Pugnetti, L., Attree, E.A., Mendozzi, L., Barbieri, E., Motta, A., Alpini, D., & Rose, F. D. (1999). Developments of collaborative research on VR applications in mental health. Focus on cybersickness and memory testing. The International Journal of Virtual Reality, 4, 41–47.
  • Rand, D., Kizony, R., Feintuch, U., Katz, N., Josman, N., Rizzo, A., & Weiss, P. L. (2005). Comparison of two VR platforms for rehabilitation: Video capture versus HMD. Presence: Teleoperators and Virtual Environments, 14, 147–160. doi:10.1162/1054746053967012
  • *Rand, D., Katz, N., & Weiss, P. L. (2007). Evaluation of virtual shopping in the VMall: Comparison of post-stroke participants to healthy control groups. Disability and Rehabilitation, 29, 1710–1719. doi:10.1080/09638280601107450
  • *Rand, D., Basha-Abu Rukan, S., Weiss, P. L., & Katz, N. (2009). Validation of the Virtual MET as an assessment tool for executive functions. Neuropsychological Rehabilitation, 19, 583–602. doi:10.1080/09602010802469074
  • Rheingold, H. (1991). Virtual reality. New York, NY: Summit.
  • Riva, G. (1998). Virtual reality as assessment tool in psychology. In G. Riva (Ed.), Virtual reality in neuro-psycho-physiology (pp. 71–79). Amsterdam: IOS Press.
  • Rizzo, A. A., Buckwalter, J. G., Neumann, U., Chua, C., Van Rooyen, A., Larson, P., & Humphrey, L. (1999). Virtual environments for targeting cognitive processes: An overview of projects at the University of Southern California. CyberPsychology & Behavior, 2, 89–100. doi:10.1089/cpb.1999.2.89
  • Rizzo, A. A., Buckwalter, J. G., Bowerly, T., Van Der Zaag, C., Humphrey, L., Neumann, U., & Sisemore, D. (2000). The virtual classroom: A virtual reality environment for the assessment and rehabilitation of attention deficits. CyberPsychology & Behavior, 3, 483–499. doi:10.1089/10949310050078940
  • Rizzo, A. A., Schultheis, M., Kerns, K. A., & Mateer, C. (2004). Analysis of assets for virtual reality applications in neuropsychology. Neuropsychological Rehabilitation, 14, 207–239. doi:10.1080/09602010343000183
  • Rizzo, A. A., Bowerly, T., Buckwalter, J. G., Klimchuk, D., Mitura, R., & Parsons, T. D. (2006). A virtual reality scenario for all seasons: The virtual classroom. CNS Spectrums, 11, 35–44. doi:10.1017/S1092852900024196
  • Robertson, I. H., Ward, T., Ridgeway, V., & Nimmo-Smith, I. (1996). The structure of normal human attention: The Test of Everyday Attention. Journal of the International Neuropsychological Society, 2(06), 525–534. doi:10.1017/S1355617700001697.
  • Rohling, M. L., Binder, L. M., Demakis, G. J., Larrabee, G. J., Ploetz, D. M., & Langhinrichsen-Rohling, J. (2011). A meta-analysis of neuropsychological outcome after mild traumatic brain injury: Re-analyses and reconsiderations of Binder et al. (1997), Frencham et al. (2005), and Pertab et al. (2009). The Clinical Neuropsychologist, 25, 608–623. doi:10.1080/13854046.2011.565076
  • Rose, F. D., Brooks, B. M., & Rizzo, A. A. (2005). Virtual reality in brain damage rehabilitation: Review. CyberPsychology & Behavior, 8, 241–262. doi:10.1089/cpb.2005.8.241
  • Ruttan, L., Martin, K., Liu, A., Colella, B., & Green, R. E. (2008). Long-term cognitive outcome in moderate to severe traumatic brain injury: A meta-analysis examining timed and untimed tests at 1 and 4.5 or more years after injury. Archives of Physical Medicine and Rehabilitation, 89, S69–S76. doi:10.1016/j.apmr.2008.07.007
  • Schretlen, D. J., & Shapiro, A. M. (2003). A quantitative review of the effects of traumatic brain injury on cognitive functioning. International Review of Psychiatry, 15, 341–349. doi:10.1080/09540260310001606728
  • Schultheis, M. T., Himelstein, J., & Rizzo, A. A. (2002). Virtual reality and neuropsychology. Journal of Head Trauma Rehabilitation, 17, 378–394.10.1097/00001199-200210000-00002
  • *Siemerkus, J., Irle, E., Schmidt-Samoa, C., Dechent, P., & Weniger, G. (2012). Egocentric spatial learning in schizophrenia investigated with functional magnetic resonance imaging. NeuroImage: Clinical, 1, 153–163. doi:10.1016/j.nicl.2012.10.004
  • Shallice, T. I. M., & Burgess, P. W. (1991). Deficits in strategy application following frontal lobe damage in man. Brain, 114(2), 727–741. doi:10.1093/brain/114.2.727.
  • Soper, D. (2015). Statistics calculators. Retrieved from http://www.danielsoper.com/statcalc3/calc.aspx?id=98
  • Urbina, S. (2004). Essentials of psychological testing. New Jersey, NJ: Wiley.
  • Vanderploeg, R. D., Curtiss, G., & Belanger, H. G. (2005). Long-term neuropsychological outcomes following mild traumatic brain injury. Journal of the International Neuropsychological Society, 11, 228–236. doi:10.1017/0S1355617705050289
  • Voyer, D., Voyer, S., & Bryden, M. P. (1995). Magnitude of sex differences in spatial abilities: A meta-analysis and consideration of critical variables. Psychological Bulletin, 117, 250–270. doi:10.1037/0033-2909.117.2.250
  • Wasserman, J. D., & Bracken, B. A. (2003). Psychometric characteristics of assessment procedures. In J. R. Graham & J. A. Naglieri (Eds.), Handbook of psychology (pp. 43–66). New Jersey, NJ: Wiley.
  • Wilson, B. A., Cockburn, J., & Baddeley, A. D. (1985). The Rivermead Behavioural Memory Test. Titchfield: Thames Valley Test Co.
  • Wilson, B. A., Alderman, N., Burgess, P. W., Emslie, H., & Evans, J. J. (1996). Behavioural assessment of the dysexecutive syndrome. St Edmunds, UK: Thames Valley Test Company.
  • Zakzanis, K. K. (2001). Statistics to tell the truth, the whole truth, and nothing but the truth Formulae, illustrative numerical examples, and heuristic interpretation of effect size analyses for neuropsychological researchers. Archives of Clinical Neuropsychology, 16, 653–667. doi:10.1016/S0887-6177(00)00076-7

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.