Virtual-reality-based attention assessment of ADHD: ClinicaVR: Classroom-CPT versus a traditional continuous performance test

References

• Adams, R., Finn, P., Moes, E., Flannery, K., & Rizzo, A. A. (2009). Distractibility in Attention/Deficit/Hyperactivity Disorder (ADHD): The virtual reality classroom. Child Neuropsychology, 15(2), 120–135. doi:10.1080/09297040802169077
   PubMed Web of Science ®Google Scholar
• Agarwal, R., & Karahanna, E. (2000). Time flies when you’re having fun: Cognitive absorption and beliefs about information technology usage. MIS Quarterly, 24(4), 665–694. doi:10.2307/3250951
   Web of Science ®Google Scholar
• American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (4th ed.). Washington, DC: Author.
   Google Scholar
• American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Washington, DC: Author.
   Google Scholar
• Andreassi, J. L. (2007). Psychophysiology: Human behavior & physiological response. Hillsdale, NJ: Lawrence Erlbaum.
   Google Scholar
• Areces, D., Rodríguez, C., García, T., Cueli, M., & González-Castro, P. (2016). Efficacy of a continuous performance test based on virtual reality in the diagnosis of ADHD and its clinical presentations. Journal of Attention Disorders, 1–11. doi:10.1177/1087054716629711
   Web of Science ®Google Scholar
• Barkley, R. A. (1991). The ecological validity of laboratory and analogue assessment methods of ADHD symptoms. Journal of Abnormal Child Psychology, 19(2), 149–178. doi:10.1007/BF00909976
   PubMed Web of Science ®Google Scholar
• Barkley, R. A. (2006). Attention deficit hyperactivity disorder: A handbook for diagnosis and treatment. New York, NY: Guilford.
   Google Scholar
• Barkley, R. A., Grodzinsky, G., & DuPaul, G. J. (1992). Frontal lobe functions in attention deficit disorder with and without hyperactivity: A review and research report. Journal of Abnormal Child Psychology, 20(2), 163–188. doi:10.1007/BF00916547
   PubMed Web of Science ®Google Scholar
• Berger, I., & Cassuto, H. (2014). The effect of environmental distractors incorporation into a CPT on sustained attention and ADHD diagnosis among adolescents. Journal of Neuroscience Methods, 222, 62–68. doi:10.1016/j.jneumeth.2013.10.012
   PubMed Web of Science ®Google Scholar
• Berwid, O. G., Curko Kera, E. A., Marks, D. J., Santra, A., Bender, H. A., & Halperin, J. M. (2005). Sustained attention and response inhibition in young children at risk for attention deficit/hyperactivity disorder. Journal of Child Psychology and Psychiatry, 46(11), 1219–1229. doi:10.1111/j.1469-7610.2005.00417.x
   PubMed Web of Science ®Google Scholar
• Biederman, J., Mick, E., & Faraone, S. V. (2000). Age-dependent decline of symptoms of attention deficit hyperactivity disorder: Impact of remission definition and symptom type. American Journal of Psychiatry, 157(5), 816–818. doi:10.1176/appi.ajp.157.5.816
   PubMed Web of Science ®Google Scholar
• Bioulac, S., Lallemand, S., Rizzo, A., Philip, P., Fabrigoule, C., & Bouvard, M. P. (2012). Impact of time on task on ADHD patient’s performances in a virtual classroom. European Journal of Paediatric Neurology, 16, 514–521. doi:10.1016/j.ejpn.2012.01.006
   PubMed Web of Science ®Google Scholar
• Bohil, C. J., Alicea, B., & Biocca, F. A. (2011). Virtual reality in neuroscience research and therapy. Nature Reviews Neuroscience, 12(12), 752–762. doi:10.1038/nrn3122
   PubMed Web of Science ®Google Scholar
• Brickenkamp, R., & Zillmer, E. A. (1998). d2 test of attention. Göttingen: Hogrefe & Huber.
   Google Scholar
• Brocki, K. C., & Bohlin, G. (2006). Developmental change in the relation between executive functions and symptoms of ADHD and co‐occurring behaviour problems. Infant and Child Development, 15(1), 19–40. doi:10.1002/icd.413
   Web of Science ®Google Scholar
• Chaytor, N., & Schmitter-Edgecombe, M. (2003). The ecological validity of neuropsychological tests: A review of the literature on everyday cognitive skills. Neuropsychology Review, 13(4), 181–197. doi:10.1023/B:NERV.0000009483.91468.fb
   PubMed Web of Science ®Google Scholar
• Chaytor, N., Schmitter-Edgecombe, M., & Burr, R. (2006). Improving the ecological validity of executive functioning assessment. Archives of Clinical Neuropsychology, 21(3), 217–227. doi:10.1016/j.acn.2005.12.002
   PubMed Web of Science ®Google Scholar
• Conners, C. K. (1995). Conners’ continuous performance test. Toronto: Multi-Health Systems.
   Google Scholar
• Conners, C. K., Epstein, J. N., Angold, A., & Klaric, J. (2003). Continuous performance test performance in a normative epidemiological sample. Journal of Abnormal Child Psychology, 31(5), 555–562. doi:10.1023/A:1025457300409
   PubMed Web of Science ®Google Scholar
• Díaz-Orueta, U., Garcia-López, C., Crespo-Eguílaz, N., Sánchez-Carpintero, R., Climent, G., & Narbona, J. (2014). AULA virtual reality test as an attention measure: Convergent validity with Conners’ continuous performance test. Child Neuropsychology, 20(3), 328–342. doi:10.1080/09297049.2013.792332
   PubMed Web of Science ®Google Scholar
• Dobrean, A. (2010). Test d2 – Test de atenție [d2 test of attention]. Cluj-Napoca: Romanian Testing Services.
   Google Scholar
• Dobrean, A., Raven, J., Comşa, M., Rusu, C., & Balázsi, R. (2008). The Romanian standardisation of the standard progressive matrices plus: Sample and general results. In J. Raven & C. J. Raven (Eds.), Uses and abuses of intelligence: Studies advancing Spearman and Raven’s quest for non arbitrary metrics. Cluj-Napoca: Romanian Testing Services.
   Google Scholar
• Domuţa, A., Balázsi, R., Porumb, M., Rusu, C., & Comşa, M. (2003). Standardizarea pe populaţia României a testului Matrici Progresive Raven Standard Plus în Matricile Progresive Raven Standard. Manual de utilizare [The Romanian standardisation of the standard progressive matrices plus. Technical manual]. Cluj-Napoca: Romanian Testing Services.
   Google Scholar
• Epstein, J. N., Erkanli, A., Conners, C. K., Klaric, J., Costello, J. E., & Angold, A. (2003). Relations between continuous performance test performance measures and ADHD behaviors. Journal of Abnormal Child Psychology, 31(5), 543–554. doi:10.1023/A:1025405216339
   PubMed Web of Science ®Google Scholar
• Erez, N., Weiss, P. L., Kizony, R., & Rand, D. (2013). Comparing performance within a virtual supermarket of children with traumatic brain injury to typically developing children: A pilot study. OTJR: Occupation, Participation & Health, 33(44), 218–227. doi:10.3928/15394492-20130912-04
   PubMed Web of Science ®Google Scholar
• Field, A. (2009). Discovering statistics using IBM SPSS statistics (3rd ed.). London: Sage.
   Google Scholar
• Frazier, T. W., Demaree, H. A., & Youngstrom, E. A. (2004). Meta-analysis of intellectual and neuropsychological test performance in attention-deficit/hyperactivity disorder. Neuropsychology, 18(3), 543–555. doi:10.1037/0894-4105.18.3.543
   PubMed Web of Science ®Google Scholar
• Gamberini, L. (2000). Virtual reality as a new research tool for the study of human memory. CyberPsychology & Behavior, 3(3), 337–342. doi:10.1089/10949310050078779
   Google Scholar
• Gevins, A., Smith, M. E., McEvoy, L., & Yu, D. (1997). High-resolution EEG mapping of cortical activation related to working memory: Effects of task difficulty, type of processing, and practice. Cerebral Cortex, 7(4), 374–385. doi:10.1093/cercor/7.4.374
   PubMed Web of Science ®Google Scholar
• Grodzinsky, G. M., & Barkley, R. A. (1999). Predictive power of frontal lobe tests in the diagnosis of attention deficit hyperactivity disorder. The Clinical Neuropsychologist, 13(1), 12–21. doi:10.1076/clin.13.1.12.1983
   PubMed Web of Science ®Google Scholar
• Gualtieri, T., & Johnson, L. G. (2005). ADHD: Is objective diagnosis possible? Psychiatry, 2(11), 44–53.
   PubMedGoogle Scholar
• Holzinger, A., Searle, G., & Wernbacher, M. (2011). The effect of previous exposure to technology on acceptance and its importance in usability and accessibility engineering. Universal Access in the Information Society, 10(3), 245–260. doi:10.1007/s10209-010-0212-x
   Web of Science ®Google Scholar
• Huang-Pollock, C. L., Karalunas, S. L., Tam, H., & Moore, A. N. (2012). Evaluating vigilance deficits in ADHD: A meta-analysis of CPT performance. Journal of Abnormal Psychology, 121(2), 360–371. doi:10.1037/a0027205
   PubMed Web of Science ®Google Scholar
• Iriarte, Y., Diaz-Orueta, U., Cueto, E., Irazustabarrena, P., Banterla, F., & Climent, G. (2012). AULA—Advanced virtual reality tool for the assessment of attention: Normative study in Spain. Journal of Attention Disorders, XX(X), 1–27. doi:10.1177/1087054712465335
   Web of Science ®Google Scholar
• Jensen, P. S., Martin, D., & Cantwell, D. P. (1997). Comorbidity in ADHD: Implications for research, practice, and DSM-V. Journal of the American Academy of Child & Adolescent Psychiatry, 36(8), 1065–1079. doi:10.1097/00004583-199708000-00014
   PubMed Web of Science ®Google Scholar
• Kennedy, R. S., Lane, N. E., Berbaum, K. S., & Lilienthal, M. G. (1993). Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness. The International Journal of Aviation Psychology, 3(3), 203–220. doi:10.1207/s15327108ijap0303_3
   Google Scholar
• Ku, J., Cho, W., Kim, J. J., Peled, A., Wiederhold, B. K., Wiederhold, M. D., & Kim, S. I. (2003). A virtual environment for investigating schizophrenic patients’ characteristics: Assessment of cognitive and navigation ability. CyberPsychology & Behavior, 6(4), 397–404. doi:10.1089/109493103322278781
   PubMedGoogle Scholar
• Lange, K. W., Hauser, J., Lange, K. M., Makulska-Gertruda, E., Takano, T., Takeuchi, Y., … Tucha, O. (2014). Utility of cognitive neuropsychological assessment in attention-deficit/hyperactivity disorder. ADHD Attention Deficit and Hyperactivity Disorders, 6(4), 241–248. doi:10.1007/s12402-014-0132-3
   Google Scholar
• Leark, R. A., Greenberg, L. M., Kindschi, C. L., Dupuy, T. R., & Hughes, S. J. (2007). Test of variables of attention continuous performance test: Professional manual. Los Alamitos, CA: TOVA.
   Google Scholar
• Losier, B. J., McGrath, P. J., & Klein, R. M. (1996). Error patterns on the continuous performance test in non‐medicated and medicated samples of children with and without ADHD: A meta‐analytic review. Journal of Child Psychology and Psychiatry, 37(8), 971–987. doi:10.1111/j.1469-7610.1996.tb01494.x
   PubMed Web of Science ®Google Scholar
• Matheis, R. J., Schultheis, M. T., Tiersky, L. A., DeLuca, S. R., Millis, S. R., & Rizzo, A. (2007). Is learning and memory different in a virtual environment? The Clinical Neuropsychologist, 21(1), 146–161. doi:10.1080/13854040601100668
   PubMed Web of Science ®Google Scholar
• Millisecond. (2012). Inquisit (Version 3) [Computer software]. Seattle, WA: Millisecond Software.
   Google Scholar
• Neguţ, A., Matu, S. A., Sava, F. A., & David, D. (2016a). Task difficulty of virtual reality-based assessment tools compared to classical paper-and-pencil or computerized measures: A meta-analytic approach. Computers in Human Behavior, 54, 414–424. doi:10.1016/j.chb.2015.08.029
   Web of Science ®Google Scholar
• Neguț, A., Matu, S. A., Sava, F. A., & David, D. (2016b). Virtual reality measures in neuropsychological assessment: A meta-analytic review. The Clinical Neuropsychologist, 30(2), 165–184. doi:10.1080/13854046.2016.1144793
   PubMed Web of Science ®Google Scholar
• Nigg, J. T., Hinshaw, S. P., & Halperin, J. M. (1996). Continuous performance test in boys with attention deficit hyperactivity disorder: Methylphenidate does response and relations with observed behaviors. Journal of Clinical Child Psychology, 25(3), 330–340. doi:10.1207/s15374424jccp2503_9
   Web of Science ®Google Scholar
• Nolin, P., Stipanicic, A., Henry, M., Lachapelle, Y., Lussier-Desrochers, D., & Allain, P. (2016). ClinicaVR: Classroom-CPT: A virtual reality tool for assessing attention and inhibition in children and adolescents. Computers in Human Behavior, 59, 327–333. doi:10.1016/j.chb.2016.02.023
   Web of Science ®Google Scholar
• Parsey, C. M., & Schmitter-Edgecombe, M. (2013). Applications of technology in neuropsychological assessment. The Clinical Neuropsychologist, 27(8), 1328–1361. doi:10.1080/13854046.2013.834971
   PubMed Web of Science ®Google Scholar
• Parsons, T. D., Bowerly, T., Buckwalter, J. G., & Rizzo, A. A. (2007). A controlled clinical comparison of attention performance in children with ADHD in a virtual reality classroom compared to standard neuropsychological methods. Child Neuropsychology, 13(4), 363–381. doi:10.1080/13825580600943473
   PubMed Web of Science ®Google Scholar
• Parsons, T. D., & Courtney, C. G. (2014). An initial validation of the virtual reality paced auditory serial addition test in a college sample. Journal of Neuroscience Methods, 222, 15–23. doi:10.1016/j.jneumeth.2013.10.006
   PubMed Web of Science ®Google Scholar
• Pollak, Y., Shomaly, H. B., Weiss, P. L., Rizzo, A. A., & Gross-Tsur, V. (2010). Methylphenidate effect in children with ADHD can be measured by an ecologically valid continuous performance test embedded in virtual reality. CNS spectrums, 15(02), 125–130. doi:10.1017/S109285290002736X
   PubMed Web of Science ®Google Scholar
• Pollak, Y., Weiss, P. L., Rizzo, A. A., Weizer, M., Shriki, L., Shalev, R. S., & Gross-Tsur, V. (2009). The utility of a continuous performance test embedded in virtual reality in measuring ADHD-related deficits. Journal of Developmental & Behavioral Pediatrics, 30(1), 2–6. doi:10.1097/DBP.0b013e3181969b22
   PubMed Web of Science ®Google Scholar
• Preston, A. S., Fennell, E. B., & Bussing, R. (2005). Utility of a CPT in diagnosing ADHD among a representative sample of high-risk children: A cautionary study. Child Neuropsychology, 11(5), 459–469. doi:10.1080/09297040591001067
   PubMed Web of Science ®Google Scholar
• Rand, D., Basha-Abu Rukan, S., Weiss, P. L., & Katz, N. (2009). Validation of the virtual MET as an assessment tool for executive functions. Neuropsychological Rehabilitation: An International Journal of Head Trauma Rehabilitation, 19(4), 583–602. doi:10.1080/09602010802469074
   Web of Science ®Google Scholar
• Rand, D., Katz, N., Shahar, M., Kizony, R., & Weiss, P. L. (2005). The virtual mall: A functional virtual environment for stroke rehabilitation. In B. C. Wiederhold, G. Riva, & A. H. Bullinger (Eds.), Annual review of cybertherapy and telemedicine: A decade of VR (Vol. 3, pp. 193–198). San Diego, CA: Interactive Media Institute.
   Google Scholar
• Rand, D., Katz, N., & Weiss, P. L. (2007). Evaluation of virtual shopping in the VMall: Comparison of post-stroke participants to healthy control groups. Disability and Rehabilitation, 29(22), 1710–1719. doi:10.1080/09638280601107450
   PubMed Web of Science ®Google Scholar
• Riccio, C. A., & Reynolds, C. R. (2001). Continuous performance tests are sensitive to ADHD in adults but lack specificity. Annals of the New York Academy of Sciences, 931(1), 113–139. doi:10.1111/j.1749-6632.2001.tb05776.x
   PubMed Web of Science ®Google Scholar
• Rizzo, A. A., Bowerly, T., Buckwalter, J. G., Klimchuk, D., Mitura, R., & Parsons, T. D. (2006). A virtual reality scenario for all seasons: The virtual classroom. CNS Spectrums, 11(1), 35–44. doi:10.1017/S1092852900024196
   PubMed Web of Science ®Google Scholar
• Rizzo, A. A., Buckwalter, J. G., Bowerly, T., Van Der Zaag, C., Humphrey, L., Neumann, U., & Sisemore, D. (2000). The virtual classroom: A virtual reality environment for the assessment and rehabilitation of attention deficits. CyberPsychology & Behavior, 3(3), 483–499. doi:10.1089/10949310050078940
   Google Scholar
• Robertson, I. H., Ward, T., Ridgeway, V., & Nimmo-Smith, I. (1996). The structure of normal human attention: The test of everyday attention. Journal of the International Neuropsychological Society, 2(06), 525–534. doi:10.1017/S1355617700001697
   PubMedGoogle Scholar
• Rosvold, H. E., Mirsky, A. F., Sarason, I., Bransome, E. D., & Beck, L. H. (1956). A continuous performance test of brain damage. Journal of Consulting Psychology, 20(5), 343–350. doi:10.1037/h0043220
   PubMedGoogle Scholar
• Sandford, J. A., & Turner, A. (1995). Manual for the integrated visual and auditory continuous performance test. Richmond, VA: Braintrain.
   Google Scholar
• Schultheis, M. T., Himelstein, J., & Rizzo, A. A. (2002). Virtual reality and neuropsychology: Upgrading the current tools. Journal of Head Trauma Rehabilitation, 17(5), 378–394. doi:10.1097/00001199-200210000-00002
   PubMed Web of Science ®Google Scholar
• Sergeant, J. A., Geurts, H., Huijbregts, S., Scheres, A., & Oosterlaan, J. (2003). The top and the bottom of ADHD: A neuropsychological perspective. Neuroscience & Biobehavioral Reviews, 27(7), 583–592. doi:10.1016/j.neubiorev.2003.08.004
   PubMed Web of Science ®Google Scholar
• Servera, M., & Cardo, E. (2006). Children sustained attention task (CSAT): Normative, reliability, and validity data. International Journal of Clinical and Health Psychology, 6(3), 697–707.
   Web of Science ®Google Scholar
• Servera, M., & Llabrés, J. (2004). Children Sustained Attention Task (CSAT). Madrid: TEA.
   Google Scholar
• Siemerkus, J., Irle, E., Schmidt-Samoa, C., Dechent, P., & Weniger, G. (2012). Egocentric spatial learning in schizophrenia investigated with functional magnetic resonance imaging. NeuroImage: Clinical, 1(1), 153–163. doi:10.1016/j.nicl.2012.10.004
   PubMed Web of Science ®Google Scholar
• Sonuga-Barke, E. J. (2003). The dual pathway model of AD/HD: An elaboration of neuro-developmental characteristics. Neuroscience & Biobehavioral Reviews, 22(7), 593–604. doi:10.1016/j.neubiorev.2003.08.005
   Web of Science ®Google Scholar
• Sonuga‐Barke, E. J. S., Taylor, E., Sembi, S., & Smith, J. (1992). Hyperactivity and delay aversion—I. The effect of delay on choice. Journal of Child Psychology and Psychiatry, 33(2), 387–398. doi:10.1111/j.1469-7610.1992.tb00874.x
   PubMed Web of Science ®Google Scholar
• Spooner, D. M., & Pachana, N. A. (2006). Ecological validity in neuropsychological assessment: A case for greater consideration in research with neurologically intact populations. Archives of Clinical Neuropsychology, 21(4), 327–337. doi:10.1016/j.acn.2006.04.004
   PubMed Web of Science ®Google Scholar
• Uno, M., Abe, J., Sawai, C., Sakaue, Y., Nishitani, A., Yasuda, Y., … Takeuchi, Y. (2006). Effect of additional auditory and visual stimuli on continuous performance test (noise-generated CPT) in AD/HD children–usefulness of noise-generated CPT. Brain & Development, 28(3), 162–169. doi:10.1016/j.braindev.2005.06.007
   PubMed Web of Science ®Google Scholar
• Van der Elst, W., Van Boxtel, M. P., Van Breukelen, G. J., & Jolles, J. (2008). A large-scale cross-sectional and longitudinal study into the ecological validity of neuropsychological test measures in neurologically intact people. Archives of Clinical Neuropsychology, 23(7), 787–800. doi:10.1016/j.acn.2008.09.002
   PubMed Web of Science ®Google Scholar
• Wasserman, J. D., & Bracken, B. A. (2003). Psychometric characteristics of assessment procedures. In J. R. Graham & J. A. Naglieri (Eds.), Handbook of psychology (pp. 43–66). Hoboken, NJ: John Wiley & Sons.
   Google Scholar
• Wechsler, D. (2003). Wechsler intelligence scale for children-WISC-IV. San Antonio, TX: Psychological Corporation.
   Google Scholar
• Wechsler, D., & Dobrean, A. (2012). Scala de Inteligenţă pentru copii Wechsler – ediţia a IVa (WISCIV). Manual tehnic şi de interpretare [Wechsler Intelligence Scale for Children-WISC-IV (WISC-IV). Technical and interpretive manual] (3rd ed.). Cluj-Napoca: Romanian Testing Services.
   Google Scholar
• Wilson, B. A., Alderman, N., Burgess, P., Emslie, H., & Evans, J. J. (1996). Behavioural Assessment of the Dysexecutive Syndrome (BADS). Bury St. Edmunds: Thames Valley Test Company.
   Google Scholar
• Wilson, B. A., Cockburn, J., & Baddeley, A. D. (1985). The rivermead behavioural memory test manual. Bury St. Edmunds: Thames Valley Test Company.
   Google Scholar
• Yalon-Chamovitz, S., & Weiss, P. L. T. (2008). Virtual reality as a leisure activity for young adults with physical and intellectual disabilities. Research in Developmental Disabilities, 29(3), 273–287. doi:10.1016/j.ridd.2007.05.004
   PubMed Web of Science ®Google Scholar