Computerized versus manual versions of the Wisconsin Card Sorting Test: Implications with typically developing and ADHD children

References

• American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (4th ed.).Washington, DC.
   Google Scholar
• Arán Filippetti, V., & Allegri, R. F. (2011). Verbal fluency in Spanish-speaking children: Analysis model according to task type, clustering, and switching strategies and performance over time. The Clinical Neuropsychologist, 25(3), 413–436. doi:10.1080/13854046.2011.559481
   PubMed Web of Science ®Google Scholar
• Arán Filippetti, V., & Mías, C. D. (2009). Neuropsicología del Trastorno por Déficit de Atención/Hiperactividad: subtipos predominio Déficit de Atención y predominio Hiperactivo-Impulsivo. Revista Argentina de Neuropsicología, 13, 14–28.
   Google Scholar
• Arán Filippetti, V., & Richaud, M. C. (2017). A structural equation modeling of executive functions, IQ and mathematical skills in primary students: Differential effects on number production, mental calculus and arithmetical problems. Child Neuropsychology, 23, 864–888. doi:10.1080/09297049.2016.1199665
   PubMed Web of Science ®Google Scholar
• Ardila, A., & Rosselli, M. (1994). Development of language, memory, and visuospatial abilities in 5- to 12-year-old children using a neuropsychological battery. Developmental Neuropsychology, 10(2), 97–120. doi:10.1080/87565649409540571
   Web of Science ®Google Scholar
• Barkley, R. A., Grodzinsky, G., & DuPaul, G. J. (1992). Frontal lobe functions in attention deficit disorder with and without hyperactivity: A review and research report. Journal of Abnormal Child Psychology, 20(2), 163–188. doi:10.1007/BF00916547
   PubMed Web of Science ®Google Scholar
• Benton, A. L., & Hamsher, K. D. (1989). Multilingual aphasia examination. Iowa City, Iowa: AJA Associates.
   Google Scholar
• Butler, M., Retzlaff, P. D., & Vanderploeg, R. (1991). Neuropsychological test usage. Professional Psychology: Research & Practice, 22, 510–512. doi:10.1037/0735-7028.22.6.510
   Web of Science ®Google Scholar
• Castro, J. M. C., & Martini, H. A. (2014). Potencia estadística y cálculo del tamaño del efecto en G* Power: complementos a las pruebas de significación estadística y su aplicación en psicología. Salud & Sociedad, 5, 210–244.
   Google Scholar
• Chelune, G. J., & Baer, R. A. (1986). Developmental norms for the Wisconsin Card Sorting Test. Journal of Clinical and Experimental Neuropsychology, 8(3), 219–228. doi:10.1080/01688638608401314
   PubMed Web of Science ®Google Scholar
• Coelho, L. F., do Rosário, M. C., Mastrorosa, R. S., Miranda, M. C., & Amodeo Bueno, O. F. (2012). Performance of a Brazilian sample on the computerized Wisconsin Card Sorting Test. Psychology & Neuroscience, 5, 147–156. doi:10.3922/j.psns.2012.2.04
   Google Scholar
• Coffey, D. M., Marmol, L., Schock, L., & Adams, W. (2005). The influence of acculturation on the Wisconsin card sorting test by Mexican Americans. Archives of Clinical Neuropsychology, 20(6), 795–803. doi:10.1016/j.acn.2005.04.009
   PubMed Web of Science ®Google Scholar
• Conners, C. K. (1990). Conners’ abbreviated symptom questionnaire: Parent version, teacher version. Manual Toronto: Multi-Health Systems.
   Google Scholar
• Conners, C. K. (2000). Continuous performance test. Canada: Multi-Health Systems Inc.
   Google Scholar
• Epstein, J. N., Erkanli, A., Conners, C. K., Klaric, J., Costello, J. E., & Angold, A. (2003). Relations between continuous performance test performance measures and ADHD behaviors. Journal of Abnormal Child Psychology, 31(5), 543–554. doi:10.1023/A:1025405216339
   PubMed Web of Science ®Google Scholar
• Eslinger, P. J., Biddle, K., Pennington, B., & Page, R. B. (1999). Cognitive and behavioral development up to 4 years after early right frontal lobe lesion. Developmental Neuropsychology, 15(2), 157–191. doi:10.1080/87565649909540744
   Web of Science ®Google Scholar
• Eslinger, P. J., & Grattan, L. M. (1993). Frontal lobe and frontal-striatal substrates for different forms of human cognitive flexibility. Neuropsychologia, 31(1), 17–28. doi:10.1016/0028-3932(93)90077-D
   PubMed Web of Science ®Google Scholar
• Fadaei, E., Tavakoli, M., Tahmasebi, A., Narimani, M., Shiri, V., & Shiri, E. (2017). The relationship between executive functions with reading difficulties in children with specific learning disorder. Archives of Neuroscience, 4(4), e13989. doi:10.5812/archneurosci.13989
   Web of Science ®Google Scholar
• Feldstein, S. N., Keller, F. R., Portman, R. E., Durham, R. L., Klebe, K. J., & Davis, H. P. (1999). A comparison of computerized and standard versions of the Wisconsin Card Sorting Test. The Clinical Neuropsychologist, 13(3), 303–313. doi:10.1076/clin.13.3.303.1744
   PubMed Web of Science ®Google Scholar
• Fletcher, J. M., Brookshire, B. L., Landry, S. H., Bohan, T. P., Davidson, K. C., Francis, D. J., … Morris, R. D. (1996). Attentional skills and executive functions in children with early hydrocephalus. Developmental Neuropsychology, 12(1), 53–76. doi:10.1080/87565649609540640
   Web of Science ®Google Scholar
• Fisher, N. J., Deluca, J. W., & Rourke, B. P. (1997). Wisconsin Card Sorting Test and Halstead Category Test performances of children and adolescents who exhibit the syndrome of nonverbal learning disabilities. Child Neuropsychology, 3(1), 61–70. doi:10.1080/09297049708401368
   Web of Science ®Google Scholar
• Fortuny, L. I. A., & Heaton, R. K. (1996). Standard versus computerized administration of the Wisconsin Card Sorting Test. The Clinical Neuropsychologist, 10(4), 419–424. doi:10.1080/13854049608406702
   Web of Science ®Google Scholar
• Golden, C. J. (1999). Stroop, Test de Colores y Palabras. Madrid: TEA Ediciones.
   Google Scholar
• Grant, D. A., & Berg, E. A. (1948). A behavioral analysis of degree of reinforcement and ease of shifting to new responses in a Weigl-type card-sorting problem. Journal of Experimental Psychology, 38(4), 404–411. doi:10.1037/h0059831
   PubMedGoogle Scholar
• He, N., Li, F., Li, Y., Guo, L., Chen, L., Huang, X., … Gong, Q. (2015). Neuroanatomical deficits correlate with executive dysfunction in boys with attention deficit hyperactivity disorder. Neuroscience Letters, 600, 45–49. doi:10.1016/j.neulet.2015.05.062
   PubMed Web of Science ®Google Scholar
• Heaton, S. K., Chelune, G. J., Talley, J. L., Kay, G. G., & Curtiss, G. (1993). Wisconsin Card Sorting Test manual: Revised and expanded. Odessa, FL: Psychological Assessment Resources.
   Google Scholar
• Heaton, R. K., Chelune, G. J., Talley, J. L., Kay, G. G., & Curtiss, G. (1997). WCST, Test de clasificación de tarjetas de Wisconsin. Madrid: TEA Ediciones.
   Google Scholar
• Huizinga, M., & van der Molen, M. W. (2007). Age-group differences in set-switching and set-maintenance on the Wisconsin card sorting task. Developmental Neuropsychology, 31(2), 193–215. doi:10.1080/87565640701190817
   PubMed Web of Science ®Google Scholar
• Igarashi, K., Oguni, H., Osawa, M., Awaya, Y., Kato, M., Mimura, M., & Kashima, H. (2002). Wisconsin card sorting test in children with temporal lobe epilepsy. Brain and Development, 24(3), 174–178. doi:10.1016/S0387-7604(02)00024-4
   PubMed Web of Science ®Google Scholar
• Kaland, N., Smith, L., & Mortensen, E. L. (2008). Brief report: cognitive flexibility and focused attention in children and adolescents with Asperger syndrome or high-functioning autism as measured on the computerized version of the Wisconsin Card Sorting Test. Journal of Autism and Developmental Disorders, 38(6), 1161–1165. doi:10.1007/s10803-007-0474-1
   PubMed Web of Science ®Google Scholar
• Kaufman, A. S., & Kaufman, N. L. (2000). K-BIT. Test Breve de Inteligencia de Kaufman (K-BIT) (2a edición). Madrid: TEA Ediciones.
   Google Scholar
• Kodituwakku, P. W., May, P. A., Clericuzio, C. L., & Weers, D. (2001). Emotion-related learning in individuals prenatally exposed to alcohol: an investigation of the relation between set shifting, extinction of responses, and behavior. Neuropsychologia, 39(7), 699–708. doi:10.1016/S0028-3932(01)00002-1
   PubMed Web of Science ®Google Scholar
• Kohli, A., & Kaur, M. (2006). Wisconsin Card Sorting Test: Normative data and experience. Indian Journal of Psychiatry, 48(3), 181–184. doi:10.4103/0019-5545.31582
   PubMedGoogle Scholar
• Krain, A. L., & Castellanos, F. X. (2006). Brain development and ADHD. Clinical Psychology Review, 26(4), 433–444. doi:10.1016/j.cpr.2006.01.005
   PubMed Web of Science ®Google Scholar
• Lakens, D. (2013). Calculating and reporting effect sizes to facilitate cumulative science: A practical primer for t-tests and ANOVAs. Frontiers in Psychology, 4, 863
   PubMed Web of Science ®Google Scholar
• Lawrence, V., Houghton, S., Douglas, G., Durkin, K., Whiting, K., & Tannock, R. (2004). Executive function and ADHD: A comparison of children’s performance during neuropsychological testing and real-world activities. Journal of Attention Disorders, 7(3), 137–149. doi:10.1177/108705470400700302
   PubMedGoogle Scholar
• Lehto, J. (1996). Are executive function tests dependent on working memory capacity? The Quarterly Journal of Experimental Psychology: Section A, 49(1), 29–50. doi:10.1080/713755616
   Web of Science ®Google Scholar
• Lehto, J. E., Juujärvi, P., Kooistra, L., & Pulkkinen, L. (2003). Dimensions of executive functioning: Evidence from children. British Journal of Developmental Psychology, 21(1), 59–80. doi:10.1348/026151003321164627
   Web of Science ®Google Scholar
• Longo, C. A., Kerr, E. N., & Smith, M. L. (2013). Executive functioning in children with intractable frontal lobe or temporal lobe epilepsy. Epilepsy & Behavior, 26, 102–108. doi:10.1016/j.yebeh.2012.11.003
   PubMed Web of Science ®Google Scholar
• Loge, D. V., Staton, R. D., & Beatty, W. W. (1990). Performance of children with ADHD on tests sensitive to frontal lobe dysfunction. Journal of the American Academy of Child & Adolescent Psychiatry, 29, 540–545. doi:10.1097/00004583-199007000-00006
   PubMed Web of Science ®Google Scholar
• McDonald, A. S. (2002). The impact of individual differences on the equivalence of computer-based and paper-and-pencil educational assessments. Computers & Education, 39, 299–312. doi:10.1016/S0360-1315(02)00032-5
   Web of Science ®Google Scholar
• Miranda, A., Presentación, M. J., Siegenthaler, R., & Jara, P. (2013). Effects of a psychosocial intervention on the executive functioning in children with ADHD. Journal of Learning Disabilities, 46(4), 363–376. doi:10.1177/0022219411427349
   PubMed Web of Science ®Google Scholar
• Miranda, M., Coelho, L. F., & Bueno, O. F. A. (2009). Comparative study between north American and Brazilian children in the computerized and manual versions of the Wisconsin card sorting test. European Psychiatry, 24. doi:10.1016/S0924-9338(09)70958-7
   Web of Science ®Google Scholar
• Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D. (2000). The unity and diversity of executive functions and their contributions to complex “Frontal Lobe” tasks: A latent variable analysis. Cognitive Psychology, 41(1), 49–100. doi:10.1006/cogp.1999.0734
   PubMed Web of Science ®Google Scholar
• Murphy, K. R., & Myors, B. (2004). Statistical power analysis: A simple and general model for traditional and modern hypothesis tests (2nd ed.). Mahwah, NJ: Erlbaum.
   Google Scholar
• Narbona, J. y., & Chevrie-Muller, C. (1997). El Lenguaje Del Niño, Desarrollo normal, evaluación y trastornos. Barcelona: Masson.
   Google Scholar
• Narvaez, J. C., Zeni, C. P., Coelho, R. P., Wagner, F., Pheula, G. F., Ketzer, C. R., … Rohde, L. A. (2014). Does comorbid bipolar disorder increase neuropsychological impairment in children and adolescents with ADHD? Revista Brasileira de Psiquiatria, 36(1), 53–59. doi:10.1590/1516-4446-2013-1085
   PubMed Web of Science ®Google Scholar
• Nichols, S. L., & Waschbusch, D. A. (2004). A review of the validity of laboratory cognitive tasks used to assess symptoms of ADHD. Child Psychiatry and Human Development, 34(4), 297–315. doi:10.1023/B:CHUD.0000020681.06865.97
   PubMed Web of Science ®Google Scholar
• Ochoa Angrino, S., & Cruz Panesso, I. (2007). Wisconsin card sorting test en el estudio del déficit de atención con hiperactividad, trastornos psiquiátricos, autismo y vejez. Universitas Psychologica, 6, 637–648.
   Google Scholar
• Ozonoff, S. (1995). Reliability and validity of the Wisconsin Card Sorting Test in studies of autism. Neuropsychology, 9(4), 491. doi:10.1037/0894-4105.9.4.491
   Web of Science ®Google Scholar
• Pan, C. Y., Tsai, C. L., Chu, C. H., Sung, M. C., Huang, C. Y., & Ma, W. Y. (2015). Effects of physical exercise intervention on motor skills and executive functions in children with ADHD: A pilot study. Journal of Attention Disorders, 23(4), 384--397. doi:10.1177/1087054715569282
   PubMedGoogle Scholar
• Peretti Wagner, G., & Marceli Trentini, C. (2009). Assessing executive functions in older adults: A comparison between the manual and the computer-based versions of the Wisconsin Card Sorting Test. Psychology & Neuroscience, 2, 195–198. doi:10.3922/j.psns.2009.2.011
   Google Scholar
• Pineda, D., Ardila, A., Rosselli, M. N., Cadavid, C., Mancheno, S., & Mejia, S. (1998). Executive dysfunctions in children with attention deficit hyperactivity disorder. International Journal of Neuroscience, 96(3-4), 177–196. doi:10.3109/00207459808986466
   PubMed Web of Science ®Google Scholar
• Regard, M., Strauss, E., & Knapp, P. (1982). Children’s production on verbal and non-verbal fluency tasks. Perceptual and Motor Skills, 55(3), 839–844. doi:10.2466/pms.1982.55.3.839
   PubMed Web of Science ®Google Scholar
• Riccio, C. A., Reynolds, C. R., & Lowe, P. A. (2001). Clinical applications of continuous performance tests: Measuring attention and impulsive responding in children and adults. New York: John Wiley & Sons Inc.
   Google Scholar
• Romine, C. B., Lee, D., Wolfe, M. E., Homack, S., George, C., & Riccio, C. A. (2004). Wisconsin Card Sorting Test with children: A meta-analytic study of sensitivity and specificity. Archives of Clinical Neuropsychology, 9, 1027–1041. doi:10.1016/j.acn.2003.12.009
   Google Scholar
• Rosselli, M., & Ardila, A. (1993). Developmental norms for the Wisconsin Card Sorting Test in 5-to 12-year-old children. The Clinical Neuropsychologist, 7(2), 145–154. doi:10.1080/13854049308401516
   PubMed Web of Science ®Google Scholar
• Semrud-Clikeman, M., Steingard, R. J., Filipek, P., Biederman, J., Bekken, K., & Renshaw, P. F. (2000). Using MRI to examine brain–behavior relationships in males with attention deficit disorder with hyperactivity. Journal of the American Academy of Child and Adolescent Psychiatry, 39(4), 477–484. doi:10.1097/00004583-200004000-00017
   PubMed Web of Science ®Google Scholar
• Sergeant, J. A., Geurts, H., & Oosterlaan, J. (2002). How specific is a deficit of executive functioning for attention-deficit/hyperactivity disorder? Behavioural Brain Research, 130(1-2), 3–28. doi:10.1016/S0166-4328(01)00430-2
   PubMed Web of Science ®Google Scholar
• Shan, I. K., Chen, Y. S., Lee, Y. C., & Su, T. P. (2008). Adult normative data of the Wisconsin card sorting test in Taiwan. Journal of the Chinese Medical Association, 71(10), 517–522. doi:10.1016/S1726-4901(08)70160-6
   PubMed Web of Science ®Google Scholar
• Shu, C. S., Tien, A. Y., Lung, F. W., & Chang, Y. Y. (2000). Norms for the Wisconsin Card Sorting Test in 6-to 11-year-old children in Taiwan. The Clinical Neuropsychologist, 14(3), 275–286. doi:10.1076/1385-4046(200008)14:3;1-P;FT275
   PubMed Web of Science ®Google Scholar
• Shue, K. L., & Douglas, V. I. (1992). Attention deficit hyperactivity disorder and the frontal lobe syndrome. Brain and Cognition, 20(1), 104–124. doi:10.1016/0278-2626(92)90064-S
   PubMed Web of Science ®Google Scholar
• Silva de Oliveira, A. L., Kaiser, V., Azambuja, T. D. O., Mallmann, L. U., Lukrafka, J. L., & Reppold, C. T. (2016). Visual-motor maturity and executive functions in schoolchildren. Paidéia, 26(64), 215–223. doi:10.1590/1982-43272664201609
   Google Scholar
• Snow, J. H. (1998). Developmental patterns and use of the Wisconsin Card Sorting Test for children and adolescents with learning disabilities. Child Neuropsychology, 4(2), 89–97. doi:10.1076/chin.4.2.89.3180
   Web of Science ®Google Scholar
• Steinmetz, J. P., Brunner, M., Loarer, E., & Houssemand, C. (2010). Incomplete psychometric equivalence of scores obtained on the manual and the computer version of the Wisconsin Card Sorting Test?. Psychological Assessment, 22(1), 199–202. doi:10.1037/a0017661
   PubMed Web of Science ®Google Scholar
• Tien, A. Y., Spevack, T. V., Jones, D. W., Pearlson, G. D., Schlaepfer, T. E., & Strauss, M. E. (1996). Computerized Wisconsin card sorting test: Comparison with manual administration. The Kaohsiung Journal of Medical Sciences, 12, 479–485.
   PubMedGoogle Scholar
• Tsuchiya, E., Oki, J., Yahara, N., & Fujieda, K. (2005). Computerized version of the Wisconsin card sorting test in children with high-functioning autistic disorder or attention-deficit/hyperactivity disorder. Brain and Development, 27(3), 233–236. doi:10.1016/j.braindev.2004.06.008
   PubMed Web of Science ®Google Scholar
• Tucha, L., Aschenbrenner, S., Koerts, J., & Lange, K. W. (2012). The five-point test: reliability, validity and normative data for children and adults. PLoS ONE, 7(9), e46080. doi:10.1371/journal.pone.0046080
   PubMed Web of Science ®Google Scholar
• Wang, L., Kakigi, R., & Hoshiyama, M. (2001). Neural activities during Wisconsin Card Sorting Test — MEG observation. Cognitive Brain Research, 12(1), 19–31. doi:10.1016/S0926-6410(01)00022-2
   PubMedGoogle Scholar
• Wechsler, D. (2003). Wechsler Intelligence Scale for Children – Fourth Edition (WISC-IV). San Antonio, TX: The Psychological Corporation. [Spanish adaptation (2005), Madrid: TEA Ediciones].
   Google Scholar
• Wechsler, D. (2010). WISC IV, Escala de Inteligencia para niños de Wechsler – IV. Adaptación Argentina. Buenos Aires: Paidos.
   Google Scholar
• Williams, D., & Jarrold, C. (2013). Assessing planning and set-shifting abilities in autism: Are experimenter-administered and computerised versions of tasks equivalent? Autism Research, 6(6), 461–467. doi:10.1002/aur.1311
   PubMed Web of Science ®Google Scholar
• Yang, R., Gao, W., Li, R., & Zhao, Z. (2015). Effect of atomoxetine on the cognitive functions in treatment of attention deficit hyperactivity disorder in children with congenital hypothyroidism: A pilot study. International Journal of Neuropsychopharmacology, 18(8), pyv044. doi:org/10.1093/ijnp/pyv044
   PubMed Web of Science ®Google Scholar
• Yeniceri, N., & Altan-Atalay, A. (2011). Age-related changes in the Wisconsin card sorting test performances of 8-to 11-year-old Turkish children. The Clinical Neuropsychologist, 25(7), 1179–1192. doi:10.1080/13854046.2011.613855
   PubMed Web of Science ®Google Scholar
• Yildiz, O., Sismanlar, S. G., Memik, N. C., Karakaya, I., & Agaoglu, B. (2011). Atomoxetine and methylphenidate treatment in children with ADHD: the efficacy, tolerability and effects on executive functions. Child Psychiatry & Human Development, 42, 257–269. doi:10.1007/s10578-010-0212-3
   PubMed Web of Science ®Google Scholar
• Yilmaz, A., Gokcen, C., Fettahoglu, E. C., & Ozatalay, E. (2013). The effect of methylphenidate on executive functions in children with Attention-Deficit Hyperactivity Disorder. Bulletin of Clinical Psychopharmacology, 23(2), 162–170. doi:10.5455/bcp.20121130090251
   Google Scholar