Publication Cover
Aging, Neuropsychology, and Cognition
A Journal on Normal and Dysfunctional Development
Volume 27, 2020 - Issue 6
1,311
Views
19
CrossRef citations to date
0
Altmetric
Original Article

Age, education and gender effects on Wisconsin card sorting test: standardization, reliability and validity in healthy Argentinian adults

, , , , & ORCID Icon
Pages 807-825 | Received 14 Jun 2019, Accepted 08 Nov 2019, Published online: 19 Nov 2019

References

  • Aebischer, B., Hill, J. C., Hilfiker, R., & Karstens, S. (2015). German translation and cross-cultural adaptation of the start back screening tool. PloS One, 10(7), e0132068.
  • Agranovich, A. V., & Puente, A. E. (2007). Do Russian and American normal adults perform similarly on neuropsychological tests? Preliminary findings on the relationship between culture and test performance. Archives of Clinical Neuropsychology, 22(3), 273–282.
  • American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
  • Anderson, P. J. (2010). Towards a developmental model of executive function. In V. Anderson, R. Jacobs, & P.J. Anderson (Eds.), Executive functions and the frontal lobes (pp. 37–56). New York: Psychology Press.
  • Arango-Lasprilla, J. C., Rivera, D., Aguayo, A., Rodriguez, W., Garza, M. T., Saracho, C. P., & Perrin, P. B. (2015a). Trail making test: Normative data for the Latin American Spanish speaking adult population. NeuroRehabilitation, 37, 639–661.
  • Arango-Lasprilla, J. C., Rivera, D., Longoni, M., Saracho, C. P., Garza, M. T., Aliaga, A., … Perrin, P. B. (2015b). Modified Wisconsin card sorting test (M-WCST): Normative data for the Latin American Spanish speaking adult population. NeuroRehabilitation, 37(4), 563–590.
  • Arango-Lasprilla, J. C., Stevens, L., Morlett Paredes, A., Ardila, A., & Rivera, D. (2017). Profession of neuropsychology in Latin America. Applied Neuropsychology: Adult, 24(4), 318–330.
  • Ardila, A. (1995). Directions of research in crosscultural neuropsychology. Journal of Clinical and Experimental Neuropsychology, 17, 143–150.
  • Ardila, A. (2005). Cultural values underlying psychometric cognitive testing. Neuropsychology Review, 15(4), 185–195.
  • Avila, J. F., Verney, S. P., Kauzor, K., Flowers, A., Mehradfar, M., & Razani, J. (2019). Normative data for farsi-speaking Iranians in the United States on measures of executive functioning. Applied Neuropsychology: Adult, 26(3), 229–235.
  • Axelrod, B. N. (2002). Are normative data from the 64-card version of the WCST comparable to the full WCST? The Clinical Neuropsychologist, 16(1), 7–11.
  • Axelrod, B. N., & Henry, R. R. (1992). Age-related performance on the Wisconsin card sorting, similarities, and controlled oral word association tests. The Clinical Neuropsychologist, 6(1), 16–26.
  • Axelrod, B. N., Paolo, A. M., & Abraham, E. (1997). Do normative data from the full WCST extend to the abbreviated WCST? Assessment, 4(1), 41–46.
  • Barr, W. B. (2002). Neuropsychological testing for assessment of treatment effects: Methodologic issues. CNS Spectrums, 7(4), 300–306.
  • Beaman, S. R. D., Beaman, P. E., Garcia-Peña, C., Villa, M. A., Heres, J., Córdova, A., & Jagger, C. (2004). Validation of a modified version of the Mini-Mental State Examination (MMSE) in Spanish. Aging, Neuropsychology, and Cognition, 11(1), 1–11.
  • Bell, M. D., Greig, T. C., Kaplan, E., & Bryson, G. (1997). Wisconsin card sorting test dimensions in schizophrenia: Factorial, predictive, and divergent validity. Journal of Clinical and Experimental Neuropsychology, 19(6), 933–941.
  • Boone, K. B., Ghaffarian, S., Lesser, I. M., Hill-Gutierrez, E., & Berman, N. G. (1993). Wisconsin card sorting test performance in healthy, older adults: Relationship to age, sex, education, and IQ. Journal of Clinical Psychology, 49(1), 54–60.
  • Bora, E., Veznedaroğlu, B., & Vahip, S. (2016). Theory of mind and executive functions in schizophrenia and bipolar disorder: A cross-diagnostic latent class analysis for identification of neuropsychological subtypes. Schizophrenia Research, 176(2–3), 500–505.
  • Borda, M. G., Reyes-Ortiz, C., Pérez-Zepeda, M. U., Patino-Hernandez, D., Gómez-Arteaga, C., & Cano-Gutiérrez, C. A. (2019). Educational level and its association with the domains of the montreal cognitive assessment test. Aging & Mental Health, 23(10), 1300–1306.
  • Branco, L. D., Cotrena, C., Pereira, N., Kochhann, R., & Fonseca, R. P. (2014). Verbal and visuospatial executive functions in healthy elderly: The impact of education and frequency of reading and writing. Dementia & Neuropsychologia, 8(2), 155–161.
  • Brickman, A. M., Cabo, R., & Manly, J. J. (2006). Ethical issues in cross-cultural neuropsychology. Applied Neuropsychology, 13(2), 91–100.
  • Brooks, B. L., & Ploetz, D. M. (2015). Embedded performance validity on the CVLT-C for youth with neurological disorders. Archives of Clinical Neuropsychology, 30(3), 200–206.
  • Burgess, P. W. (1997). Theory and methodology in executive function research. In P. Rabbitt (Ed.), Methodology of frontal and executive function (pp. 81–116). Hove, UK: Psychology Press.
  • Butman, J., Arizaga, R. L., Harris, P., Drake, M., Baumann, D., De Pascale, A., & Ollari, J. A. (2001). El “mini mental state examination” en español. Normas para buenos aires. Revista De Neurología Argentina, 26(1), 11–15.
  • Campanholo, K. R., Boa, I. N. F., Hodroj, F. C. D. S. A., Guerra, G. R. B., Miotto, E. C., & de Lucia, M. C. S. (2017). Impact of sociodemographic variables on executive functions. Dementia & Neuropsychologia, 11(1), 62–68.
  • Chelune, G. J., & Baer, R. L. (1986). Developmental norms for the Wisconsin card sorting test. Journal of Clinical and Experimental Neuropsychology, 8(3), 219–228.
  • Coffey, D. M., Marmol, L., Schock, L., & Adams, W. (2005). The influence of acculturation on the Wisconsin card sorting test by Mexican Americans. Archives of Clinical Neuropsychology, 20(6), 795–803.
  • Cohn, M., & Statucka, M. (2019). Origins matter: Culture impacts cognitive testing in Parkinson’s disease. Frontiers in Human Neuroscience, 13, 269.
  • Cole, M. (1997). Cultural psychology: A once and future discipline. Cambridge, MA: Belknap Press of Harvard University Press.
  • Craig, F., Margari, F., Legrottaglie, A. R., Palumbi, R., de Giambattista, C., & Margari, L. (2016). A review of executive function deficits in autism spectrum disorder and attention-deficit/hyperactivity disorder. Neuropsychiatric Disease and Treatment, 12, 1191–1202.
  • de la Cruz, M. V. (2001). Manual del Test de Clasificación de Tarjetas de Wisconsin (WCST). Madrid: TEA Ediciones.
  • de Zubicaray, G. I., Smith, G. A., Chalk, J. B., & Semple, J. (1998). The Modified card sorting test: Test-retest stability and relationships with demographic variables in a healthy older adult sample. British Journal of Clinical Psychology, 37(4), 457–466.
  • Del Valle-del Valle, G., Puerta-Cuestas, M. V., Renau-Hernández, O., Noguera-Escalera, P., García-Blázquez, M. C., Ferri-Salvador, N., … Noé-Sebastián, E. (2008). Utilidad clínica de la versión de 64 cartas del test de clasificación de cartas de Wisconsin en pacientes que han sufrido un traumatismo craneoencefálico. Revista De Neurología, 46(3), 142–146.
  • Dias, N. S., Ferreira, D., Reis, J., Jacinto, L. R., Fernandes, L., & Pinho, F., ... & Cerqueira, J. J. (2015). Age effects on EEG correlates of the Wisconsin Card Sorting Test. Physiological reports, 3(7), e12390.
  • Duggan, E. C., Awakon, L. M., Loaiza, C. C., & Garcia-Barrera, M. A. (2018). Contributing towards a cultural neuropsychology assessment decision-making framework: Comparison of WAIS-IV norms from Colombia, Chile, Mexico, Spain, United States, and Canada. Archives of Clinical Neuropsychology. doi:10.1093/arclin/acy074
  • Faria, C. D. A., Alves, H. V. D., & Charchat-Fichman, H. (2015). The most frequently used tests for assessing executive functions in aging. Dementia & Neuropsychologia, 9(2), 149–155.
  • Fernandes, L. S., Ferreira, D. S., Almeida, P. R., & Dias, N. S. (2015). Aging and attentional set shifting on WCST: An event-related EEG study. In Institute of Electrical and Electronics Engineers (Ed.), 2015 7th International IEEE/EMBS conference on neural engineering (NER) (pp. 1088–1091). Montpellier, France: IEEE.
  • Fernández, A. L., & Abe, J. (2018). Bias in cross-cultural neuropsychological testing: problems and possible solutions. Culture and Brain, 6(1), 1–35.
  • Fernandez, A. L., Ferreres, A., Morlett-Paredes, A., Rivera, D., & Arango-Lasprilla, J. C. (2016). Past, present, and future of neuropsychology in Argentina. The Clinical Neuropsychologist, 30(8), 1154–1178.
  • Friedman, N. P., & Miyake, A. (2017). Unity and diversity of executive functions: Individual differences as a window on cognitive structure. Cortex, 86, 186–204.
  • Gadd, C., & Phipps, W. D. (2012). A preliminary standardisation of the Wisconsin card sorting test for setswana-speaking university students. South African Journal of Psychology, 42(3), 389–398.
  • Gelonch, O., Garolera, M., Valls, J., Rosselló, L., & Pifarré, J. (2016). Executive function in fibromyalgia: Comparing subjective and objective measures. Comprehensive Psychiatry, 66, 113–122.
  • Grant, D. A., & Berg, E. A. (1996). Test de clasificación de cartas de Wisconsin. Madrid: TEA Ediciones SA.
  • Grissom, N. M., & Reyes, T. M. (2019). Let’s call the whole thing off: Evaluating gender and sex differences in executive function. Neuropsychopharmacology, 44(1), 86–96.
  • Guàrdia-Olmos, J., Peró-Cebollero, M., Rivera, D., & Arango-Lasprilla, J. C. (2015). Methodology for the development of normative data for ten Spanish-language neuropsychological tests in eleven Latin American countries. NeuroRehabilitation, 37(4), 493–499.
  • Hanczar, B., Hua, J., Sima, C., Weinstein, J., Bittner, M., & Dougherty, E. R. (2010). Small-sample precision of ROC-related estimates. Bioinformatics, 26(6), 822–830.
  • Hartman, M., Bolton, E., & Fehnel, S. E. (2001). Accounting for age differences on the Wisconsin card sorting test: Decreased working memory, not inflexibility. Psychology and Aging, 16, 385–399.
  • Heaton, K. R., Chelune, G. J., Talley, J. L., Kay, G. G., & Curtiss, G. (2005). Manual do teste Wisconsin de classificação de cartas. São Paulo: Casa do Psicólogo.
  • Heaton, R. K. (1981). Wisconsin card sorting test manual. Odessa, FL: Psychological Assessment Resources.
  • Heaton, R. K., Chelune, G. J., Talley, J. L., Kay, G. G., & Curtiss, G. (1993). Wisconsin card sorting test manual: Revised and expanded. Odessa, FL: Psychological Assessment Resources.
  • INDEC (National Institute of Statistics and Census of Argentina), 2010. National Census. Retrieved from https://www.indec.gov.ar/nivel4_default.asp?id_tema_1=2&id_tema_2=41&id_tema_3=135
  • Josev, E. K., & Anderson, P. J. (2017). Executive dysfunction in very preterm children and associated brain pathology. In Wiebe, S. A., & Karbach, J. (Eds.), Executive function:Development Across the Life Span(pp. 231–246). New York: Routledge.
  • Kohli, A., & Kaur, M. (2006). Wisconsin card sorting test: Normative data and experience. Indian Journal of Psychiatry, 48(3), 181–184.
  • Koren, D., Seidman, L. J., Harrison, R. H., Lyons, M. J., Kremem, W. S., Caplan, B., … Tsuang, M. T. (1998). Factor structure of the Wisconsin card sorting test: Dimensions of deficit in schizophrenia. Neuropsychology, 12(2), 289–302.
  • Krch, D., Lequerica, A., Arango-Lasprilla, J. C., Rogers, H. L., DeLuca, J., & Chiaravalloti, N. D. (2015). The multidimensional influence of acculturation on digit symbol-coding and Wisconsin card sorting test in Hispanics. The Clinical Neuropsychologist, 29(5), 624–638.
  • Lange, F., Brückner, C., Knebel, A., Seer, C., & Kopp, B. (2018). Executive dysfunction in Parkinson’s disease: A meta-analysis on the Wisconsin card sorting test literature. Neuroscience & Biobehavioral Reviews, 93, 38–56.
  • Lázaro, J. C. F., Carrasco, B. T., & Ruiz, B. C. (2011). Influencia del nivel y de la actividad escolar en las funciones ejecutivas. Interamerican Journal of Psychology, 45(2), 281–292.
  • Leany, B. D., Benuto, L. T., & Thaler, N. S. (2013). Neuropsychological assessment with Hispanic clients. In Benuto L. (Ed.), Guide to psychological assessment with Hispanics (pp.351–376). Boston, MA: Springer.
  • Lemay, S., Bédard, M. A., Rouleau, I., & Tremblay, P. L. (2004). Practice effect and test-retest reliability of attentional and executive tests in middle-aged to elderly subjects. The Clinical Neuropsychologist, 18(2), 284–302.
  • Lichtenstein, J. D., Erdodi, L. A., Rai, J. K., Mazur-Mosiewicz, A., & Flaro, L. (2018). Wisconsin card sorting test embedded validity indicators developed for adults can be extended to children. Child Neuropsychology, 24(2), 247–260.
  • Lin, S. H., Liu, C. M., Hwang, T. J., Hsieh, M. H., Hsiao, P. C., Faraone, S. V., & Chen, W. J. (2011). Performance on the Wisconsin card sorting test in families of schizophrenia patients with different familial loadings. Schizophrenia Bulletin, 39(3), 537–546.
  • Lineweaver, T. T., Bondi, M. W., Thomas, R. G., & Salmon, D. P. (1999). A normative study of Nelson’s (1976) modified version of the Wisconsin card sorting test in healthy older adults. The Clinical Neuropsychologst, 13(3), 328–347.
  • Loeber, S., Duka, T., Welzel, H., Nakovics, H., Heinz, A., Flor, H., & Mann, K. (2009). Impairment of cognitive abilities and decision making after chronic use of alcohol: The impact of multiple detoxifications. Alcohol & Alcoholism, 44(4), 372–381.
  • Marenco, S., Meyer, C., van der Veen, J. W., Zhang, Y., Kelly, R., & Shen, J., ... & Berman, K. F. (2018). Role of gamma-amino-butyric acid in the dorsal anterior cingulate in age-associated changes in cognition. Neuropsychopharmacology, 43(11), 2285–2291
  • Marino, J. C., & Alderete, A. M. (2010). Valores normativos de pruebas de fluidez verbal categoriales, fonológicas, gramaticales y combinadas y análisis comparativo de la capacidad de iniciación. Revista Neuropsicología, Neuropsiquiatría Y Neurociencias, 10(1), 82–93.
  • Miranda, A. R., Rivadero, L., Serra, S. V., & Soria, E. A. (2019). Multidomain self-report assessment of fronto-executive complaints in Spanish-speaking adults. Psychology & Neuroscience. doi:10.1037/pne0000187
  • Nagahama, Y., Okina, T., Suzuki, N., Matsuzaki, S., Yamauchi, H., Nabatame, H., & Matsuda, M. (2003). Factor structure of a modified version of the wisconsin card sorting test: An analysis of executive deficit in Alzheimer’s disease and mild cognitive impairment. Dementia and Geriatric Cognitive Disorders, 16(2), 103–112.
  • Niemeier, J. P., Marwitz, J. H., Lesher, K., Walker, W. C., & Bushnik, T. (2007). Gender differences in executive functions following traumatic brain injury. Neuropsychological Rehabilitation, 17(3), 293–313.
  • Oberg, G., & Ramírez, M. (2007). Cross-linguistic metaanalysis of phonological fluency: Normal performance across cultures. International Journal of Psychology, 41(5), 342–347.
  • Obonsawin, M. C., Crawford, J. R., Page, J., Chalmers, P., Low, G., & Marsh, P. (1999). Performance on the modified card sorting test by normal, healthy individuals: Relationship to general intellectual ability and demographic variables. British Journal of Clinical Psychology, 38(1), 27–41.
  • Ostrosky-Solís, F., & Lozano, A. (2006). Digit span: Effect of education and culture. International Journal of Psychology, 41(5), 333–341.
  • Pedraza, O., & Mungas, D. (2008). Measurement in cross-cultural neuropsychology. Neuropsychology Review, 18(3), 184–193.
  • Periáñez, J. A., & Barceló, F. (2001). Adaptación madrid del test de clasificación de cartas de Wisconsin: Un estudio comparativo de consistencia interna. Revista De Neurología, 33(7), 611–618.
  • Pezzuti, L., Mastrantonio, E., & Orsini, A. (2013). Construction and validation of an ecological version of the Wisconsin card sorting test applied to an elderly population. Aging, Neuropsychology, and Cognition, 20(5), 567–591.
  • Plitas, A., & Plakiotis, C. (2010). Neuropsychological testing of culturally and linguistically diverse individuals: The case of Greek-speaking individuals. Current Opinion in Psychiatry, 23(3), 261–266.
  • Querejeta, A. N., Sarquís, Y. F., Moreno, M. A., Crostelli, A. L., Stecco, J. I., Venier, A., … Pilatti, A. (2012). Test Neuropsi: Normas según edad y nivel de instrucción para Argentina. Cuadernos De Neuropsicología, 6(2), 48–58.
  • Rammal, S., Abi Chahine, J., Rammal, M., Fares, Y., & Abou Abbas, L. (2019). Modified Wisconsin Card Sorting Test (M-WCST): Normative data for the lebanese adult population. Developmental Neuropsychology, 44(5), 397–408.
  • Raudeberg, R., Iverson, G. L., & Hammar, Å. (2019). Norms matter: U.S. normative data under-estimate cognitive deficits in Norwegians with schizophrenia spectrum disorders. The Clinical Neuropsychologist, 1–17. doi:10.1080/13854046.2019.1590641
  • Rhodes, M. G. (2004). Age-related differences in performance on the Wisconsin card sorting test: A meta-analytic review. Psychology and Aging, 19(3), 482–494.
  • Rivera, D., Perrin, P. B., Stevens, L. F., Garza, M. T., Weil, C., Saracho, C. P., … Arango-Lasprilla, J. C. (2015). Stroop color-word interference test: Normative data for the Latin American Spanish speaking adult population. NeuroRehabilitation, 37(4), 591–624.
  • Rosselli, M., Matute, E., & Jurado, M. B. (2008). Las funciones ejecutivas a través de la vida. Revista Neuropsicología, Neuropsiquiatría Y Neurociencias, 8(1), 23–46.
  • Shan, I. K., Chen, Y. S., Lee, Y. C., & Su, T. P. (2008). Adult normative data of the Wisconsin card sorting test in Taiwan. Journal of the Chinese Medical Association, 71(10), 517–522.
  • Sherer, M., Nick, T. G., Millis, S. R., & Novack, T. A. (2003). Use of the WCST and the WCST-64 in the assessment of traumatic brain injury. Journal of Clinical and Experimental Neuropsychology, 25(4), 512–520.
  • Shokri, S., Akbarfahimi, M., Alizadeh Zarei, M., Hosseini, S. G., & Farhadian, M. (2016). The influence of age and gender on executive functions of the brain in an Iranian sample of healthy adults. Journal of Advanced Medical Sciences and Applied Technologies, 2(3), 247–256.
  • Snyder, H. R., Miyake, A., & Hankin, B. L. (2015). Advancing understanding of executive function impairments and psychopathology: Bridging the gap between clinical and cognitive approaches. Frontiers in Psychology, 6, 328.
  • Stratta, P., Prosperini, P., Daneluzzo, E., Bustini, M., & Rossi, A. (2001). Educational level and age influence spatial working memory and Wisconsin card sorting test performance differently: A controlled study in schizophrenic patients. Psychiatry Research, 102(1), 39–48.
  • Vigliecca, N. S., & Baez, S. (2015). Screening executive function and global cognition with the Nine‐card sorting test: Healthy participant studies and ageing implications. Psychogeriatrics, 15(3), 163–170.
  • Vogel, A., Stokholm, J., & Jørgensen, K. (2019). Normative data for eight verbal fluency measures in older Danish adults. Aging, Neuropsychology, and Cognition, 21, 1–11.
  • Wang, R. Y., Wang, Y. L., Cheng, F. Y., Chao, Y. H., Chen, C. L., & Yang, Y. R. (2018). Effects of a multicomponent exercise on dual-task performance and executive function among older adults. International Journal of Gerontology, 12(2), 133–138.
  • Whitley, E., Deary, I. J., Ritchie, S. J., Batty, G. D., Kumari, M., & Benzeval, M. (2016). Variations in cognitive abilities across the life course: cross-sectional evidence from understanding society: The UK household longitudinal study. Intelligence, 59, 39–50.
  • Zimmermann, N., Cardoso, C. D. O., Trentini, C. M., Grassi-Oliveira, R., & Fonseca, R. P. (2015). Brazilian preliminary norms and investigation of age and education effects on the modified Wisconsin card sorting test, stroop color and word test and digit span test in adults. Dementia & Neuropsychologia, 9(2), 120–127.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.