Cognitive abilities underlying performance on the modified card sorting test: novel and traditional scores

References

• Alderman, N., Evans, J., Emslie, H., Wilson, B. A., & Burgess, P. W. (1998). The ecological validity of tests of executive function. Journal of the International Neuropsychological Society, 4(6), 547–558. doi:10.1017/S1355617798466037.
   PubMed Web of Science ®Google Scholar
• Amanzio, M., Palermo, S., Zucca, M., Rosato, R., Rubino, E., Leotta, D., … Rainero, I. (2018). Neuropsychological correlates of instrumental activities of daily living in neurocognitive disorders: A possible role for executive dysfunction and mood changes. International Psychogeriatrics, 30(12), 1871–1881. doi:10.1017/S1041610218000455
   PubMed Web of Science ®Google Scholar
• Amorim, P. (2000). Mini International Neuropsychiatric Interview (MINI): validação de entrevista breve para diagnóstico de transtornos mentais [Mini International Neuropsychiatric Interview (MINI): validation of a short structured diagnostic psychiatric interview]. Revista Brasileira de Psiquiatria, 22(3), 103–115. doi:10.1590/S1516-44462000000300003
   Google Scholar
• Anderson, S. W., Damasio, H., Jones, R. D., & Tranel, D. (1991). Wisconsin Card Sorting Test performance as a measure of frontal lobe damage. Journal of Clinical and Experimental Neuropsychology, 13(6), 909–922. doi:10.1080/01688639108405107
   PubMed Web of Science ®Google Scholar
• Arango-Lasprilla, J. C., Rivera, D., Longoni, M., Saracho, C. P., Garza, M. T., Aliaga, A., … Perrin, P. B. (2015). Modified Wisconsin Card Sorting Test (M-WCST): Normative data for the Latin American Spanish speaking adult population. NeuroRehabilitation, 37(4), 563–590. doi:10.3233/NRE-151280
   PubMed Web of Science ®Google Scholar
• Arango-Lasprilla, J. C., Rivera, D., Nicholls, E., Aguayo Arelis, A., García de la Cadena, C., Peñalver Guia, A. I., … Sánchez-SanSegundo, M. (2017). Modified Wisconsin Card Sorting Test (M-WCST): Normative data for Spanish-speaking pediatric population. Neuro Rehabilitation, 41(3), 617–626. doi:10.3233/NRE-172242
   Google Scholar
• Axelrod, B. N., Greve, K. W., & Goldman, R. S. (1994). Comparison of four Wisconsin Card Sorting Test scoring guides with novice raters. Assessment, 1(2), 115–121. doi:10.1177/1073191194001002001
   PubMedGoogle Scholar
• Bell, M. D., Greig, T. C., Kaplan, E., & Bryson, G. (1997). Wisconsin Card Sorting Test dimensions in schizophrenia: Factorial, predictive, and divergent validity. Journal of Clinical and Experimental Neuropsychology, 19(6), 933–941. doi:10.1080/01688639708403774
   PubMed Web of Science ®Google Scholar
• Berg, E. A. (1948). A simple objective technique for measuring flexibility in thinking. The Journal of General Psychology, 39(1), 15–22. doi:10.1080/00221309.1948.9918159
   PubMed Web of Science ®Google Scholar
• Bowie, C. R., & Harvey, P. D. (2006). Administration and interpretation of the Trail Making Test. Nature Protocols, 1(5), 2277–2281. doi:10.1038/nprot.2006.390
   PubMed Web of Science ®Google Scholar
• Burgess, P. W., & Shallice, T. (1997). The Hayling and Brixton tests. Retrieved from http://discovery.ucl.ac.uk/5457/
   Google Scholar
• Burgess, P. W., & Shallice, T. (1996). Response suppression, Initiation and strategy use following frontal lobe lesions. Neuropsychologia, 34(4), 263–272. doi:10.1016/0028-3932(95)00104-2
   PubMed Web of Science ®Google Scholar
• Cambridge, O. R., Knight, M. J., Mills, N., & Baune, B. T. (2018). The clinical relationship between cognitive impairment and psychosocial functioning in major depressive disorder: A systematic review. Psychiatry Research, 269, 157–171. doi:10.1016/j.psychres.2018.08.033
   PubMed Web of Science ®Google Scholar
• Chan, R. C. K., Shum, D., Toulopoulou, T., & Chen, E. Y. H. (2008). Assessment of executive functions: Review of instruments and identification of critical issues. Archives of Clinical Neuropsychology, 23(2), 201–216. doi:10.1016/j.acn.2007.08.010
   PubMed Web of Science ®Google Scholar
• Chan, Y. H. (2003). Biostatistics 104: Correlational analysis. Singapore Medical Journal, 44(12), 614–619.
   PubMedGoogle Scholar
• Chaves, M. L. F., & Izquierdo, I. (1992). Differential diagnosis between dementia and depression: A study of efficiency increment. Acta Neurologica Scandinavica, 85(6), 378–382. doi:10.1111/j.1600-0404.1992.tb06032.x
   PubMed Web of Science ®Google Scholar
• Chiu, E.-C., Wu, W.-C., Hung, J.-W., & Tseng, Y.-H. (2017). Validity of the Wisconsin Card Sorting Test in patients with stroke. Disability and Rehabilitation, 1–5. doi:10.1080/09638288.2017.1323020
   Web of Science ®Google Scholar
• Cianchetti, C., Corona, S., Foscoliano, M., Contu, D., & Sannio-Fancello, G. (2007). Modified Wisconsin Card Sorting Test (MCST, MWCST): normative data in children 4–13 years old, according to classical and new types of scoring. The Clinical Neuropsychologist, 21(3), 456–478. doi:10.1080/13854040600629766
   PubMed Web of Science ®Google Scholar
• Cianchetti, C., Corona, S., Foscoliano, M., Scalas, F., & Sannio-Fancello, G. (2005). Modified Wisconsin Card Sorting Test: Proposal of a supplementary scoring method. Archives of Clinical Neuropsychology, 20(4), 555–558. doi:10.1016/j.acn.2004.12.002
   PubMed Web of Science ®Google Scholar
• Cotrena, C., Branco, L. D., Shansis, F. M., & Fonseca, R. P. (2016). Executive function impairments in depression and bipolar disorder: Association with functional impairment and quality of life. Journal of Affective Disorders, 190, 744–753. doi:10.1016/j.jad.2015.11.007
   PubMed Web of Science ®Google Scholar
• del Pino, R., Peña, J., Ibarretxe-Bilbao, N., Schretlen, D. J., & Ojeda, N. (2016). Modified Wisconsin Card Sorting Test: Standardization and norms of the test for a population sample in Spain]. Revista de Neurologia, 62(5), 193–202. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/26916322
   PubMed Web of Science ®Google Scholar
• Diamond, A. (2013). Executive functions. Annual Review of Psychology, 64(1), 135–168. doi:10.1146/annurev-psych-113011-143750.Executive
   PubMed Web of Science ®Google Scholar
• Dickinson, T., Becerra, R., & Coombes, J. (2017). Executive functioning deficits among adults with bipolar disorder (types I and II): A systematic review and meta-analysis. Journal of Affective Disorders, 218, 407. doi:10.1016/j.jad.2017.04.010
   PubMed Web of Science ®Google Scholar
• Dratcu, L., Ribeiro, L. D. C., & Calil, H. M. (1987). Depression assessment in Brazil: The first application of the Montgomery-Asberg depression rating scale. British Journal of Psychiatry, 150(6), 797–800. doi:10.1192/bjp.150.6.797
   PubMedGoogle Scholar
• Elwood, R. W. (1991). The Wechsler Memory Scale-revised: Psychometric characteristics and clinical application. Neuropsychology Review, 2(2), 179–201. doi:10.1007/BF01109053
   PubMedGoogle Scholar
• Faria, C. D. A., Alves, H. V. D., & Charchat-Fichman, H. (2015). The most frequently used tests for assessing executive functions in aging. Dementia and Neuropsychologia, 9(2), 149–155. doi:10.1590/1980-57642015DN92000009
   PubMedGoogle Scholar
• Faustino, B., Oliveira, J., & Lopes, P. (2019). Diagnostic precision of the Wisconsin Card Sorting Test in assessing cognitive deficits in substance use disorders. Applied Neuropsychology: Adult, 1–8. doi:10.1080/23279095.2019.1607737
   PubMedGoogle Scholar
• Fettes, P. W., Moayedi, M., Dunlop, K., Mansouri, F., Vila-Rodriguez, F., Giacobbe, P., … Downar, J. (2018). Abnormal functional connectivity of frontopolar subregions in treatment-nonresponsive major depressive disorder. Biological Psychiatry: Cognitive Neuroscience and Neuroimaging, 3(4), 337–347. doi:10.1016/j.bpsc.2017.12.003
   PubMedGoogle Scholar
• Folstein, M. F., Folstein, S. E., & McHugh, P. R. (1975). Mini-mental state: A practical method for grading the cognitive state of patients for the clinician. Journal of Psychiatric Research, 12(3), 189–198. Retrieved from http://www.health.fgov.be/internet2Prd/groups/public/@public/@dg1/@acutecare/documents/ie2divers/19074388_nl.pdf
   PubMed Web of Science ®Google Scholar
• Fonseca, R. P., Salles, J. F. de, & Parente, M. A. de M. P. (2009). Instrumento de Avaliação Neuropsicológica Breve Neupsilin. Porto Alegre: Vetor.
   Google Scholar
• Fonseca, R. P., Oliveira, C., Gindri, G., Zimmermann, N., Reppold, C., & Parente, M. (2010). Teste Hayling: Um instrumento de avaliação de componentes das funções executivas. In C. S. Hutz (Ed.), Avanços em avaliação psicológica e neuropsicológica de crianças e adolescentes (1st ed., pp. 337–364). São Paulo: Casa Do Psicólogo.
   Google Scholar
• Freire, M. Á., Figueiredo, V. L. M. de, Gomide, A., Jansen, K., Silva, R. A. da, Magalhães, P. V. da S., & Kapczinski, F. P. (2014). Escala Hamilton: Estudo das características psicométricas em uma amostra do sul do Brasil. Jornal Brasileiro de Psiquiatria, 6 3(4), 281–289. doi:10.1590/0047-2085000000036
   Google Scholar
• Gindri, G., Zibetti, M. R., & Fonseca, R. P. (2008). Funções executivas pós-lesão de hemisfério direito: Estudo comparativo e freqüência de déficits. Psico, 39(3). Retrieved from http://revistaseletronicas.pucrs.br/ojs/index.php/revistapsico/article/view/3901
   Google Scholar
• Gonzalez-Gadea, M. L., Baez, S., Torralva, T., Castellanos, F. X., Rattazzi, A., Bein, V., … Ibanez, A. (2013). Cognitive variability in adults with ADHD and AS: Disentangling the roles of executive functions and social cognition. Research in Developmental Disabilities, 34(2), 817–830. doi:10.1016/j.ridd.2012.11.009
   PubMed Web of Science ®Google Scholar
• Gorenstein, C., Andrade, L. H. S. G., & Zuardi, A. W. (2000). Escalas de avalia{\textbackslash}ccão clínica em psiquiatria e psicofarmacologia. Lemos Editorial.
   Google Scholar
• Greve, K. W., & Smith, M. C. (1991). A Comparison of the Wisconsin Card Sorting Test with the modified card sorting test for use with older adults. Gerontology and Geriatrics Education, 11(4), 57–66. doi:10.1300/J021v11n04_05
   Google Scholar
• Hamilton, M. (1960). A rating scale for depression. Journal of Neurology, Neurosurgery, and Psychiatry, 23(1), 56–62. Retrieved from http://www.ncbi.nlm.nih.gov/pmc/articles/PMC495331/
   PubMed Web of Science ®Google Scholar
• Hoogland, J., van Wanrooij, L. L., Boel, J. A., Goldman, J. G., Stebbins, G. T., Dalrymple-Alford, J. C., … Weintraub, D. (2018). Detecting mild cognitive deficits in Parkinson’s disease: Comparison of neuropsychological tests. Movement Disorders, 33(11), 1750–1759. doi:10.1002/mds.110
   PubMed Web of Science ®Google Scholar
• Howieson, D. (2019). Current limitations of neuropsychological tests and assessment procedures. The Clinical Neuropsychologist, 33(2), 200–208. doi:10.1080/13854046.2018.1552762
   PubMed Web of Science ®Google Scholar
• Ingram, F., Greve, K. W., Ingram, P. T. F., & Soukup, V. M. (1999). Temporal stability of the Wisconsin Card Sorting Test in an untreated patient sample. British Journal of Clinical Psychology, 38(2), 209–211. doi:10.1348/014466599162764
   PubMedGoogle Scholar
• Ioime, L., Guglielmo, R., Affini, G. F., Quatrale, M., Martinotti, G., Callea, A., … Janiri, L. (2018). Neuropsychological performance in alcohol dependent patients: A one-year longitudinal study. Psychiatry Investigation, 15(5), 505–513. doi:10.30773/pi.2017.09.27.1
   PubMed Web of Science ®Google Scholar
• Jeyakumar, S. L. E., Warriner, E. M., Raval, V. V., & Ahmad, S. A. (2004). Balancing the Need for Reliability and Time Efficiency: Short Forms of the Wechsler Adult Intelligence Scale-III. Educational and Psychological Measurement, 64(1), 71–87. doi:10.1177/0013164403258407
   Web of Science ®Google Scholar
• Kamal, S., Kamal, A., Bayoumy, H., Abdel Mawla, S., Roshdy, R., & Garas, O. (2016). Executive dysfunction in patients with schizophrenia and bipolar disorders. Middle East Current Psychiatry, 23(2), 79–84. doi:10.1097/01.XME.0000475262.10853.09
   Google Scholar
• Karr, J. E., Areshenkoff, C. N., Rast, P., Hofer, S. M., Iverson, G. L., & Garcia-Barrera, M. A. (2018). The unity and diversity of executive functions: A systematic review and re-analysis of latent variable studies. Psychological Bulletin, 144(11), 1147–1185. doi:10.1037/bul0000160
   PubMed Web of Science ®Google Scholar
• Knight, M. J., & Baune, B. T. (2018). Cognitive dysfunction in major depressive disorder. Current Opinion in Psychiatry, 31(1), 26–31. doi:10.1097/YCO.0000000000000378
   PubMed Web of Science ®Google Scholar
• Lange, F., Kröger, B., Steinke, A., Seer, C., Dengler, R., & Kopp, B. (2016). Decomposing card-sorting performance: Effects of working memory load and age-related changes. Neuropsychology, 30(5), 579–590. doi:10.1037/neu0000271
   PubMed Web of Science ®Google Scholar
• Lineweaver, T. T., Bond, M. W., Thomas, R. G., & Salmon, D. P. (1999). A normative study of Nelson’s (1976) modified version of the Wisconsin Card Sorting Test in healthy older adults. The Clinical Neuropsychologist, 13(3), 328–347. doi:10.1076/clin.13.3.328.1745
   PubMed Web of Science ®Google Scholar
• Matsuoka, T., Kato, Y., Imai, A., Fujimoto, H., Shibata, K., Nakamura, K., … Narumoto, J. (2018). Differences in the neural correlates of frontal lobe tests. Psychogeriatrics, 18(1), 42–48. doi:10.1111/psyg.12285
   PubMed Web of Science ®Google Scholar
• Meyer, A., Zimmermann, R., Gschwandtner, U., Hatz, F., Bousleiman, H., Schwarz, N., & Fuhr, P. (2015). Apathy in Parkinson’s disease is related to executive function, gender and age but not to depression. Frontiers in Aging Neuroscience, 6:350. doi:10.3389/fnagi.2014.00350
   PubMed Web of Science ®Google Scholar
• Miskowiak, K. W., Kjaerstad, H. L., Meluken, I., Petersen, J. Z., Maciel, B. R., Köhler, C. A., … Carvalho, A. F. (2017). The search for neuroimaging and cognitive endophenotypes: A critical systematic review of studies involving unaffected first-degree relatives of individuals with bipolar disorder. Neuroscience and Biobehavioral Reviews, 73, 1–22. doi:10.1016/j.neubiorev.2016.12.011
   PubMed Web of Science ®Google Scholar
• Nascimento, E. (2004). WAIS-III: Escala de inteligência Wechsler para adultos. São Paulo: Casa Do Psicólogo.
   Google Scholar
• Nelson, H. E. (1976). A modified card sorting test sensitive to frontal lobe defects. Cortex; A Journal Devoted to the Study of the Nervous System and Behavior, 12(4), 313–324. Retrieved from http://www.sciencedirect.com/science/article/pii/S0010945276800354
   PubMed Web of Science ®Google Scholar
• Nyhus, E., & Barcelo, F. (2009). The Wisconsin Card Sorting Test and the cognitive assessment of prefrontal executive functions: A critical update. Brain and Cognition, 71(3), 437–451. doi:10.1016/j.bandc.2009.03.005
   PubMed Web of Science ®Google Scholar
• Reitan, R. M., & Wolfson, D. (1995). Category test and trail making test as measures of frontal lobe functions. The Clinical Neuropsychologist, 9(1), 50–56. Retrieved from http://www.tandfonline.com/doi/full/10.1080/13854049508402057 doi:10.1080/13854049508402057
   Web of Science ®Google Scholar
• Robinson, L. J., Gray, J. M., Ferrier, I. N., & Gallagher, P. (2016). The effect of self-monitoring on Wisconsin Card Sorting Test performance in euthymic patients with bipolar disorder: A pilot study. Cognitive Neuropsychiatry, 21(3), 256–270. doi:10.1080/13546805.2016.1184134
   PubMed Web of Science ®Google Scholar
• Sánchez-Cubillo, I., Periáñez, J. A., Adrover-Roig, D., Rodríguez-Sánchez, J. M., Ríos-Lago, M., Tirapu, J., & Barceló, F. (2009). Construct validity of the Trail Making Test: Role of task-switching, working memory, inhibition/interference control, and visuomotor abilities. Journal of the International Neuropsychological Society, 15(3), 438–450. doi:10.1017/S1355617709090626
   PubMed Web of Science ®Google Scholar
• Sasabayashi, D., Takayanagi, Y., Nishiyama, S., Takahashi, T., Furuichi, A., Kido, M., … Suzuki, M. (2016). Increased frontal gyrification negatively correlates with executive function in patients with first-episode schizophrenia. Cerebral Cortex, 27(4):2686–2694. doi:10.1093/cercor/bhw101
   Web of Science ®Google Scholar
• Shipstead, Z., Harrison, T. L., & Engle, R. W. (2016). Working memory capacity and fluid intelligence. Perspectives on Psychological Science, 11(6), 771–799. doi:10.1177/1745691616650647
   Web of Science ®Google Scholar
• Singh, S., Aich, T., & Bhattarai, R. (2017). Wisconsin Card Sorting Test performance impairment in schizophrenia: An Indian study report. Indian Journal of Psychiatry, 59(1), 88. doi:10.4103/0019-5545.204440
   PubMed Web of Science ®Google Scholar
• Snyder, H. R., Miyake, A., & Hankin, B. L. (2015). Advancing understanding of executive function impairments and psychopathology: Bridging the gap between clinical and cognitive approaches. Frontiers in Psychology, 6, 328. doi:10.3389/fpsyg.2015.00328
   PubMed Web of Science ®Google Scholar
• Stroop, J. R. (1935). Studies of interference in serial verbal reactions. Journal of Experimental Psychology, 18(6), 643–662. doi:10.1037/h0054651
   Google Scholar
• Sun, J.-J., Liu, X.-M., Shen, C.-Y., Feng, K., & Liu, P.-Z. (2018). Abnormal prefrontal brain activation during a verbal fluency task in bipolar disorder patients with psychotic symptoms using multichannel NIRS. Neuropsychiatric Disease and Treatment, Volume 14, 3081–3090. doi:10.2147/NDT.S176153
   Web of Science ®Google Scholar
• Taskiran, S., Mutluer, T., & Necef, I. (2017). 4.16 Neuropsychological profile differences between children with disruptive mood dysregulation disorder (DMDD) and attention-deficit/hyperactivity disorder (ADHD): A preliminary study. Journal of the American Academy of Child and Adolescent Psychiatry, 56(10), S233–S234. doi:10.1016/j.jaac.2017.09.232
   Web of Science ®Google Scholar
• Uran, P., & Kılıç, B. G. (2015). Comparison of neuropsychological performances and behavioral patterns of children with attention deficit hyperactivity disorder and severe mood dysregulation. European Child and Adolescent Psychiatry, 24(1), 21–30. doi:10.1007/s00787-014-0529-8
   PubMed Web of Science ®Google Scholar
• van Aken, L., Kessels, R. P. C., Wingbermühle, E., van der Veld, W. M., & Egger, J. I. M. (2016). Fluid intelligence and executive functioning more alike than different? Acta Neuropsychiatrica, 28(1), 31–37. doi:10.1017/neu.2015.46
   PubMed Web of Science ®Google Scholar
• Van Gorp, W. G., Kalechstein, A. D., Moore, L. H., Hinkin, C. H., Mahler, M. E., Foti, D., & Mendez, M. (1997). A clinical comparison of two forms of the card sorting test. The Clinical Neuropsychologist, 11(2), 155–160. doi:10.1080/13854049708407044
   Web of Science ®Google Scholar
• Vilela, J. A. A., & Loureiro, S. (2000). Escala de Avaliação de Mania de Young – Estudo das qualidades psicométricas da versão brasileira. In C. Gorenstein, C. L. Andrade, & A. W. Zuardi (Eds.), Escalas de Avaliação Clínica em Psiquiatria e Psicofarmacologia (pp. 113–124). São Paulo: Lemos Editorial.
   Google Scholar
• Vilela, J. A. A., Crippa, J. A. S., Del-Ben, C. M., & Loureiro, S. R. (2005). Reliability and validity of a Portuguese version of the Young Mania Rating Scale. Brazilian Journal of Medical and Biological Research, 38(9), 1429–1439. doi:10.1590/S0100-879X2005000900019
   PubMed Web of Science ®Google Scholar
• Wang, Q., Sun, J., Ma, X., Wang, Y., Yao, J., Deng, W., … Li, T. (2011). Normative data on a battery of neuropsychological tests in the Han Chinese population. Journal of Neuropsychology, 5(1), 126–142. doi:10.1348/174866410X516803
   PubMedGoogle Scholar
• Wechsler, D. (2002). Memory Scale (3rd ed.). San Antonio: Psychological Corporation.
   Google Scholar
• Wegmann, E., Brand, M., Snagowski, J., & Schiebener, J. (2017). Are you able not to react to what you hear? Inhibition behavior measured with an auditory Go/NoGo paradigm. Journal of Clinical and Experimental Neuropsychology, 39(1), 58–71. doi:10.1080/13803395.2016.1201461
   PubMed Web of Science ®Google Scholar
• Xu, G., Lin, K., Rao, D., Dang, Y., Ouyang, H., Guo, Y., … Chen, J. (2012). Neuropsychological performance in bipolar I, bipolar II and unipolar depression patients: A longitudinal, naturalistic study. Journal of Affective Disorders, 136(3), 328–339. doi:10.1016/j.jad.2011.11.029
   PubMed Web of Science ®Google Scholar
• Young, R. C., Biggs, J. T., Ziegler, V. E., & Meyer, D. A. (1978). A rating scale for mania: Reliability, validity and sensitivity. British Journal of Psychiatry, 133(5), 429–435. doi:10.1192/bjp.133.5.429
   PubMed Web of Science ®Google Scholar
• Zimmerman, M., Martinez, J. H., Young, D., Chelminski, I., & Dalrymple, K. (2013). Severity classification on the Hamilton depression rating scale. Journal of Affective Disorders, 150(2), 384–388. doi:10.1016/j.jad.2013.04.028
   PubMed Web of Science ®Google Scholar
• Zimmermann, N., Cardoso, C., de, O., Trentini, C. M., Grassi-Oliveira, R., & Fonseca, R. P. (2015). Brazilian preliminary norms and investigation of age and education effects on the Modified Wisconsin Card Sorting Test, stroop color and word test and digit span test in adults. Dementia and Neuropsychologia, 9(2), 120–127. doi:10.1590/1980-57642015DN92000006
   PubMedGoogle Scholar