Interpreting reliable change on the Spanish-language NIH toolbox cognition battery

References

• Artiola I Fortuny, L., Hermosillo, D., Heaton, R. K., & Pardee, R. E. (1999). Manual de normas y procedimientos para la Batería Neuropsicológica en Español. Psychology Press.
   Google Scholar
• Beaumont, J. L., Havlik, R., Cook, K. F., Hays, R. D., Wallner-Allen, K., Korper, S. P., Lai, J. S., Nord, C., Zill, N., Choi, S., Yost, K. J., Ustsinovich, V., Brouwers, P., Hoffman, H. J., & Gershon, R. (2013). Norming plans for the NIH Toolbox. Neurology, 80(11 Suppl 3), S87–S92. https://doi.org/10.1212/wnl.0b013e3182872e70.
   PubMedGoogle Scholar
• Brooks, B. L., Holdnack, J. A., & Iverson, G. L. (2016). To change is human: “abnormal” reliable change memory scores are common in healthy adults and older adults. Archives of Clinical Neuropsychology, 31(8), 1026–1036. https://doi.org/10.1093/arclin/acw079
   PubMed Web of Science ®Google Scholar
• Carlozzi, N. E., Tulsky, D. S., Chiaravalloti, N. D., Beaumont, J. L., Weintraub, S., Conway, K., & Gershon, R. C. (2014). NIH toolbox cognitive battery (NIHTB-CB): The NIHTB pattern comparison processing speed test. Journal of the International Neuropsychological Society, 20(6), 630–641. https://doi.org/10.1017/S1355617714000319
   PubMed Web of Science ®Google Scholar
• Casaletto, K. B., Umlauf, A., Marquine, M., Beaumont, J. L., Mungas, D., Gershon, R., Slotkin, J., Akshoomoff, N., & Heaton, R. K. (2016). Demographically corrected normative standards for the Spanish language version of the NIH Toolbox Cognition Battery. Journal of the International Neuropsychological Society, 22(3), 364–374. https://doi.org/10.1017/S135561771500137X.
   PubMed Web of Science ®Google Scholar
• Chelune, G. J., Naugle, R. I., Lüders, H., Sedlak, J., & Awad, I. A. (1993). Individual change after epilepsy surgery: Practice effects and base-rate information. Neuropsychology, 7(1), 41–52. https://doi.org/10.1037/0894-4105.7.1.41.
   Google Scholar
• Cherner, M., Marquine, M. J., Umlauf, A., Morlett Paredes, A., Rivera Mindt, M., Suárez, P., Yassai-Gonzalez, D., Kamalyan, L., Scott, T., Heaton, A., Diaz-Santos, M., Gooding, A., Artiola I Fortuny, L., & Heaton, R. K. (2021). Neuropsychological norms for the US-Mexico border region in Spanish (NP-NUMBRS) project: Methodology and sample characteristics. The Clinical Neuropsychologist, 35(2), 253–268. https://doi.org/10.1080/13854046.2019.1709661.
   PubMed Web of Science ®Google Scholar
• Cysique, L. A., Franklin, D., Abramson, I., Ellis, R. J., Letendre, S., Collier, A., Clifford, D., Gelman, B., McArthur, J., Morgello, S., Simpson, D., McCutchan, J. A., Grant, I., & Heaton, R. K, HNRC Group. (2011). Normative data and validation of a regression based summary score for assessing meaningful neuropsychological change. Journal of Clinical and Experimental Neuropsychology, 33(5), 505–522. https://doi.org/10.1080/13803395.2010.535504.
   PubMed Web of Science ®Google Scholar
• Delis, D. C., Kaplan, E., & Kramer, J. H. (2001). The Delis–Kaplan executive function system: technical manual. The Psychological Corporation.
   Google Scholar
• Dikmen, S. S., Bauer, P. J., Weintraub, S., Mungas, D., Slotkin, J., Beaumont, J. L., Gershon, R., Temkin, N. R., & Heaton, R. K. (2014). Measuring episodic memory across the lifespan: NIH toolbox picture sequence memory test. Journal of the International Neuropsychological Society, 20(6), 611–619. https://doi.org/10.1017/S1355617714000460.
   PubMed Web of Science ®Google Scholar
• Duff, K. (2012). Current topics in science and practice evidence-based indicators of neuropsychological change in the individual patient: Relevant concepts and methods. Archives of Clinical Neuropsychology, 27(3), 248–261. https://doi.org/10.1093/arclin/acr120.
   PubMed Web of Science ®Google Scholar
• Duff, K., Beglinger, L. J., Moser, D. J., Paulsen, J. S., Schultz, S. K., & Arndt, S. (2010). Predicting cognitive change in older adults: The relative contribution of practice effects. Archives of Clinical Neuropsychology, 25(2), 81–88. https://doi.org/10.1093/arclin/acp105.
   PubMed Web of Science ®Google Scholar
• Erdfelder, E., Faul, F., Buchner, A., & Lang, A. G. (2009). Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses. Behavior Research Methods, 41(4), 1149–1160. https://doi.org/10.3758/BRM.41.4.1149.
   PubMed Web of Science ®Google Scholar
• Field, A. P. (2005). Intraclass correlation. In B. Everitt & D. Howell (Eds.), Encyclopedia of statistics in behavioral science (pp. 948–954). John Wiley & Sons, Ltd. https://doi.org/10.1002/0470013192.bsa313.
   Google Scholar
• Fox, R. S., Manly, J. J., Slotkin, J., Devin Peipert, J., & Gershon, R. C. (2021). Reliability and validity of the Spanish-language version of the NIH Toolbox. Assessment, 28(2), 457–471. https://doi.org/10.1177/1073191120913943.
   PubMed Web of Science ®Google Scholar
• Gershon, R. C. (2016). NIH toolbox norming study. Harvard Dataverse, V4, https://doi.org/10.7910/DVN/FF4DI7
   Google Scholar
• Gershon, R. C., Fox, R. S., Manly, J. J., Mungas, D. M., Nowinski, C. J., Roney, E. M., & Slotkin, J. (2020). The NIH toolbox: Overview of development for use with Hispanic populations. Journal of the International Neuropsychological Society, 26(6), 567–575. https://doi.org/10.1017/S1355617720000028.
   PubMed Web of Science ®Google Scholar
• Guàrdia-Olmos, J., Peró-Cebollero, M., Rivera, D., & Arango-Lasprilla, J. C. (2015). Methodology for the development of normative data for ten Spanish-language neuropsychological tests in eleven Latin American countries. NeuroRehabilitation, 37(4), 493–499. https://doi.org/10.3233/NRE-151277.
   PubMed Web of Science ®Google Scholar
• Guilmette, T. J., Sweet, J. J., Hebben, N., Koltai, D., Mahone, E. M., Spiegler, B. J., Stucky, K., & Westerveld, M, Conference Participants. (2020). American Academy of Clinical Neuropsychology consensus conference statement on uniform labeling of performance test scores. The Clinical Neuropsychologist, 34(3), 437–453. https://doi.org/10.1080/13854046.2020.1722244.
   PubMed Web of Science ®Google Scholar
• Heaton, R. K., Akshoomoff, N., Tulsky, D., Mungas, D., Weintraub, S., Dikmen, S., Beaumont, J., Casaletto, K. B., Conway, K., Slotkin, J., & Gershon, R. (2014). Reliability and validity of composite scores from the NIH toolbox cognition battery in adults. Journal of the International Neuropsychological Society, 20(6), 588–598. https://doi.org/10.1017/S1355617714000241.
   PubMed Web of Science ®Google Scholar
• Heilbronner, R. L., Sweet, J. J., Attix, D. K., Krull, K. R., Henry, G. K., & Hart, R. P. (2010). Official position of the American Academy of Clinical Neuropsychology on serial neuropsychological assessments: The utility and challenges of repeat test administrations in clinical and forensic contexts. The Clinical Neuropsychologist, 24(8), 1267–1278. https://doi.org/10.1080/13854046.2010.526785.
   PubMed Web of Science ®Google Scholar
• Hensel, A., Luck, T., Luppa, M., Glaesmer, H., Angermeyer, M. C., & Riedel-Heller, S. G. (2009). Does a reliable decline in Mini Mental State Examination total score predict dementia? Diagnostic accuracy of two reliable change indices. Dementia and Geriatric Cognitive Disorders, 27(1), 50–58. https://doi.org/10.1159/000189267.
   PubMed Web of Science ®Google Scholar
• Iverson, G. L. (2001). Interpreting change on the WAIS-III/WMS-III in clinical samples. Archives of Clinical Neuropsychology, 16(2), 183–191. https://doi.org/10.1016/S0887-6177(00)00060-3.
   PubMed Web of Science ®Google Scholar
• Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59(1), 12–19. https://doi.org/10.1037/0022-006X.59.1.12.
   PubMed Web of Science ®Google Scholar
• Koo, T. K., & Li, M. Y. (2016). A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15(2), 155–163. https://doi.org/10.1016/j.jcm.2016.02.012%0A
   PubMed Web of Science ®Google Scholar
• Martin, R., Sawrie, S., Gilliam, F., Mackey, M., Faught, E., Knowlton, R., & Kuzniekcy, R. (2002). Determining reliable cognitive change after epilepsy surgery: Development of reliable change indices and standardized regression-based change norms for the WMS-III and WAIS-III. Epilepsia, 43(12), 1551–1558. https://doi.org/10.1046/j.1528-1157.2002.23602.x.
   PubMed Web of Science ®Google Scholar
• Mungas, D., Reed, B. R., Crane, P. K., Haan, M. N., & González, H. (2004). Spanish and English Neuropsychological Assessment Scales (SENAS): Further development and psychometric characteristics. Psychological Assessment, 16(4), 347–359. https://doi.org/10.1037/1040-3590.16.4.347.
   PubMed Web of Science ®Google Scholar
• Mungas, D., Reed, B. R., Haan, M. N., & Gonzalez, H. (2005). Spanish and English Neuropsychological Assessment Scales: Relationship to demographics, language, cognition, and independent function. Neuropsychology, 19(4), 466–475. https://doi.org/10.1037/0894-4105.19.4.466.
   PubMed Web of Science ®Google Scholar
• Nakhutina, L., Pramataris, P., Morrison, C., Devinsky, O., & Barr, W. B. (2010). Reliable change indices and regression-based measures for the Rey-Osterreith complex figure test in partial epilepsy patients. The Clinical Neuropsychologist, 24(1), 38–44. https://doi.org/10.1080/13854040902960091.
   PubMed Web of Science ®Google Scholar
• Ostrosky-Solís, F., Ardila, A., & Rosselli, M. (1999). NEUROPSI: A brief neuropsychological test battery in Spanish with norms by age and educational level. Journal of the International Neuropsychological Society, 5(5), 413–433. https://doi.org/10.1017/S1355617799555045.
   PubMed Web of Science ®Google Scholar
• Pontón, M. O., Satz, P., Herrera, L., Ortiz, F., Urrutia, C. P., Young, R., D'Elia, L. F., Furst, C. J., & Namerow, N. (1996). Normative data stratified by age and education for the Neuropsychological Screening Battery for Hispanics (NeSBHIS): Initial report. Journal of the International Neuropsychological Society, 2(2), 96–104. https://doi.org/10.1017/s1355617700000941.
   PubMedGoogle Scholar
• Portaccio, E., Goretti, B., Zipoli, V., Iudice, A., Pina, D., Della, Malentacchi, G. M., Sabatini, S., Annunziata, P., Falcini, M., Mazzoni, M., & Pia Amato, M, TuSCIMS Study Group (2010). Reliability, practice effects, and change indices for Rao's Brief Repeatable Battery. Multiple Sclerosis, 16(5), 611–617. https://doi.org/10.1177/1352458510362818.
   PubMed Web of Science ®Google Scholar
• Rabin, L. A., Paolillo, E., & Barr, W. B. (2016). Stability in test-usage practices of clinical neuropsychologists in the United States and Canada over a 10-year period: A follow-up survey of INS and NAN members. Archives of Clinical Neuropsychology, 31(3), 206–230. https://doi.org/10.1093/arclin/acw007.
   PubMed Web of Science ®Google Scholar
• Rivera Mindt, M., Byrd, D., Saez, P., & Manly, J. (2010). Increasing culturally competent neuropsychological services for ethnic minority populations: A call to action. The Clinical Neuropsychologist, 24(3), 429–453. https://doi.org/10.1080/13854040903058960.
   PubMed Web of Science ®Google Scholar
• Rivera Mindt, M., Marquine, M. J., Aghvinian, M., Paredes, A. M., Kamalyan, L., Suárez, P., Heaton, A., Scott, T. M., Gooding, A., Diaz-Santos, M., Umlauf, A., Taylor, M. J., Artiola I Fortuny, L., Heaton, R. K., & Cherner, M. (2021). The neuropsychological norms for the U.S.-Mexico border region in Spanish (NP-NUMBRS) project: Overview and considerations for life span research and evidence-based practice. The Clinical Neuropsychologist, 35(2), 466–480. https://doi.org/10.1080/13854046.2020.1794046/.
   PubMed Web of Science ®Google Scholar
• Rossetti, H. C., Cullum, C. M., Hynan, L. S., & Lacritz, L. H. (2010). The CERAD neuropsychologic battery total score and the progression of Alzheimer disease. Alzheimer Disease & Associated Disorders, 24(2), 138–142. https://doi.org/10.1097/WAD.0b013e3181b76415.
   PubMed Web of Science ®Google Scholar
• Sánchez-Benavides, G., Pena-Casanova, J., Casals-Coll, M., Gramunt, N., Manero, R. M., Puig-Pijoan, A., Aguilar, M., Robles, A., Antúnez, C., Frank-García, A., Fernández-Martínez, M., & Blesa, R, NEURONORMA Study Team. (2016). One-year reference norms of cognitive change in Spanish old adults: Data from the NEURONORMA Sample. Archives of Clinical Neuropsychology, 31(4), 378–388. https://doi.org/10.1093/arclin/acw018.
   PubMed Web of Science ®Google Scholar
• Tulsky, D. S., Carlozzi, N., Chiaravalloti, N. D., Beaumont, J. L., Kisala, P. A., Mungas, D., Conway, K., & Gershon, R. (2014). NIH Toolbox Cognition Battery (NIHTB-CB): List sorting test to measure working memory. Journal of the International Neuropsychological Society, 20(6), 599–610. https://doi.org/10.1017/S135561771400040X.
   PubMed Web of Science ®Google Scholar
• Wechsler, D. (2008). Wechsler Adult Intelligence Scale, Fourth edition. Pearson, Inc.
   Google Scholar
• Wechsler, D. (2009). Wechsler Memory Scale, Fourth edition. Pearson.
   Google Scholar
• Zelazo, P. D., Anderson, J. E., Richler, J., Wallner-Allen, K., Beaumont, J. L., Conway, K. P., Gershon, R., & Weintraub, S. (2014). NIH toolbox cognition battery (CB): Validation of executive function measures in adults. Journal of the International Neuropsychological Society, 20(6), 620–629. https://doi.org/10.1017/S1355617714000472.
   PubMed Web of Science ®Google Scholar