67
Views
0
CrossRef citations to date
0
Altmetric
Research Article

Computerized assessment of executive functioning: Validation of the CNS Vital Signs executive functioning scores in a sample of community-dwelling older adults

ORCID Icon, ORCID Icon & ORCID Icon
Received 13 Dec 2023, Accepted 09 May 2024, Published online: 19 May 2024

References

  • Alfalahi, H., Khandoker, A. H., Chowdhury, N., Iakovakis, D., Dias, S. B., Chaudhuri, K. R., & Hadjileontiadis, L. J. (2022). Diagnostic accuracy of keystroke dynamics as digital biomarkers for fine motor decline in neuropsychiatric disorders: A systematic review and meta-analysis. Scientific Reports, 12(1), 7690. https://doi.org/10.1038/s41598-022-11865-7
  • Anderson, M. N., Lempke, L. B., Bell, D. H., Lynall, R. C., & Schmidt, J. D. (2020). The ability of CNS Vital Signs to detect coached sandbagging performance during concussion baseline testing: A randomized control trial. Brain Injury, 34(3), 369–374. https://doi.org/10.1080/02699052.2020.1724332
  • Arán Filippetti, V., & Richaud, M. C. (2016). A structural equation modeling of executive functions, IQ and mathematical skills in primary students: Differential effects on number production, mental calculus and arithmetical problems. Child Neuropsychology, 23(7), 864–888. https://doi.org/10.1080/09297049.2016.1199665
  • Ball, C., & Puffett, A. (1998). The assessment of cognitive function in the elderly using videoconferencing. Journal of Telemedicine and Telecare, 4(1_suppl), 36–38. https://doi.org/10.1258/1357633981931362
  • Baytunca, M. B., Inci, S. B., Ipci, M., Kardas, B., Bolat, G. U., & Ercan, E. S. (2018). The neurocognitive nature of children with ADHD comorbid sluggish cognitive tempo: Might SCT be a disorder of vigilance? Psychiatry Research, 270, 967–973. https://doi.org/10.1016/j.psychres.2018.03.038
  • Bell-McGinty, S., Podell, K., Franzen, M., Baird, A. D., & Williams, M. J. (2002). Standard measures of executive function in predicting instrumental activities of daily living in older adults. International Journal of Geriatric Psychiatry, 17(9), 828–834. https://doi.org/10.1002/gps.646
  • Bezdicek, O., Michalec, J., Nikolai, T., Havránková, P., Roth, J., Jech, R., & Růžička, E. (2015). Clinical validity of the mattis dementia rating scale in differentiating mild cognitive impairment in Parkinson’s disease and normative data. Dementia and Geriatric Cognitive Disorders, 39(5-6), 303–311. https://doi.org/10.1159/000375365
  • Bilder, R. M., Postal, K. S., Barisa, M., Aase, D. M., Cullum, C. M., Gillaspy, S. R., Harder, L., Kanter, G., Lanca, M., Lechuga, D. M., Morgan, J. M., Most, R., Puente, A. E., Salinas, C. M., & Woodhouse, J. (2020). InterOrganizational practice committee recommendations/guidance for teleneuropsychology (TeleNP) in response to the COVID-19 pandemic. The Clinical Neuropsychologist, 34(7-8), 1314–1334. https://doi.org/10.1080/13854046.2020.1767214
  • Brandley, E. T., & Holton, K. F. (2020). Breakfast positively impacts cognitive function in college students with and without ADHD. American Journal of Health Promotion: AJHP, 34(6), 668–671. https://doi.org/10.1177/0890117120903235
  • Braver, T. S., Cohen, J. D., Nystrom, L. E., Jonides, J., Smith, E. E., & Noll, D. C. (1997). A parametric study of prefrontal cortex involvement in human working memory. Neuroimage, 5, 49–62. https://doi.org/10.1006/nimg.1996.0247
  • Brearly, T. W., Shura, R. D., Martindale, S. L., Lazowski, R. A., Luxton, D. D., Shenal, B. V., & Rowland, J. A. (2017). Neuropsychological test administration by videoconference: A systematic review and meta-analysis. Neuropsychology Review, 27(2), 174–186. https://doi.org/10.1007/s11065-017-9349-1
  • Brooks, B. L., Sherman, E. M. S., & Iverson, G. L. (2014). Embedded validity indicators on CNS Vital Signs in youth with neurological diagnoses. Archives of Clinical Neuropsychology, 29(5), 422–431. https://doi.org/10.1093/arclin/acu029
  • Brooks, B. L., & Sherman, E. M. S. (2012). Computerized neuropsychological testing to rapidly evaluate cognition in pediatric patients with neurologic disorders. Journal of Child Neurology, 27(8), 982–991. https://doi.org/10.1177/0883073811430863
  • Brooks, B. L., Plourde, V., Fay-McClymont, T. B., MacAllister, W. S., & Sherman, E. M. S. (2019). Factor structure of the CNS Vital Signs computerized cognitive battery in youth with neurological diagnoses. Child Neuropsychology: A Journal on Normal and Abnormal Development in Childhood and Adolescence, 25(7), 980–991. https://doi.org/10.1080/09297049.2019.1569609
  • Brothers, S. L., & Suchy, Y. (2022). Daily assessment of executive functioning and expressive suppression predict daily functioning among community-dwelling older adults. Journal of the International Neuropsychological Society, 28(9), 974–983. https://doi.org/10.1017/S1355617721001156
  • Burton, C. L., Strauss, E., Hultsch, D. F., & Hunter, M. A. (2006). Cognitive functioning and everyday problem solving in older adults. The Clinical Neuropsychologist, 20(3), 432–452. https://doi.org/10.1080/13854040590967063
  • Butzner, M., & Cuffee, Y. (2021). telehealth interventions and outcomes across rural communities in the United States: Narrative review. Journal of Medical Internet Research, 23(8), e29575. https://doi.org/10.2196/29575
  • Cahn-Weiner, D. A., Malloy, P. F., Boyle, P. A., Marran, M., & Salloway, S. (2000). Prediction of functional status from neuropsychological tests in community-dwelling elderly individuals. The Clinical Neuropsychologist, 14(2), 187–195. https://doi.org/10.1076/1385-4046(200005)14:2;1-Z;FT187
  • Cantor, J. H., McBain, R. K., Pera, M. F., Bravata, D. M., & Whaley, C. M. (2021). Who is (and is not) receiving telemedicine care during the COVID-19 pandemic. American Journal of Preventive Medicine, 61(3), 434–438. https://doi.org/10.1016/j.amepre.2021.01.030
  • Cass, J., Fristad, M., Valleru, J., Gallup, J., & Butter, E. (2020). Improving wait times for pediatric neuropsychology services. Evidence-Based Practice in Child and Adolescent Mental Health, 5(2), 128–138. https://doi.org/10.1080/23794925.2020.1784057
  • Chu, C., Cram, P., Pang, A., Stamenova, V., Tadrous, M., & Bhatia, R. S. (2021). Rural telemedicine use before and during the COVID-19 Pandemic: Repeated cross-sectional study. Journal of Medical Internet Research, 23(4), e26960. https://doi.org/10.2196/26960
  • CNS Vital Signs. (2019). CNS vital signs interpretation guide. https://www.cnsvs.com/WhitePapers/CNSVS-BriefInterpretationGuide.pdf
  • Cook, S. E., Marsiske, M., & McCoy, K. J. M. (2009). The use of the modified telephone interview for cognitive status (TICS-M) in the detection of amnestic mild cognitive impairment. Journal of Geriatric Psychiatry and Neurology, 22(2), 103–109. https://doi.org/10.1177/0891988708328214
  • Cullum, C. M., Hynan, L. S., Grosch, M., Parikh, M., & Weiner, M. F. (2014). Teleneuropsychology: Evidence for video teleconference-based neuropsychological assessment. Journal of the International Neuropsychological Society, 20(10), 1028–1033. https://doi.org/10.1017/S1355617714000873
  • Delis, D. C., Kaplan, E., & Kramer, J. H. (2001a). Delis-Kaplan executive function System. Pearson.
  • Delis, D. C., Kaplan, E., & Kramer, J. H. (2001b). Delis-Kaplan executive function system examiner’s manual. Pearson.
  • DesRuisseaux, L. A., Suchy, Y., & Franchow, E. I. (2023). Intra-individual variability identifies individuals vulnerable to contextually induced executive lapses. The Clinical Neuropsychologist, 37(2), 322–349. https://doi.org/10.1080/13854046.2022.2055651
  • Feldstein, S. N., Keller, R. K., Portman, R. E., Durham, R. L., Klebe, K. J., & Davis, H. P. (1999). A comparison of computerized and standard versions of the Wisconsin Card Sorting Test. The Clinical Neuropsychologist, 13(3), 303–313. https://doi.org/10.1076/clin.13.3.303.1744
  • Franklin, W. J., Kloudas, L., Saraf, A., Karlsten, M., Parekh, D., & Schwartz, D. D. (2014). Neurocognitive evaluation of adults with congenital heart disease: The niche study. Journal of the American College of Cardiology, 63(12), A489. https://doi.org/10.1016/S0735-1097(14)60489-7
  • Gereau Mora, M., & Suchy, Y. (2023). Know thyself: Executive functioning and sex predict self-appraisal of functional abilities in community-dwelling older adults. The Clinical Neuropsychologist, 37(8), 1686–1709. https://doi.org/10.1080/13854046.2023.2167738
  • Gibbons, L. E., Carle, A. C., Mackin, R. S., Harvey, D., Mukherjee, S., Insel, P., Curtis, S. M., Mungas, D., & Crane, P. K. (2012). A composite score for executive functioning, validated in Alzheimer’s Disease Neuroimaging Initiative (ADNI) participants with baseline mild cognitive impairment. Brain Imaging and Behavior, 6(4), 517–527. https://doi.org/10.1007/s11682-012-9176-1
  • Gualtieri, C. T., & Johnson, L. G. (2006). Reliability and validity of a computerized neurocognitive test battery, CNS Vital Signs. Archives of Clinical Neuropsychology, 21(7), 623–643. https://doi.org/10.1016/j.acn.2006.05.007
  • Harris, R. J. (2001). A primer of multivariate statistics. Psychology Press.
  • Heaton, R. K. (2020). WCST-64: Computer Version 2–Research Edition (Version 2) [Computer software]. PAR.
  • Hedden, T., & Yoon, C. (2006). Individual differences in executive processing predict susceptibility to interference in verbal working memory. Neuropsychology, 20(5), 511–528. https://doi.org/10.1037/0894-4105.20.5.511
  • Hewitt, K. C., Block, C., Bellone, J. A., Dawson, E. L., Garcia, P., Gerstenecker, A., Grabyan, J. M., Howard, C., Kamath, V., LeMonda, B. C., Margolis, S. A., McBride, W. F., Salinas, C. M., Tam, D. M., Walker, K. A., & Del Bene, V. A. (2022). Diverse experiences and approaches to tele neuropsychology: Commentary and reflections over the past year of COVID-19. The Clinical Neuropsychologist, 36(4), 790–805. https://doi.org/10.1080/13854046.2022.2027022
  • Himi, S. A., Bühner, M., & Hilbert, S. (2021). Advancing the understanding of the factor structure of executive functioning. Journal of Intelligence, 9(1), 16. https://doi.org/10.3390/jintelligence9010016
  • Iverson, G. L., Brooks, B. L., Ashton, V. L., Johnson, L. G., & Gualtieri, C. T. (2009). Does familiarity with computers affect computerized neuropsychological test performance? Journal of Clinical and Experimental Neuropsychology, 31(5), 594–604. https://doi.org/10.1080/13803390802372125
  • Jersild, A. T. (1927). Mental set and shift. Archives of Psychology, 89, 5–82.
  • Johnson-Greene, D. (2004). Dementia rating scale-2 (DRS-2). Archives of Clinical Neuropsychology, 19(1), 145–147. https://doi.org/10.1016/j.acn.2003.07.003
  • Jurica, P. J., Leitten, C. L., & Mattis, S. (2001). Dementia Rating Scale–2TM Professional Manual. Psychological Assessment Resources.
  • Kane, M. J., Conway, A. R. A., Miura, T. K., & Colflesh, G. J. H. (2007). Working memory, attention control, and the n-back task: A question of construct validity. Journal of Experimental Psychology, 33(3), 615–622. https://doi.org/10.1037/0278-7393.33.3.615
  • Karr, J. E., Areshenkoff, C. N., Rast, P., Hofer, S. M., Iverson, G. L., & Garcia-Barrera, M. A. (2018). The unity and diversity of executive functions: A systematic review and re-analysis of latent variable studies. Psychological Bulletin, 144(11), 1147–1185. https://doi.org/10.1037/bul0000160
  • Klouda, L., Franklin, W. J., Saraf, A., Parekh, D. R., & Schwartz, D. D. (2017). Neurocognitive and executive functioning in adult survivors of congenital heart disease. Congenital Heart Disease, 12(1), 91–98. https://doi.org/10.1111/chd.12409
  • Kolluri, S., Stead, T. S., Mangal, R. K., Coffee, R. L., Littell, J., & Ganti, L. (2022). telehealth in response to the rural health disparity. Health Psychology Research, 10(3), 37445. https://doi.org/10.52965/001c.37445
  • Kourtis, L. C., Regele, O. B., Wright, J. M., & Jones, G. B. (2019). Digital biomarkers for Alzheimer’s disease: The mobile/wearable devices opportunity. NPJ Digital Medicine, 2(1), 1–9. https://doi.org/10.1038/s41746-019-0084-2
  • Lanting, S. C., Iverson, G. L., & Lange, R. T. (2012). Concurrent validity of CNS vital signs in patients with mild traumatic brain injury [Paper presentation]. American Congress of Rehabilitation Medicine Conference, Vancouver, BC, Canada.
  • Marra, D. E., Hamlet, K. M., Bauer, R. M., & Bowers, D. (2020). Validity of teleneuropsychology for older adults in response to COVID-19: A systematic and critical review. The Clinical Neuropsychologist, 34(7-8), 1411–1452. https://doi.org/10.1080/13854046.2020.1769192
  • Martin, M. (2018). Computer and Internet Use in the United States: 2018 (ACS-49; American Community Survey Reports). US Census Beureau.
  • Mattis, S. (2001). Dementia rating scale–2TM. Psychological Assessment Resources.
  • Messler, A. C., Kane, K. D., & Serrano, Y. (2023, published online ahead of print). Tele-neuropsychology in culturally and linguistically diverse populations within the U.S. and U.S. territories: A scoping review. The Clinical Neuropsychologist, 1–23. https://doi.org/10.1080/13854046.2023.2215954
  • Miyake, A., & Friedman, N. P. (2012). The nature and organization of individual differences in executive functions: Four general conclusions. Current Directions in Psychological Science, 21(1), 8–14. https://doi.org/10.1177/0963721411429458
  • Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D. (2000). The unity and diversity of executive functions and their contributions to complex “frontal lobe” tasks: A latent variable analysis. Cognitive Psychology, 41(1), 49–100. https://doi.org/10.1006/cogp.1999.0734
  • Monette, S., Bigras, M., & Lafrenière, M.-A. (2015). Structure of executive functions in typically developing kindergarteners. Journal of Experimental Child Psychology, 140, 120–139. https://doi.org/10.1016/j.jecp.2015.07.005
  • Montani, C., Billaud, N., Tyrrell, J., Fluchaire, I., Malterre, C., Lauvernay, N., Couturier, P., & Franco, A. (1997). Psychological impact of a remote psychometric consultation with hospitalized elderly people. Journal of Telemedicine and Telecare, 3(3), 140–145. https://doi.org/10.1258/1357633971931048
  • Moore, T. M., Reise, S. P., Gur, R. E., Hakonarson, H., & Gur, R. C. (2015). Psychometric properties of the Penn Computerized Neurocognitive Battery. Neuropsychology, 29(2), 235–246. https://doi.org/10.1037/neu0000093
  • Niermeyer, M. A., & Suchy, Y. (2020). The vulnerability of executive functioning: The additive effects of recent non-restorative sleep, pain interference, and use of expressive suppression on test performance. The Clinical Neuropsychologist, 34(4), 700–719. https://doi.org/10.1080/13854046.2019.1696892
  • Niermeyer, M. A., Ziemnik, R. E., Franchow, E. I., Barron, C. A., & Suchy, Y. (2019). Greater naturally occurring expressive suppression is associated with poorer executive functioning and motor-sequence learning among older adults. Journal of Clinical and Experimental Neuropsychology, 41(2), 118–132. https://doi.org/10.1080/13803395.2018.1502257
  • Papathanasiou, A., Messinis, L., Zampakis, P., & Papathanasopoulos, P. (2017). Corpus callosum atrophy as a marker of clinically meaningful cognitive decline in secondary progressive multiple sclerosis. Impact on employment status. Journal of Clinical Neuroscience: Official Journal of the Neurosurgical Society of Australasia, 43, 170–175. https://doi.org/10.1016/j.jocn.2017.05.032
  • Pedraza, O., Smith, G. E., Ivnik, R. J., Willis, F. B., Ferman, T. J., Petersen, R. C., Graff-Radford, N. R., & Lucas, J. A. (2007). Reliable change on the Dementia Rating Scale. Journal of the International Neuropsychological Society, 13(4), 716–720. https://doi.org/10.1017/S1355617707070920
  • Perlstein, W. M., Dixit, N. K., Carter, C. S., Noll, D. C., & Cohen, J. D. (2003). Prefrontal cortex dysfunction mediates deficits in working memory and prepotent responding in schizophrenia. Biological Psychiatry, 53(1), 25–38. https://doi.org/10.1016/S0006-3223(02)01675-X
  • Plourde, V., Hrabok, M., Sherman, E. M. S., & Brooks, B. L. (2017). Validity of a computerized cognitive battery in children and adolescents with neurological diagnoses. Archives of Clinical Neuropsychology, 33(2), 247–253. https://doi.org/10.1093/arclin/acx067
  • Possin, K., Lamarre, A., Wood, K. A., Mungas, D., & Kramer, J. (2013). Ecological validity and neuroanatomical correlates of the NIH EXAMINER executive composite score. Journal of the International Neuropsychological Society, 20(1), 20–28. https://doi.org/10.1017/S1355617713000611
  • Singh, S., Strong, R. W., Jung, L., Li, F. H., Grinspoon, L., Scheuer, L. S., Passell, E. J., Martini, P., Chaytor, N., Soble, J. R., & Germine, L. (2021). The TestMyBrain Digital Neuropsychology Toolkit: Development and psychometric characteristics. Journal of Clinical and Experimental Neuropsychology, 43(8), 786–795. https://doi.org/10.1080/13803395.2021.2002269
  • Snoswell, C. L., Arnautovska, U., Haydon, H. M., Siskind, D., Smith, A. C., Snoswell, C. L., Arnautovska, U., Haydon, H. M., Siskind, D., & Smith, A. C. (2022). Increase in telemental health services on the medicare benefits schedule after the start of the coronavirus pandemic: Data from 2019 to 2021. Australian Health Review, 46(5), 544–549. https://doi.org/10.1071/AH22078
  • Steinmetz, J.-P., Brunner, M., Loarer, E., & Houssemand, C. (2010). Incomplete psychometric equivalence of scores obtained on the manual and the computer version of the Wisconsin Card Sorting Test? Psychological Assessment, 22(1), 199–202. https://doi.org/10.1037/a0017661
  • Suchy, Y. (2015). Executive functioning: A comprehensive guide for clinical practice. Oxford University Press.
  • Suchy, Y., & Brothers, S. L. (2022). Reliability and validity of composite scores from the timed subtests of the D-KEFS battery. Psychological Assessment, 34(5), 483–495. https://doi.org/10.1037/pas0001081
  • Suchy, Y., Mullen, C. M., Brothers, S., & Niermeyer, M. A. (2020). Interpreting executive and lower-order error scores on the timed subtests of the Delis-Kaplan Executive Function System (D-KEFS) battery: Error analysis across the adult lifespan. Journal of Clinical and Experimental Neuropsychology, 42(10), 982–997. https://doi.org/10.1080/13803395.2020.1832203
  • Suchy, Y., Gereau, M. M., DesRuisseaux, L. A., & Brothers, S. L. (2023). It’s complicated: Executive functioning moderates the impact of life complexity on daily functioning in community-dwelling older adults. Journal of the International Neuropsychological Society, 29(9), 1–9.
  • Suchy, Y., Brothers, S., DesRuisseaux, L. A., Gereau, M. M., Davis, J. R., Chilton, R. L. C., & Schmitter-Edgecombe, M. (2022). Ecological validity reconsidered: The night out task versus the D-KEFS. Journal of Clinical and Experimental Neuropsychology, 44(8), 562–579. https://doi.org/10.1080/13803395.2022.2142527
  • Suchy, Y., Ziemnik, R. E., Niermeyer, M. A., & Brothers, S. L. (2020). Executive functioning interacts with complexity of daily life in predicting daily medication management among older adults. The Clinical Neuropsychologist, 34(4), 797–825. https://doi.org/10.1080/13854046.2019.1694702
  • Ünsel-Bolat, G., Ercan, E. S., Bolat, H., Süren, S., Bacanlı, A., Yazıcı, K. U., & Rohde, L. A. (2019). Comparisons between sluggish cognitive tempo and ADHD-restrictive inattentive presentation phenotypes in a clinical ADHD sample. ADHD. Attention Deficit and Hyperactivity Disorders, 11(4), 363–372. https://doi.org/10.1007/s12402-019-00301-y
  • Usai, M. C., Viterbori, P., Traverso, L., & De Franchis, V. (2014). Latent structure of executive function in five- and six-year-old children: A longitudinal study. European Journal of Developmental Psychology, 11(4), 447–462. https://doi.org/10.1080/17405629.2013.840578
  • Van Voorhis, C. R. W., & Morgan, B. L. (2007). Understanding power and rules of thumb for determining sample sizes. Tutorials in Quantitative Methods for Psychology, 3(2), 43–50. https://doi.org/10.20982/tqmp.03.2.p043
  • Vestal, L., Smith-Olinde, L., Hicks, G., Hutton, T., & Hart, J. (2006). Efficacy of language assessment in Alzheimer’s disease: Comparing in-person examination and telemedicine. Clinical Interventions in Aging, 1(4), 467–471. https://doi.org/10.2147/ciia.2006.1.4.467
  • Wadsworth, H. E., Galusha-Glasscock, J. M., Womack, K. B., Quiceno, M., Weiner, M. F., Hynan, L. S., Shore, J., & Cullum, C. M. (2016). Remote neuropsychological assessment in rural American Indians with and without cognitive impairment. Archives of Clinical Neuropsychology, 31(5), 420–425. https://doi.org/10.1093/arclin/acw030
  • Wechsler, D. (2008). Wechsler adult intelligence scale (4th ed.). Pearson Assessments.
  • Zangani, C., Ostinelli, E. G., Smith, K. A., Hong, J. S. W., Macdonald, O., Reen, G., Reid, K., Vincent, C., Sheriff, R. S., Harrison, P. J., Hawton, K., Pitman, A., Bale, R., Fazel, S., Geddes, J. R., & Cipriani, A. (2022). Impact of the COVID-19 pandemic on the global delivery of mental health services and telemental health: Systematic review. JMIR Mental Health, 9(8), e38600. https://doi.org/10.2196/38600
  • Zulman, D. M., Wong, E. P., Slightam, C., Gregory, A., Jacobs, J. C., Kimerling, R., Blonigen, D. M., Peters, J., & Heyworth, L. (2019). Making connections: Nationwide implementation of video telehealth tablets to address access barriers in veterans. JAMIA Open, 2(3), 323–329. https://doi.org/10.1093/jamiaopen/ooz024
  • Zygouris, S., & Tsolaki, M. (2015). Computerized cognitive testing for older adults: A review. American Journal of Alzheimer’s Disease & Other Dementias, 30(1), 13–28. https://doi.org/10.1177/1533317514522852

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.