80
Views
1
CrossRef citations to date
0
Altmetric
Original Research

Visual-spatial perception: a comparison between instruments frequently used in the primary care setting and a computerized cognitive assessment battery

, , &
Pages 1881-1887 | Published online: 25 Nov 2015

Abstract

Background

The development of screening instruments will help the primary care team to determine when further comprehensive cognitive assessment is necessary.

Design

A retrospective analysis based on medical records.

Patients and setting

Patients referred to a comprehensive geriatric assessment unit.

Analysis

Cognitive screening and assessment included visual-spatial components: the Mini Mental State Examination, the Clock Drawing Test, the Montreal Cognitive Assessment Test, and the Neurotrax (Mindstreams) computerized cognitive assessment battery.

Results

The average age of the 190 eligible patients was 81.09±5.42 years. Comparing the individual tests with that of the visual-spatial index of Neurotrax, we found the Trail Making B test to be most sensitive (72.4%) and the Cube Test to have the highest specificity (72.8%). A combination of tests resulted in higher sensitivity and lower specificity.

Conclusion

The use of a combination of visual-spatial tests for screening in neurocognitive disorders should be evaluated in further prospective studies.

Introduction

Cognitive decline associated with advancing age is one of the most important challenges currently facing health care providers, both in the spheres of diagnosis and management and in the delivery of supportive services to the patient and caregivers.Citation1Citation3 The spectrum of neurocognitive decline from subjective cognitive complaints to mild cognitive impairment (MCI) and ultimately to a progressive dementia syndrome places the primary care physician at the forefront in providing care for a growing number of cognitively impaired older patients, the majority of whom reside in the community. While systematic population screening for cognitive impairment has not been shown to be effective,Citation4,Citation5 the assessment of patients who are referred to the clinic for cognitive symptoms and decreased cognitive function is recommended.Citation6Citation8

MCI is a clinical syndrome that has been clearly defined, both in the clinical situation and in research settings.Citation7,Citation9,Citation10 MCI is prevalent in the older population, with some 15% of those older than 65 years having this condition, with a range of 3%–42% reported in community-based studies.Citation11Citation13 The presence of predominant memory complaints and impairment alongside the preservation of function in instrumental daily activities suggests amnestic MCI, and this is generally considered to represent an early stage of Alzheimer’s disease.Citation9,Citation10,Citation14 Approximately 10% of patients with MCI will progress to dementia annually.Citation15,Citation16

In a longitudinal archival study,Citation17 it was shown that changes in visual-spatial perception sometimes appear in the preclinical phase of dementia as early as 3 years before the diagnosis of dementia, while memory decline occurs some 2 years before diagnosis.

The purpose of this study was to examine whether the use of visual-spatial perception testing (as a component of existing screening tools for the early detection of cognitive impairment) is of value for the determination of cognitive impairment, as compared to the visual-spatial component of a more comprehensive computerized neurocognitive battery used for cognitive assessment.

Methods

We performed a retrospective analysis based on medical records from the years 2005 to 2010 of patients seen at the comprehensive geriatric assessment (CGA) unit of the Clalit Health Services in Beer Sheva, Israel. The multidisciplinary staff of the CGA unit include specialist geriatricians, geriatric nurses, a dietician, an occupational therapist, a physical therapist, and a social worker.

The study population included patients older than 65 years referred by the primary care physician for geriatric assessment. The assessment battery included the following components: 1) Demographics, including age, gender, and education level. 2) History and examination, with emphasis on medical history and physical examination, drug therapy, laboratory and other investigations (available via the computerized medical record system), psychosocial assessment, and nutritional status. 3) Depression screening by Patient Health Questionnaire.Citation18 4) Basic Activity of Daily Living.Citation19,Citation20 5) Instrumental Activity of Daily Living (the Older Americans Resources and Service Instrumental Activity of Daily Living).Citation21 6) Comorbidity status (Charlson comorbidity indexCitation22 and cumulative illness rating scale – geriatric version).Citation23 7) Cognitive screening was performed using the following instruments: a) Mini Mental State Examination, rated on a scale of 0–30;Citation24 b) Clock Drawing Test (CDT) rated on a scale of 0–2;Citation25,Citation26 c) Montreal Cognitive Assessment (MoCA) test rated on a scale of 0–30;Citation27 d) Neurotrax (Mindstreams) computerized cognitive assessment battery, validated for use in the elderly.Citation28Citation30

The visual-spatial components of each of the aforementioned instruments were compared. A dichotomy score of either normal or abnormal was allocated for each of the tests as follows:

1) Mini Mental State Examination: The intersecting pentagons were rated as normal (score 1) or abnormal (score 0). 2) CDT as normal (score 2) or abnormal (1 or 0). Scores were allocated as follows: 0 – neither numbers nor hands are present, or they have been placed incorrectly; 1 – the hands are present and they have been placed correctly, and numbers are either missing or incorrectly placed; 2 – both hands and numbers are present and have been placed correctly. 3) Cube Drawing Test component of the MoCA test as normal (score 1) or abnormal (score 0). 4) Trail Making B test component of MoCA test as normal, where all points (letters and numbers) are connected in the correct order (score 1), or at least one point is missed or not in the correct sequence (score 0). 5) Visual-spatial index of the Neurotrax (Mindstreams) computerized cognitive assessment battery (a score of ≤85, representing one standard deviation [SD] below normal was scored as 0, and >85 as 1).

A diagnosis of dementia was made according to DSM-IV criteriaCitation31 and of MCI according to consensus criteria for MCI.Citation7,Citation9,Citation10

The study was approved by the Ethics Committee of Clalit Health Services at the Meir Medical Center.

Statistical analysis

We calculated sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) for each of the measures for determining cognitive impairment.

  • Sensitivity = true positive/gold standard positive

  • Specificity = true negative/gold standard negative

  • PPV = true positive/test outcome positive

  • NPV = true negative/test outcome negative

Using the visual-spatial index of the Neurotrax (Mind-streams) assessment battery as the reference,Citation28Citation30 the other tests were compared both individually and in varied combinations, in order to determine sensitivity and specificity, PPV, and NPV. Chi-square analysis was performed with P<0.05 considered to be statistically significant.

Results

Study population

A total of 190 patients assessed at the CGA unit over the years 2005–2010 with data available for all the study instruments were eligible for inclusion in the study ().

Table 1 Characteristics of study participations (N=190)

The average age and SD was 81.09±5.42 years (range: 67–94), and 111 (58.4%) were females. The mean education level was 13.83 years (SD ±10.02). Based on clinical and cognitive assessment, 62 (32.6%) of the patients were determined to be cognitively normal, 90 (47.4%) were diagnosed as having MCI, and 38 (20%) were diagnosed as having dementia. Of those with dementia, 27 (71%) patients were diagnosed with Alzheimer’s disease, nine (23.8%) with vascular dementia, one (2.6%) with diffuse Lewy body dementia, and one (2.6%) with other dementia.

Cognitive evaluations

The results of the cognitive assessments are presented in .

Table 2 Selected outcomes cognitive assessment of study population

With regard to the Neurotrax computerized cognitive assessment, a total of 107 (56.3%) subjects scored below one SD from the normal (<85%) on the global score index. For the visual-spatial index, 98 subjects (51.6%) scored below one SD.

With regard to abnormal results for the other cognitive tests, the Cube Test was abnormal in 64 subjects (33.7%), the Trail Making B test in 110 (57.9%), the Intersecting Pentagon Copying (IPC) test in 117 (61.6%) subjects, and the CDT was abnormal in 92 (48.4%).

Comparing the individual cognitive tests with that of the visual-spatial index of Neurotrax, we found the Trail Making B test to be most sensitive (72.4%) and the Cube Test to have the highest specificity (72.8%) ().

Table 3 Comparison between single tools and visual score of Neurotrax test for evaluation of visual-spatial ability

The effect of combining two different tests, Trail Making B and IPC, was a higher sensitivity of 87.8%. The highest specificity of combined tests was for Trail Making B test and the Cube Test (54.3%) ().

Table 4 Comparison between two integrated single tools and visual score of Neurotrax test for evaluation of visual-spatial ability

When looking at the combined effect of three tests compared to the visual-spatial index, the highest sensitivity was 88.8% for a combination of Trail Making B test, Cube Test, and IPC. This combination also had the highest specificity of 33.7% compared to other multiple combinations of tests. When looking at the combination of all four tests, the sensitivity was 93.9%, and specificity was 27.2% ().

Table 5 Comparison between three and four integrated tools and visual score of Neurotrax test for evaluation of visual-spatial ability

Discussion

Our results show that tests of visual-spatial function are useful for screening patients for impaired cognitive function. While most screening instruments currently in use include an evaluation of visual-spatial function as one component of the test,Citation24Citation29 no screening tool is based solely on this aspect of cognitive function. The high sensitivity found for the combination of all four tests that were administered was associated with a low specificity. Our results suggest that when at least one of the tests is abnormal, further cognitive assessment is indicated.

The high sensitivity of the combined tests may eliminate the need for further cognitive screening. The time required to administer these four tests varies from 3 to 5 minutes, which is certainly acceptable for screening. These tests are all simple paper-based tests that can be easily administered in the clinic or home setting by nonprofessional staff who have received the necessary training ().

To the best of our knowledge, this is the first such study to evaluate the combined value of screening tests for visual-spatial function in cognitive assessment. The use in this study of the Neurotrax visual-spatial index based on the Block Design of the Wechsler Adult Intelligence Scale-3Citation32 as the reference test, as well as the use of a cognitive diagnosis based on a CGA by a multidisciplinary team, strengthens the value of our findings.

Our study has a number of limitations. We performed a retrospective analysis based on the charts of patients referred to a single CGA unit in the southern district of Israel. Our patients spoke either Hebrew or Russian as their primary language and were all of Jewish ethnicity. Thus, the generalizability of our results is limited. The choice of a computerized cognitive assessment battery as the gold standard rather than formal neuropsychological assessment is a possible limitation. However, the Neurotrax battery has been well validated in numerous studies.Citation28Citation30 We realize that many of the tests that we used are not limited to visual-spatial function but that they assess other aspects of cognitive function as well, particularly executive function. The overlap with other cognitive functions may clearly have a confounding effect on our results.

We also acknowledge that most conditions causing the dementia syndrome present primarily with memory, language, and executive function deficits, at least initially, and that impaired visual-spatial function in itself does not constitute one of the usual diagnostic criteria ().

Table 6 Sensitivity and specificity of individual tests compared with clinical diagnosis

Conclusion

The combination of four short, paper-based tests, namely the Trail Making B test, the Cube Test, the IPC test, and the CDT, was found to be highly sensitive (93.9%) for identifying subjects with cognitive impairment, when compared to the Neurotrax (Mindstreams) computerized cognitive assessment battery. The use of a combination of visual-spatial tests for screening in neurocognitive disorders should be evaluated in further prospective studies.

Disclosure

The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

References

  • HebertLEScherrPABieniasJLBennettDAEvansDAAlzheimer disease in the US population: prevalence estimates using the 2000 censusArch Neurol20036081119112212925369
  • 2012 Facts and Figures Alzheimer’s Disease Facts and Figures2012 Available from: https://www.alz.org/downloads/facts_figures_2012.pdf
  • MitchellAJShiri-FeshkiMRate of progression of mild cognitive impairment to dementia – meta-analysis of 41 robust inception cohort studiesActa Psychiatr Scand2009119425226519236314
  • Canadian Agency for Drugs and Technologies in HealthScreening Tools to Identify Adults with Mild Cognitive Impairment Not Associated with Dementia: A Review of Diagnostic Accuracy, Effectiveness and Guidelines2013 Available from: https://www.cadth.ca/media/pdf/htis/sep-2013/RC0475_Mild%20Cognitive%20Impairment%20Final.pdfAccessed November 13, 2015
  • LinJSO’ConnorERossomRCU.S. preventive services task force evidence syntheses, formerly systematic evidence reviewsScreening for Cognitive Impairment in Older Adults: An Evidence Update for the U.S. Preventive Services Task ForceRockville, MDAgency for Healthcare Research and Quality (US)2013
  • State of Israel, Ministry of Health [webpage on the Internet]The Israel National Program for Prophylaxis and Treatment of Alzheimer’s Disease and Other Dementias2013 Available from: State of Israel, Ministry of Health, 2013. http://www.health.gov.il/English/Topics/SeniorHealth/DEMENTIA/Pages/National_program.aspxAccessed November 13, 2015
  • AlbertMSDeKoskySTDicksonDThe diagnosis of mild cognitive impairment due to Alzheimer’s disease: recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer’s diseaseAlzheimers Dement20117327027921514249
  • CordellCBBorsonSBoustaniMMedicare Detection of Cognitive Impairment WorkgroupAlzheimer’s Association recommendations for operationalizing the detection of cognitive impairment during the medicare annual wellness visit in a primary care settingAlzheimers Dement20139214115023265826
  • PetersenRCSmithGEWaringSCIvnikRJTangalosEGKokmenEMild cognitive impairment: clinical characterization and outcomeArch Neurol199956330330810190820
  • WinbladBPalmerKKivipeltoMMild cognitive impairment – beyond controversies, towards a consensus: report of the international working group on mild cognitive impairmentJ Intern Med2004256324024615324367
  • ArteroSPetersenRTouchonJRitchieKRevised criteria for mild cognitive impairment: validation within a longitudinal population studyDement Geriatr Cogn Disord2006225–646547017047325
  • BusseABischkopfJRiedel-HellerSGAngermeyerMCMild cognitive impairment: prevalence and incidence according to different diagnostic criteria. Results of the Leipzig Longitudinal Study of the Aged (LEILA75+)Br J Psychiatry200318244945412724250
  • WardAArrighiHMMichelsSCedarbaumJMMild cognitive impairment: disparity of incidence and prevalence estimatesAlzheimers Dement201281142122265588
  • RavagliaGFortiPMaioliFConversion of mild cognitive impairment to dementia: predictive role of mild cognitive impairment subtypes and vascular risk factorsDement Geriatr Cogn Disord2006211515816276110
  • BennettDAWilsonRSSchneiderJANatural history of mild cognitive impairment in older personsNeurology200259219820512136057
  • BruscoliMLovestoneSIs MCI really just early dementia? A systematic review of conversion studiesInt Psychogeriatr200416212914015318760
  • JohnsonDKStorandtMMorrisJCGalvinJELongitudinal study of the transition from healthy aging to Alzheimer diseaseArch Neurol200966101254125919822781
  • KroenkeKSpitzerRLWilliamsJBThe PHQ-9: validity of a brief depression severity measureJ Gen Intern Med200116960661311556941
  • MahoneyFIBarthelDWFunctional evaluation: the barthel indexMd State Med J196514616514258950
  • WadeDTCollinCThe Barthel ADL index: a standard measure of physical disability?Int Disabil Stud198810264673042746
  • DobleSEFisherAGThe dimensionality and validity of the Older Americans Resources and Services (OARS) Activities of Daily Living (ADL) scaleJ Outcome Meas1998214249661728
  • CharlsonMEPompeiPAlesKLMacKenzieCRA new method of classifying prognostic comorbidity in longitudinal studies: development and validationJ Chronic Dis19874053733833558716
  • LinnBSLinnMWGurelLCumulative illness rating scaleJ Am Geriatr Soc19681656226265646906
  • FolsteinMFFolsteinSEMcHughPR“Mini-mental state”. A practical method for grading the cognitive state of patients for the clinicianJ Psychiatr Res19751231891981202204
  • KokmenENaessensJMOffordKPA short test of mental status: description and preliminary resultsMayo Clin Proc19876242812883561043
  • KornerEALauritzenLNilssonFMLolkAChristensenPSimple scoring of the clock-drawing test for dementia screeningDan Med J2012591A436522239841
  • NasreddineZSPhillipsNABédirianVThe Montreal Cognitive Assessment, MoCA: a brief screening tool for mild cognitive impairmentJ Am Geriatr Soc200553469569915817019
  • DonigerGMZuckerDMSchweigerATowards practical cognitive assessment for detection of early dementia: a 30-minute computerized battery discriminates as well as longer testingCurr Alzheimer Res20052211712415974907
  • DwolatzkyTWhiteheadVDonigerGMValidity of a novel computerized cognitive battery for mild cognitive impairmentBMC Geriatr20033414594456
  • DwolatzkyTDimantLSimonESDonigerGMValidity of a short computerized assessment battery for moderate cognitive impairment and dementiaInt Psychogeriatr201022579580320519066
  • American Psychiatric AssociationDiagnostic and Statistical Manual of Mental Disorders1994 Available from: http://www.psychiatry.org/psychiatrists/practice/dsmAccessed November 13, 2015
  • SilvaMADevelopment of the WAIS-III: a brief overview, history, and descriptionGrad J Couns Psychol200811119