Test–retest reliability and practice effects for the ANAM General Neuropsychological Screening battery

Abstract

Objective: As the use of computer-based neurocognitive assessment is rapidly expanding, the need to systematically study and document key psychometric properties of these measures has become increasingly more salient. To meet this aim, this study examined test–retest reliability and practice effects for the Automated Neuropsychological Assessment Metrics General Neuropsychological Screening battery (ANAM GNS) in a sample of 94 community dwelling adults. Method: ANAM GNS was administered and then repeated (alternate form) after 30 days. Test–retest reliability, practice effects, and the standard error of measurement were calculated. Using these estimates, reliable change indices were calculated to determine degree of performance change needed to exceed chance and measurement error (with 90% confidence interval). Results: The test–retest reliability for the ANAM composite score was .91. Performance significantly improved upon retest, but the effect size was small consistent with minimal practice effects. The threshold indicating change beyond chance or measurement error with 90% certainty was .9 (z-score). Conclusions: Findings suggest that the ANAM GNS has excellent test–retest reliability upon retest at 30 days. Small practice effects can be expected. Change greater than .9 standard deviations in the ANAM composite score is likely to represent meaningful clinical change. This paper presents initial psychometric data from the ANAM GNS and supports its use as a reliable measure of cognition.

Keywords:

• ANAM
• neuropsychology
• psychometrics
• computerized testing

Notes

1. ANAM is exclusively distributed by Vista LifeSciences, Inc.

2. The ANAM Military battery is a customized version of the ANAM Core battery. The batteries are identical except for demographic questions and inclusion of a TBI assessment in the Military version.

3. ANAM GNS was constructed such that it subsumes the ANAM Core battery in its entirety at the beginning of the battery.