Inflated scaled scores on the digital WISC-V coding subtest in a Canadian sample

Abstract

This study examined performance differences in the traditional paper-and-pencil and new digital versions of the Coding subtest from the Wechsler Intelligence Scale for Children-Fifth Edition (WISC-V) using a cross-sectional sample. A total of 212 school-aged children between 6 and 14 years old were included in the sample, with 116 completing the paper version and 96 completing the digital version administered on a tablet in 2017–2018. One-way ANOVA revealed a significant difference with large effect size between mean scaled scores, with the digital version resulting in higher scaled scores than the paper version, F (1, 210) = 67.57, p < 0.001, d = 1.14, η_p² = 0.24. That is, normed digital scores appear inflated as compared to paper scores. No difference in raw scores was observed when controlling for age, F (1, 209) = 0.54, p > 0.05. Post-hoc analyses were performed to account for potential confounds in demographic differences and to maximize group equivalence, with the same pattern of results. Findings have important implications for clinical interpretation of Coding scores when administering the digital version of the task. Clinicians, including psychologists and neuropsychologists, should be aware of the limitations of the new digital version of this subtest, including differences in standardized performance and task requirements. Future studies using random assignment and/or repeated-measures design are needed to replicate these findings.

Keywords:

• Computerized assessment
• processing speed
• test equivalence
• Wechsler tests
• WISC-V Coding

Disclosure statement

The authors declare that there is no conflict of interest.

Additional information

Funding

This project was supported by an unrestricted grant to Dr. J. Casey from the Scottish Rite Valley of Windsor.