On the Shortcomings of Shortened Tests: A Literature Review

Abstract

To efficiently assess multiple psychological constructs and to minimize the burden on respondents, psychologists increasingly use shortened versions of existing tests. However, compared to the longer test, a shorter test version may have a substantial impact on the reliability and the validity of the test scores in psychological research and individual decision making. In this study, we reviewed the psychological literature for recent trends in the use of short tests and examined in depth how and to what extent test constructors and test users addressed the impact on reliability and validity, other potential consequences of using short tests. The sample consisted of shortened tests found in six peer-reviewed psychological journals in the period 2005–2010. Based on our review, we provided recommendations for psychologists considering test shortening.

Keywords:

• literature review
• psychological tests
• reliability of short tests
• test shortening
• validity of short tests

Acknowledgments

This research was supported by a grant from the Netherlands Organization of Scientific Research (NWO 400-05-179) (first author).

The authors would like to thank Stéfanie André for her research support.This article was accepted under the previous co-editor team, Rob R. Meijer and Stephen G. Sireci.