Controlling construct-irrelevant factors through computer-based testing: disengagement, anxiety, & cheating

ABSTRACT

A decision of whether to move from paper-and-pencil to computer-based tests is based largely on a careful weighing of the potential benefits of a change against its costs, disadvantages, and challenges. This paper briefly discusses the trade-offs involved in making such a transition, and then focuses on a relatively unexplored benefit of computer-based tests – the control of construct-irrelevant factors that can threaten test score validity. Several unique advantages provided by computer-based tests are described, and how these advantages can be used to manage the effects of several common construct-irrelevant factors is discussed. Ultimately, the potential for expanded control may prove to be one of the most important benefits of computer-based tests.

KEYWORDS:

• Computer-based testing
• construct-irrelevant factors
• test-taking engagement
• test anxiety

Additional information

Notes on contributors

Steven L. Wise

Steven L. Wise is a Senior Research Fellow at NWEA.  Dr. Wise has published extensively during the past three decades in applied measurement, with particular emphases in computer-based testing and the psychology of test taking.  In recent years, Dr. Wise’s research has focused primarily on methods for effectively dealing with the measurement problems posed by examinee disengagement on achievement tests.