Monte Carlo Simulation in Item Response Theory Applications Using SAS

ABSTRACT

Data simulation and Monte Carlo simulation studies are important skills for researchers and practitioners of educational and psychological measurement, but there are few resources on the topic specific to item response theory. Even fewer resources exist on the statistical software techniques to implement simulation studies. This article presents an introduction to the questions that simulation studies can, and cannot answer, along with the primary steps of the simulation study. We primarily focus on the parts of the simulation for which statistical software is used, presenting syntax for simulating 2PL data, and discuss how to extend the basic syntax to more complex models. We focus on SAS software in the article to build upon an existing syntax base, as most universities have SAS licenses. Two small simulations serve as didactic illustrations and to demonstrate parameter recovery of the SAS IRT procedure and an evaluation of the procedure’s item-fit options.

KEYWORDS:

• Item response theory
• simulation techniques
• statistical software