ABSTRACT
Many education tests and psychological surveys elicit respondent views of similar constructs across scenarios (e.g., story followed by multiple choice questions) by repeating common statements across scales (one-statement-multiple-scale, OSMS). However, a respondent’s earlier responses to the common statement can affect later responses to it (recursive carry-over effect), which violates the local item independence assumption of most measurement models. Ignoring this carry-over effect can bias both estimated item parameters for later scales and relations among scales. This study investigates the consequences of model misspecification for OSMS questions in mediation analyses via real data from the Teaching and Learning International Survey (TALIS) and simulations. The results showed that failing to consider carry-over effects in a mediation model yielded biased relations between latent variables. Moreover, our MMCEO mediation model corrected the inflated correlations caused by carry-over effects and yielded superior estimates of the mediation effects. We discuss implications for appropriately addressing carry‑over effects.
Acknowledgments
The authors received no financial support for the research, authorship, and/or publication of this article.
Disclosure statement
No potential conflict of interest was reported by the author(s).
Data availability statement
Two appendices, the Mplus syntax for the MMCOE mediation model, and one simulated data set are available at https://osf.io/jhrg5/?view_only=454f8be1e67949c9a90c0ddeb78f0150.
Notes
1. See https://osf.io/jhrg5/ for the example of Mplus syntax.
2. The conventional approach (assumes no COEs) uses (a) the raw responses or (b) the recoded responses of scale B by constraining its pseudo items to have the same slope and location parameters.
3. Because expected a posteriori (EAP) estimates were exported for categorical variables in Mplus, EAP reliability was computed (Adams, Citation2005).