32
Views
0
CrossRef citations to date
0
Altmetric
Research Article

Influences of Carry-Over Effects Across Scales on Mediation Analyses

ORCID Icon, ORCID Icon &
Published online: 04 Apr 2024
 

ABSTRACT

Many education tests and psychological surveys elicit respondent views of similar constructs across scenarios (e.g., story followed by multiple choice questions) by repeating common statements across scales (one-statement-multiple-scale, OSMS). However, a respondent’s earlier responses to the common statement can affect later responses to it (recursive carry-over effect), which violates the local item independence assumption of most measurement models. Ignoring this carry-over effect can bias both estimated item parameters for later scales and relations among scales. This study investigates the consequences of model misspecification for OSMS questions in mediation analyses via real data from the Teaching and Learning International Survey (TALIS) and simulations. The results showed that failing to consider carry-over effects in a mediation model yielded biased relations between latent variables. Moreover, our MMCEO mediation model corrected the inflated correlations caused by carry-over effects and yielded superior estimates of the mediation effects. We discuss implications for appropriately addressing carry‑over effects.

Acknowledgments

The authors received no financial support for the research, authorship, and/or publication of this article.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Data availability statement

Two appendices, the Mplus syntax for the MMCOE mediation model, and one simulated data set are available at https://osf.io/jhrg5/?view_only=454f8be1e67949c9a90c0ddeb78f0150.

Notes

1. See https://osf.io/jhrg5/ for the example of Mplus syntax.

2. The conventional approach (assumes no COEs) uses (a) the raw responses or (b) the recoded responses of scale B by constraining its pseudo items to have the same slope and location parameters.

3. Because expected a posteriori (EAP) estimates were exported for categorical variables in Mplus, EAP reliability was computed (Adams, Citation2005).

Log in via your institution

Log in to Taylor & Francis Online

PDF download + Online access

  • 48 hours access to article PDF & online version
  • Article PDF can be downloaded
  • Article PDF can be printed
USD 53.00 Add to cart

Issue Purchase

  • 30 days online access to complete issue
  • Article PDFs can be downloaded
  • Article PDFs can be printed
USD 214.00 Add to cart

* Local tax will be added as applicable

Related Research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.