1,230
Views
0
CrossRef citations to date
0
Altmetric
Research Articles

Estimating Measurement Error in Longitudinal Data Using the Longitudinal MultiTrait MultiError Approach

Pages 592-603 | Received 25 Jan 2022, Accepted 07 Nov 2022, Published online: 07 Dec 2022

References

  • Alwin, D. (2007). The margins of error: A study of reliability in survey measurement. Wiley-Blackwell.
  • Alwin, D. F. (2021). Developing reliable measures: An approach to evaluating the quality of survey measurement using longitudinal designs. In Measurement error in longitudinal data. Oxford University Press. https://doi.org/10.1093/oso/9780198859987.003.0006
  • Andrews, F. M. (1984). Construct validity and error components of survey measures: A structural modeling approach. Public Opinion Quarterly, 48, 409–442. https://doi.org/10.1086/268840
  • Angelini, V., Cavapozzi, D., & Paccagnella, O. (2011). Dynamics of reporting work disability in Europe. Journal of the Royal Statistical Society: Series A (Statistics in Society), 174, 621–638. https://doi.org/10.1111/j.1467-985X.2011.00705.x
  • Asparouhov, T., & Muthén, B. (2010). Bayesian analysis using Mplus: Technical implementation (pp. 1–38). Mplus.
  • Bäckström, M. (2007). Higher-order factors in a five-factor personality inventory and its relation to social desirability. European Journal of Psychological Assessment, 23, 63–70. https://doi.org/10.1027/1015-5759.23.2.63
  • Bassi, F., Hagenaars, J. A., Croon, M. A., & Vermunt, J. K. (2000). Estimating true changes when categorical panel data are affected by uncorrelated and correlated classification errors: An application to unemployment data. Sociological Methods & Research, 29, 230–268. https://doi.org/10.1177/0049124100029002003
  • Billiet, J., & Davidov, E. (2008). Testing the stability of an acquiescence style factor behind two interrelated substantive variables in a panel design. Sociological Methods & Research, 36, 542–562. https://doi.org/10.1177/0049124107313901
  • Billiet, J., & McClendon, M. (2000). Modeling acquiescence in measurement models for two balanced sets of items. Structural Equation Modeling: A Multidisciplinary Journal, 7, 608–628. https://doi.org/10.1207/S15328007SEM07045
  • Blom, A. G., Bosnjak, M., Cornilleau, A., Cousteaux, A.-S., Das, M., Douhou, S., & Krieger, U. (2016). A comparison of four probability-based online and mixed-mode panels in Europe. Social Science Computer Review, 34, 8–25. https://doi.org/10.1177/0894439315574825
  • Boeschoten, L., Filipponi, D., & Varriale, R. (2021). Combining multiple imputation and hidden markov modeling to obtain consistent estimates of employment status. Journal of Survey Statistics and Methodology, 9, 549–573. https://doi.org/10.1093/jssam/smz052
  • Bollen, K. (1989). Structural equations with latent variables. Wiley-Interscience Publication.
  • Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81–105. https://doi.org/10.1037/h0046016
  • Cernat, A., & Sakshaug, J. W. (Eds.). (2021). Measurement error in longitudinal data. Oxford University Press.
  • Cernat, A., Couper, M. P., & Ofstedal, M. B. (2016). Estimation of mode effects in the health and retirement study using measurement models. Journal of Survey Statistics and Methodology, 4, 501–524. https://doi.org/10.1093/jssam/smw021
  • Cernat, A., Lugtig, P., Uhrig, S. N., & Watson, N. (2021). Assessing and relaxing assumptions in quasi-simplex models. In A. Cernat & J. W. Sakshaug (Eds.), Measurement error in longitudinal data (pp. 155–171). Oxford University Press.
  • Cernat, A., & Oberski, D. L. (2019). Extending the within‐persons experimental design: The multitrait‐multierror MTME approach. In P. Lavrakas, M. Traugott, C. Kennedy, A. Holbrook, E. de Leeuw, & B. West (Eds.), Experimental methods in survey research (1st ed., pp. 481–500). Wiley. https://doi.org/10.1002/9781119083771.ch24
  • Cernat, A., & Oberski, D. L. (2021). Estimating stochastic survey response errors using the multitrait-multierror model. Journal of the Royal Statistical Society Series A, 185, 134–155.
  • Cole, D., & Maxwell, S. (2003). Testing mediational models with longitudinal data: Questions and tips in the use of structural equation modeling. Journal of Abnormal Psychology, 112, 558–577. https://doi.org/10.1037/0021-843X.112.4.558
  • DeMaio, T. (1984). Social desirability and survey measurement: A review. In C. Turner & E. Martin (Eds.), Surveying subjective phenomena (pp. 257–282). Russell Sage Foundation.
  • Fisher, R. J., & Katz, J. E. (2000). Social-desirability bias and the validity of self-reported values. Psychology and Marketing, 17, 105–120. https://doi.org/10.1002/(SICI)1520-6793(200002)17:2<105::AID-MAR3>3.0.CO;2-9
  • Fuller, W. A. (1987). Measurement error models. Wiley-Interscience.
  • Gelman, A., & Rubin, D. B. (1992). Inference from iterative simulation using multiple sequences. Statistical Science, 457–472.
  • Geiser, C., Eid, M., Nussbeck, F. W., Courvoisier, D. S., & Cole, D. A. (2010). Multitrait-multimethod change modelling. AStA Advances in Statistical Analysis, 94, 185–201. https://doi.org/10.1007/s10182-010-0127-0
  • Graziano, W. G., & Tobin, R. M. (2002). Agreeableness: Dimension of personality or social desirability artifact? Journal of Personality, 70, 695–727. https://doi.org/10.1111/1467-6494.05021
  • Grimm, K. J., Pianta, R. C., & Konold, T. (2009). Longitudinal multitrait-multimethod models for developmental research. Multivariate Behavioral Research, 44, 233–258. https://doi.org/10.1080/00273170902794230
  • Groves, R. M. (Ed.). (2009). Survey methodology (2nd ed.). Wiley.
  • Haberecht, K., Schnuerer, I., Gaertner, B., John, U., & Freyer-Adam, J. (2015). The stability of social desirability: A latent change analysis. Journal of Personality, 83, 404–412. https://doi.org/10.1111/jopy.12112
  • Hagenaars, J. A. (2018). Confounding true and random changes in categorical panel data. In M. Giesselmann, K. Golsch, H. Lohmann, & A. Schmidt-Catran (Eds.), Lebensbedingungen in Deutschland in der Längsschnittperspektive (pp. 245–266). Springer. https://doi.org/10.1007/978-3-658-19206-8_14
  • Hamaker, E. L., Kuiper, R. M., & Grasman, R. P. P. P. (2015). A critique of the cross-lagged panel model. Psychological Methods, 20(1), 102–116. https://doi.org/10.1037/a0038889
  • Heise, D. R. (1969). Separating reliability and stability in test-retest correlation. American Sociological Review, 34, 93–101. https://doi.org/10.2307/2092790
  • Helm, J. L., Castro-Schilo, L., & Oravecz, Z. (2017). Bayesian versus maximum likelihood estimation of multitrait–multimethod confirmatory factor models. Structural Equation Modeling: A Multidisciplinary Journal, 24, 17–30. https://doi.org/10.1080/10705511.2016.1236261
  • Holtmann, J., Koch, T., Bohn, J., & Eid, M. (2020). Multimethod assessement of time-stable and time-variable interindividual differences. European Journal of Psychological Assessment, 36, 1024–1043. https://doi.org/10.1027/1015-5759/a000577
  • Institute for Social and Economic Research (2021). Understanding society – the UK household longitudinal study, innovation panel, waves 1-13, user manual (pp.1–214). University of Essex. https://doc.ukdataservice.ac.uk/doc/6849/mrdoc/pdf/6849_ip_waves_1-13_user_manual_oct_2021.pdf
  • King, G., Murray, C. J. L., Salomon, J. A., & Tandon, A. (2003). Enhancing the validity and cross-cultural comparability of measurement in survey research. American Political Science Review, 97, 567–583. https://doi.org/10.1017/S0003055403000881
  • Koch, T., Holtmann, J., Eid, M., & West, S. G. (2020). Analyzing longitudinal multirater data with changing and stable raters. Structural Equation Modeling: A Multidisciplinary Journal, 27, 73–87. https://doi.org/10.1080/10705511.2019.1638784
  • Kreuter, F., Presser, S., & Tourangeau, R. (2008). Social desirability bias in CATI, IVR, and web surveys the effects of mode and question sensitivity. Public Opinion Quarterly, 72, 847–865. https://doi.org/10.1093/poq/nfn063
  • Krosnick, J. A. (1991). Response strategies for coping with the cognitive demands of attitude measures in surveys. Applied Cognitive Psychology, 5, 213–236. https://doi.org/10.1002/acp.2350050305
  • Krumpal, I. (2013). Determinants of social desirability bias in sensitive surveys: A literature review. Quality & Quantity, 47, 2025–2047. https://doi.org/10.1007/s11135-011-9640-9
  • Leitgöb, H., Seddig, D., Schmidt, P., Sosu, E., & Davidov, E. (2021). Longitudinal measurement (non)invariance in latent constructs: Conceptual insights, model specifications, and testing strategies. In A. Cernat & J. Sakshaug (Eds.), Measurement error in longitudinal data. Oxford University Press. https://doi.org/10.1093/oso/9780198859987.003.0010
  • Little, T. D. (2013). Longitudinal structural equation modeling. Guilford Press.
  • Lönnqvist, J.-E., Paunonen, S., Tuulio-Henriksson, A., Lönnqvist, J., & Verkasalo, M. (2007). Substance and style in socially desirable responding. Journal of Personality, 75, 291–322. https://doi.org/10.1111/j.1467-6494.2006.00440.x
  • Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Addison-Wesley Publishing Company, Inc.
  • Lynn, P., & Lugtig, P. J. (2017). Total survey error for longitudinal surveys. In P. P. Biemer, E. de Leeuw, S. Eckman, B. Edwards, F. Kreuter, L. E. Lyberg, N. C. Tucker, & B. T. West (Eds.), Total survey error in practice (pp. 279–298). John Wiley & Sons, Inc. https://doi.org/10.1002/9781119041702.ch13
  • McClendon, M. (1991). Acquiescence and recency response-order effects in interview surveys. Sociological Methods & Research, 20, 60–103. https://doi.org/10.1177/0049124191020001003
  • Moors, G., Kieruj, N. D., & Vermunt, J. K. (2014). The effect of labeling and numbering of response scales on the likelihood of response bias. Sociological Methodology, 44, 369–399. https://doi.org/10.1177/0081175013516114
  • Muthén, L. K., & Muthen, B. (2017). Mplus user’s guide: Statistical analysis with latent variables, user’s guide. Muthén & Muthén.
  • Oberski, D. L., Hagenaars, J. A. P., & Saris, W. E. (2015). The latent class multitrait-multimethod model. Psychological Methods, 20, 422–443. https://doi.org/10.1037/a0039783
  • Oberski, D. L., Kirchner, A., Eckman, S., & Kreuter, F. (2017a). Evaluating the quality of survey and administrative data with generalized multitrait-multimethod models. Journal of the American Statistical Association, 112, 1477–1489. https://doi.org/10.1080/01621459.2017.1302338
  • Paccagnella, O. (2021). Self-evaluation, differential item functioning, and longitudinal anchoring vignettes. In Measurement error in longitudinal data. Oxford University Press. https://doi.org/10.1093/oso/9780198859987.003.0012
  • Pankowska, P., Bakker, B., Oberski, D. L., & Pavlopoulos, D. (2018). Reconciliation of inconsistent data sources by correction for measurement error: The feasibility of parameter re-use. Statistical Journal of the IAOS, 34, 317–329. https://doi.org/10.3233/SJI-170368
  • Pavlopoulos, D., Pankowska, P., Bakker, B., & Oberski, D. (2021). Modelling error dependence in categorical longitudinal data. In Measurement error in longitudinal data. Oxford University Press. https://doi.org/10.1093/oso/9780198859987.003.0008
  • Program on Global Aging, Health & Policy (2021). Gateway to global aging data. https://g2aging.org/?section=documentation
  • Saris, W., & Gallhofer, I. (2007). Design, evaluation, and analysis of questionnaires for survey research (1st ed.). Wiley-Interscience.
  • Saris, W., Oberski, D. L., Revilla, M., Zavala-Rojas, D., Lilleoja, L., Gallhofer, I., Gruner, T. (2011). The development of the program SQP 2.0 for the prediction of the quality of survey questions (RECSM Working Paper No. 24; RECSM Working Paper). RECSM. https://www.semanticscholar.org/paper/The-development-of-the-program-SQP-2.0-for-the-of-Saris-Oberski/4bcdce3e737830efc6e20632c4536e1240a7ee07
  • Saris, W. E., & Revilla, M. (2016). Correction for measurement errors in survey research: Necessary and possible. Social Indicators Research, 127, 1005–1020. https://doi.org/10.1007/s11205-015-1002-x
  • Saris, W. E., Révilla, M., Krosnick, J. A., & Shaeffer, E. M. (2010). Comparing questions with agree/disagree response options to questions with item-specific response options. Survey Research Methods, 4, 61–79.
  • Saris, W., Satorra, A., & Coenders, G. (2004). A new approach to evaluating the quality of measurement instruments: The split-ballot MTMM design. Sociological Methodology, 34, 311–347. https://doi.org/10.1111/j.0081-1750.2004.00155.x
  • Saris, W., & Van Meurs, A. (1991). Evaluation of measurement instruments by meta-analysis of multitrait multimethod studies. North-Holand.
  • Scherpenzeel, A., & Saris, W. (2007). Multitrait-multimethod models for longitudinal research. In K. van, J. Oud, & A. Satorra (Eds.), Longitudinal models in the behavioral and related sciences (pp. 381–401). Lawrence Erlbaum Associates Publishers.
  • Schmitt, M. J., & Steyer, R. (1993). A latent state-trait model (not only) for social desirability. Personality and Individual Differences, 14, 519–529. https://doi.org/10.1016/0191-8869(93)90144-R
  • Spector, P. E., Rosen, C. C., Richardson, H. A., Williams, L. J., & Johnson, R. E. (2019). A new perspective on method variance: A measure-centric approach. Journal of Management, 014920631668729, 45, 855–880. https://doi.org/10.1177/0149206316687295
  • Tourangeau, R., Rips, L. J., & Rasinski, K. (2000). The psychology of survey response (1st ed.). Cambridge University Press.
  • Turek, K., Kalmijn, M., & Leopold, T. (2021). The comparative panel file: Harmonized household panel surveys from seven countries. European Sociological Review, 37, 505–523. https://doi.org/10.1093/esr/jcab006
  • Van De Pol, F., & De Leeuw, J. (1986). A latent Markov model to correct for measurement error. Sociological Methods & Research, 15, 118–141. https://doi.org/10.1177/0049124186015001009
  • van de Pol, F., & Langeheine, R. (1990). Mixed markov latent class models. In C. C. Clogg (Ed.), Sociological methodology (Vol. 20, pp. 213–247). Blackwell. https://doi.org/10.2307/271087
  • Wiley, J., & Wiley, M. (1974). A note on correlated errors in repeated measurements. Sociological Methods & Research, 3, 172–188. https://doi.org/10.1177/004912417400300202