A Realistic Evaluation of Methods for Handling Missing Data When There is a Mixture of MCAR, MAR, and MNAR Mechanisms in the Same Dataset

References

• Berndt, E. R., Hall, B. H., Hall, R. E., & Hausman, J. A. (1974). Estimation and inference in nonlinear structural models. Annals of Economic and Social Measurement, 3(4), 653–665.
   Google Scholar
• Bradley, J. V. (1978). Robustness? British Journal of Mathematical and Statistical Psychology, 31(2), 144–152. https://doi.org/10.1111/j.2044-8317.1978.tb00581.x
   Web of Science ®Google Scholar
• Breiman, L. (2003). Manual for setting up, using, and understanding random forest V4.0. https://www.stat.berkeley.edu/∼breiman/Using_random_forests_v4.0.pdf
   Google Scholar
• Breiman, L. (2001). Random forests. Machine Learning, 45(1), 5–32. https://doi.org/10.1023/A:1010933404324
   Web of Science ®Google Scholar
• Buuren, S. v., & Groothuis-Oudshoorn, K. (2011). mice: Multivariate imputation by chained equations in R. Journal of Statistical Software, 45(3), 1–67. https://www.jstatsoft.org/v45/i03/) https://doi.org/10.18637/jss.v045.i03
   Web of Science ®Google Scholar
• Cohen, S., Kamarck, T., & Mermelstein, R. (1983). A global measure of perceived stress. Journal of Health and Social Behavior, 385–396. https://doi.org/10.2307/2136404.
   PubMed Web of Science ®Google Scholar
• Collins, L. M., Schafer, J. L., & Kam, C.-M. (2001). A comparison of inclusive and restrictive strategies in modern missing data procedures. Psychological Methods, 6(4), 330–351. https://doi.org/10.1037//1082-989X.6.4.330
   PubMed Web of Science ®Google Scholar
• Diggle, P., & Kenward, M. G. (1994). Informative drop-out in longitudinal data analysis. Applied Statistics, 43(1), 49–93. https://doi.org/10.2307/2986113
   Web of Science ®Google Scholar
• Enders, C. K. (2001). A primer on maximum likelihood algorithms available for use with missing data. Structural Equation Modeling: A Multidisciplinary Journal, 8(1), 128–141. https://doi.org/10.1207/S15328007SEM0801_7
   Web of Science ®Google Scholar
• Enders, C. K. (2010). Applied missing data analysis. Guilford.
   Google Scholar
• Enders, C. K. (2011). Missing not at random models for latent growth curve analyses. Psychological Methods, 16(1), 1–16. https://doi.org/10.1037/a0022640
   PubMed Web of Science ®Google Scholar
• Glynn, R. J., Laird, N. M., & Rubin, D. B. (1986). Selection modeling versus mixture modeling with nonignorable nonresponse. In H. Wainer (Ed.), Drawing inferences from self-selected samples (pp. 115–142). Springer. https://doi.org/10.1007/978-1-4612-4976-4_10
   Google Scholar
• Glynn, R. J., Laird, N. M., & Rubin, D. B. (1993). Multiple imputation in mixture models for nonignorable response with follow-ups. Journal of the American Statistical Association, 88(423), 984–993. https://doi.org/10.1080/01621459.1993.10476366
   Web of Science ®Google Scholar
• Gomer, B., & Yuan, K. H. (2021). Subtypes of the missing not at random missing data mechanism. Psychological Methods, 26(5), 559–598. https://doi.org/10.1037/met0000377
   PubMed Web of Science ®Google Scholar
• Gordon, A. M., & Chen, S. (2016). Do you get where I’m coming from?: Perceived understanding buffers against the negative impact of conflict on relationship satisfaction. Journal of Personality and Social Psychology, 110(2), 239–260. https://doi.org/10.1037/pspi0000039
   PubMed Web of Science ®Google Scholar
• Graham, J. W., Taylor, B. J., Olchowski, A. E., & Cumsille, P. E. (2006). Planned missing data designs in psychological research. Psychological Methods, 11(4), 323–343. https://doi.org/10.1037/1082-989X.11.4.323
   PubMed Web of Science ®Google Scholar
• Harel, O. (2009). The estimation of R2 and adjusted R2 in incomplete data sets using multiple imputation. Journal of Applied Statistics, 36(10), 1109–1118. https://doi.org/10.1080/02664760802553000
   Web of Science ®Google Scholar
• Hayes, T., Usami, S., Jacobucci, R., & McArdle, J. J. (2015). Using classification and regression trees (CART) and random forests to analyze attrition: Results from two simulations. Psychology and Aging, 30(4), 911–929. https://doi.org/10.1037/pag0000046
   PubMed Web of Science ®Google Scholar
• Heckman, J. J. (1976). The common structure of statistical models of truncation, sample selection and limited dependent variables and a simple estimator for such models. In Annals of economic and social measurement, volume 5, number 4 (pp. 475–492). NBER.
   Google Scholar
• Hedeker, D., & Gibbons, R. D. (1997). Application of random-effects pattern-mixture models for missing data in longitudinal studies. Psychological Methods, 2(1), 64–78. https://doi.org/10.1037/1082-989X.2.1.64
   Web of Science ®Google Scholar
• Hedeker, D., & Gibbons, R. D. (2006). Longitudinal data analysis (Vol. 451). John Wiley & Sons. https://doi.org/10.1002/0470036486
   Google Scholar
• Jamshidian, M., Jalal, S. J., & Jansen, C. (2014). MissMech: An R package for testing homoscedasticity, multivariate normality, and missing completely at random (MCAR). Journal of Statistical Software, 56(6), 1–31. https://doi.org/10.18637/jss.v056.i06
   Web of Science ®Google Scholar
• Lang, F. R., John, D., Lüdtke, O., Schupp, J., & Wagner, G. G. (2011). Short assessment of the Big Five: Robust across survey methods except telephone interviewing. Behavior Research Methods, 43(2), 548–567. https://doi.org/10.3758/s13428-011-0066-z
   Google Scholar
• Li, K.-H., Meng, X.-L., Raghunathan, T. E., & Rubin, D. B. (1991). Significance levels from repeated p-values with multiply-imputed data. Statistica Sinica, 1(1), 65–92.
   Web of Science ®Google Scholar
• Liaw, A., & M., Wiener, M. (2002). Classification and regression by randomForest. R News, 2(3), 18–22.
   Google Scholar
• Little, R. J. (1988). A test of missing completely at random for multivariate data with missing values. Journal of the American Statistical Association, 83(404), 1198–1202. https://doi.org/10.1080/01621459.1988.10478722
   Web of Science ®Google Scholar
• Little, R. J. (1993). Pattern-mixture models for multivariate incomplete data. Journal of the American Statistical Association, 88(421), 125–134. https://doi.org/10.2307/2290705
   Web of Science ®Google Scholar
• Little, R. J. A., & Wang, Y. (1996). Pattern-mixture models for multivariate incomplete data with covariates. Biometrics, 52(1), 98–111. https://doi.org/10.2307/2533148
   PubMed Web of Science ®Google Scholar
• Little, R. J., & Rubin, D. B. (2020). Statistical analysis with missing data (3rd. ed.). John Wiley & Sons.
   Google Scholar
• Marsh, H. W. (1998). Pairwise deletion for missing data in structural equation models: Nonpositive definite matrices, parameter estimates, goodness of fit, and adjusted sample sizes. Structural Equation Modeling: A Multidisciplinary Journal, 5(1), 22–36. https://doi.org/10.1080/10705519809540087
   Web of Science ®Google Scholar
• Peugh, J. L., & Enders, C. K. (2004). Missing data in educational research: A review of reporting practices and suggestions for improvement. Review of Educational Research, 74(4), 525–556. https://doi.org/10.3102/00346543074004525
   Web of Science ®Google Scholar
• R Core Team. (2019). R: A language and environment for statistical computing. R Foundation for Statistical Computing. https://www.R-project.org/
   Google Scholar
• Raghunathan, T. E., & Rubin, D. B. (1998). Roles for Bayesian techniques in survey sampling [Paper presentation]. Proceedings of the Silver Jubilee Meeting of the Statistical Society of Canada, pp. 51–55.
   Google Scholar
• Rencher, A. C., & Schaalje, G. B. (2008). Linear models in statistics. John Wiley & Sons.
   Google Scholar
• Robitzsch, A., & Grund, S. (2021). miceadds: Some additional multiple imputation functions, especially for ’mice’. R package version 3.11-6. https://CRAN.R-project.org/package=miceadds
   Google Scholar
• Rubin, D. B. (1976). Inference and missing data. Biometrika, 63(3), 581–592. https://doi.org/10.1093/biomet/63.3.581
   Web of Science ®Google Scholar
• Rubin, D. B. (1977). Formalizing subjective notions about the effect of nonrespondents in sample surveys. Journal of the American Statistical Association, 72(359), 538–543. https://doi.org/10.1080/01621459.1977.10480610
   Web of Science ®Google Scholar
• Rubin, D. B. (1987). Multiple imputation for nonresponse in surveys. Wiley. https://doi.org/10.1002/9780470316696
   Google Scholar
• Schafer, J. L. (2013, ported to R by Novo, A.). norm: Analysis of multivariate normal datasets with missing values. R package version 1.0-9.5. https://CRAN.R-project.org/package=norm
   Google Scholar
• Schafer, J. L., & Graham, J. W. (2002). Missing data: Our view of the state of the art. Psychological Methods, 7(2), 147–177. https://doi.org/10.1037//1082-989X.7.2.147
   PubMed Web of Science ®Google Scholar
• Schenker, N., & Taylor, J. M. G. (1996). Partially parametric techniques for multiple imputation. Computational Statistics & Data Analysis, 22(4), 425–446. https://doi.org/10.1016/0167-9473(95)00057-7
   Web of Science ®Google Scholar
• Steigen, A. M., & Bergh, D. (2019). The social provisions scale: Psychometric properties of the SPS-10 among participants in nature-based services. Disability and Rehabilitation, 41(14), 1690–1698. https://doi.org/10.1080/09638288.2018.1434689
   Google Scholar
• Sterba, S. K., & Gottfredson, N. C. (2015). Diagnosing global case influence on MAR versus MNAR model comparisons. Structural Equation Modeling: A Multidisciplinary Journal, 22(2), 294–307. https://doi.org/10.1080/10705511.2014.936082
   Web of Science ®Google Scholar
• White, I. R., Royston, P., & Wood, A. M. (2011). Multiple imputation using chained equations: Issues and guidance for practice. Statistics in Medicine, 30(4), 377–399. https://doi.org/10.1002/sim.4067
   PubMed Web of Science ®Google Scholar
• Wothke, W. (1993). Nonpositive definite matrices in structural modeling. Sage Focus Editions, 154, 256.
   Google Scholar
• Yamada, Y., Ćepulić, D. B., Coll-Martín, T., Debove, S., Gautreau, G., Han, H., Rasmussen, J., Tran, T. P., Travaglino, G. A., & Lieberoth, A. (2021). COVIDiSTRESS Global Survey dataset on psychological and behavioural consequences of the COVID-19 outbreak. Scientific Data, 8(1), 3. https://doi.org/10.1038/s41597-020-00784-9
   PubMed Web of Science ®Google Scholar
• Yuan, K.-H., Jamshidian, M., & Kano, Y. (2018). Missing data mechanisms and homogeneity of means and variances-covariances. Psychometrika, 83(2), 425–442. https://doi.org/10.1007/s11336-018-9609-x
   PubMed Web of Science ®Google Scholar
• Yuan, K.-H., Yang-Wallentin, F., & Bentler, P. M. (2012). ML versus MI for missing data with violation of distribution conditions. Sociological Methods & Research, 41(4), 598–629. https://doi.org/10.1177/0049124112460373
   PubMed Web of Science ®Google Scholar