Pattern Mixture Models for Quantifying Missing Data Uncertainty in Longitudinal Invariance Testing

REFERENCES

• Administration for Children and Families. (2002). Making a difference in the lives of infants and toddlers and their families: The impacts of early head start (Vol. I–III). Washington, DC: U.S. Department of Health and Human Services.
   Google Scholar
• Akl, E. A., Shawwa, K., Kahale, L. A., Agoritsas, T., Brignardello-Petersen, R., Busse, J. W., …Guyatt, G. H. (2015). Reporting missing participant data in randomised trials: Systematic survey of the methodological literature and a proposed guide. British Medical Journal Open, 5, 1–7. doi:10.1136/bmjopen-2015-008431
   Web of Science ®Google Scholar
• Allison, P. (1987). Estimation of linear models with incomplete data. Sociological Methodology, 17, 71–103. doi:10.2307/271029
   Google Scholar
• Bauer, D. J. (2007). Observations on the use of growth mixture models in psychological research. Multivariate Behavioral Research, 42, 757–786. doi:10.1080/00273170701710338
   Web of Science ®Google Scholar
• Beunckens, C., Molenberghs, G., Thijs, H., & Verbeke, G. (2007). Incomplete hierarchical data. Statistical Methods in Medical Research, 16, 457–492. doi:10.1177/0962280206075310
   PubMed Web of Science ®Google Scholar
• Brydges, C., Fox, A., Reid, C., & Anderson, M. (2014). The differentiation of executive functions in middle and late childhood: A longitudinal latent-variable analysis. Intelligence, 47, 34–43. doi:10.1016/j.intell.2014.08.010
   Web of Science ®Google Scholar
• Byrne, B., Shavelson, R., & Muthén, B. (1989). Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin, 105, 456–466. doi:10.1037/0033-2909.105.3.456
   Web of Science ®Google Scholar
• Carlson, B. (2009, August). Analysis of nonresponse bias in the early head start research and evaluation project. Paper presented at the Joint Statistical Meetings’ Section on Survey Research Methods, Washington, D.C.
   Google Scholar
• Demirtas, H., & Schafer, J. L. (2003). On the performance of random-coefficient pattern mixture models for non-ignorable drop-out. Statistics in Medicine, 22, 2553–2575. doi:10.1002/(ISSN)1097-0258
   PubMed Web of Science ®Google Scholar
• Diggle, P., & Kenward, M. G. (1994). Informative drop-out in longitudinal data-analysis. Applied Statistics, 43, 49–93. doi:10.2307/2986113
   Web of Science ®Google Scholar
• Edwards, M. C., & Wirth, R. J. (2009). Measurement and the study of change. Research in Human Development, 6, 74–96. doi:10.1080/15427600902911163
   Web of Science ®Google Scholar
• Enders, C. K. (2010). Applied missing data analysis. New York, NY: Guilford.
   Google Scholar
• Enders, C. K. (2011). Missing not at random models for latent growth curve analyses. Psychological Methods, 16, 1–16. doi:10.1037/a0022640
   PubMed Web of Science ®Google Scholar
• Fagerstrom, C., Lindwall, M., Ingeborg, A., & Rennemark, M. (2012). Factorial validity and invariance of the Life Satisfaction Index in older people across groups and time: Addressing the heterogeneity of age, functional ability, and depression. Archives of Gerontology and Geriatrics, 55, 349–356. doi:10.1016/j.archger.2011.10.007
   PubMed Web of Science ®Google Scholar
• Feldman, B., & Rabe-Hesketh, S. (2012). Modeling achievement trajectories when attrition is informative. Journal of Educational and Behavioral Statistics, 37, 703–736. doi:10.3102/1076998612458701
   Web of Science ®Google Scholar
• Gottfredson, N., Bauer, D., & Baldwin, S. (2014). Modeling change in the presence of nonrandomly missing data: Evaluating a shared parameter mixture model. Structural Equation Modeling, 21, 196–209. doi:10.1080/10705511.2014.882666
   PubMed Web of Science ®Google Scholar
• Hafez, M. S., Moustaki, I., & Kuha, J. (2015). Analysis of multivariate longitudinal data subject to nonrandom dropout. Structural Equation Modeling, 22, 193–201. doi:10.1080/10705511.2014.936086
   Web of Science ®Google Scholar
• Haviland, A. Jones, B. & Nagin, D. (2011). Group-based trajectory modeling extended to account for nonrandom participation attention. Sociological Methods and Research, 40, 367–390.
   Google Scholar
• Hedeker, D., & Gibbons, R. D. (1997). Application of random-effects pattern-mixture models for missing data in longitudinal studies. Psychological Methods, 2, 64–78. doi:10.1037/1082-989X.2.1.64
   Web of Science ®Google Scholar
• Horn, J., & McArdle, J. (1992). A practical and theoretical guide to measurement invariance in aging research. Experimental Aging Research, 18, 117–144. doi:10.1080/03610739208253916
   PubMed Web of Science ®Google Scholar
• Jones, M., Mishra, B., & Dobson, A. (2015). Analytical results in longitudinal studies depended on target of inference and assumed mechanism of attrition. Journal of Clinical Epidemiology, 68, 1165–1175. doi:10.1016/j.jclinepi.2015.03.011
   PubMed Web of Science ®Google Scholar
• Jöreskog, K. G. (1971). Simultaneous factor analysis in several populations. Psychometrika, 36, 409–426. doi:10.1007/BF02291366
   Web of Science ®Google Scholar
• King, B. (2011). Unbiased measurement of health-related quality-of-life ( Unpublished doctoral dissertation). University of Amsterdam, Amsterdam, The Netherlands.
   Google Scholar
• Leite, W. (2007). A comparison of latent growth models for constructs measured by multiple items. Structural Equation Modeling, 14, 581–610. doi:10.1080/10705510701575438
   Web of Science ®Google Scholar
• Lin, H., McCulloch, C. E., & Rosenheck, R. A. (2004). Latent pattern mixture models for informative intermittent missing data in longitudinal studies. Biometrics, 60, 295–305. doi:10.1111/j.0006-341X.2004.00173.x
   PubMed Web of Science ®Google Scholar
• Little, R. J. A. (1993). Pattern-mixture models for multivariate incomplete data. Journal of the American Statistical Association, 88, 125–134.
   Web of Science ®Google Scholar
• Little, R. J. A. (1995). Modeling the drop-out mechanism in repeated-measures studies. Journal of the American Statistical Association, 90, 1112–1121. doi:10.1080/01621459.1995.10476615
   Web of Science ®Google Scholar
• Little, R. J. A. (2008). Selection and pattern-mixture models. In G. Fitzmaurice, M. Davidian, G. Verbeke, & G. Molenberghs (Eds.), Longitudinal data analysis (pp. 409–431). London, UK: CRC.
   Google Scholar
• Little, R. J. A., D’Agostino, R., Cohen, M., Dickerson, K., Emerson, S. S., Farrar, J., … Stern, H. (2012). The prevention and treatment of missing data in clinical trials: Special report. The New England Journal of Medicine, 367, 1355–1360. doi:10.1056/NEJMsr1203730
   PubMed Web of Science ®Google Scholar
• Little, R. J. A., & Rubin, D. B. (2002). Statistical analysis with missing data. Hoboken, NJ: Wiley.
   Google Scholar
• Liu, Y., Millsap, R. E., West, S. G., Tein, J.-Y., Tanaka, R., & Grimm, K. J. (2016). Testing measurement invariance in longitudinal data with ordered-categorical measures. Psychological Methods. doi:10.1037/met0000075
   Web of Science ®Google Scholar
• Lubke, G., & Neale, M. (2006). Distinguishing between latent classes and continuous factors: Resolution by maximum likelihood? Multivariate Behavioral Research, 41, 499–532. doi:10.1207/s15327906mbr4104_4
   PubMed Web of Science ®Google Scholar
• MacCallum, R. C., & Austin, J. T. (2000). Applications of structural equation modeling in psychological research. Annual Reviews of Psychology, 51, 201–226. doi:10.1146/annurev.psych.51.1.201
   PubMed Web of Science ®Google Scholar
• Mallinckrodt, C., Lin, Q., & Molenberghs, M. (2013). A structured framework for assessing sensitivity to missing data assumptions in longitudinal clinical trials. Pharmaceutical Statistics, 12, 1–6. doi:10.1002/pst.1547
   PubMed Web of Science ®Google Scholar
• Mason, S., Lauterbach, D., McKibben, J., Lawrence, J., & Fauerbach, J. (2013). Confirmatory factor analysis and invariance of the Davidson Trauma Scale (DTS) in a longitudinal sample of burn patients. Psychological Trauma: Theory, Research, Practice, and Policy, 5, 10–17. doi:10.1037/a0028002
   Web of Science ®Google Scholar
• McLachlan, G., & Peel, D. (2000). Finite mixture models. New York, NY: Wiley.
   Google Scholar
• Meredith, W. (1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58, 525–543. doi:10.1007/BF02294825
   Web of Science ®Google Scholar
• Meredith, W., & Horn, J. (2001). The role of factorial invariance in modeling growth and change. In L. M. Collins & A. G. Sayer (Eds.), New methods for the analysis of change (pp. 203–240). Washington, DC: American Psychological Association.
   Google Scholar
• Minini, P., & Chavance, M. (2004). Sensitivity analysis of longitudinal normal data with drop-outs. Statistics in Medicine, 23, 1039–1054. doi:10.1002/sim.1702
   PubMed Web of Science ®Google Scholar
• Mogos, M., Beckstead, J., Kip, K., Evans, M., Boothroyd, R., Aiyer, A., & Reis, S. (2015). Assessing longitudinal invariance of the Center for Epidemiologic Studies–Depression Scale among middle-aged and older adults. Journal of Nursing Measurement, 23, 302–314. doi:10.1891/1061-3749.23.2.302
   PubMed Web of Science ®Google Scholar
• Molenberghs, G., & Kenward, M. G. (2007). Missing data in clinical studies. Chichester, UK: Wiley.
   Google Scholar
• Molenberghs, G., & Verbeke, G. (2001). A review on linear mixed models for longitudinal data, possibly subject to dropout. Statistical Modeling, 1, 235–269. doi:10.1191/147108201128195
   Web of Science ®Google Scholar
• Muthén, B., Asparouhov, T., Hunter, A. M., & Leuchter, A. F. (2011). Growth modeling with nonignorable dropout: Alternative analyses of the STAR*D antidepressant trial. Psychological Methods, 16, 17–33. doi:10.1037/a0022634
   PubMed Web of Science ®Google Scholar
• Muthén, L. K., & Muthén, B. (1998–2016). Mplus (Version 7.4) [Computer software]. Los Angeles, CA: Muthén & Muthén.
   Google Scholar
• National Research Council. (2010). The prevention and treatment of missing data in clinical trials. Panel on handling missing data in clinical trials. Division of Behavioral and Social Sciences and Education. Washington, DC: National Academies Press.
   Google Scholar
• Nguyen, C., Lee, K., & Carlin, J. (2015). Posterior predictive checking of multiple imputation models. Biometrical Journal, 57, 676–694. doi:10.1002/bimj.201400034
   PubMed Web of Science ®Google Scholar
• O’Kelly, M., & Ratitch, B. (2014). Clinical trials with missing data: A guide for practitioners. New York, NY: Wiley.
   Google Scholar
• Pitts, S., West, S., & Tein, J.-Y. (1996). Longitudinal measurement models in evaluation research: Examining stability and change. Evaluation and Program Planning, 19, 333–350. doi:10.1016/S0149-7189(96)00027-4
   Web of Science ®Google Scholar
• Raykov, T., & Marcoulides, G. A. (2004). Using the delta method for approximate interval estimation of parameter functions in SEM. Structural Equation Modeling, 11, 621–637. doi:10.1207/s15328007sem1104_7
   Web of Science ®Google Scholar
• Richerson, K., Watkins, M., & Beaujean, A. (2014). Longitudinal invariance of the Wechsler Intelligence Scale for Children–Fourth Edition in a referral sample. Journal of Psychoeducational Assessment, 32, 597–609. doi:10.1177/0734282914538802
   Web of Science ®Google Scholar
• Roggman, L., Cook, G., Peterson, C., & Raikes, H. (2008). Who drops out of early Head Start home visiting programs? Early Education and Development, 19, 574–599. doi:10.1080/10409280701681870
   Web of Science ®Google Scholar
• Rombach, I., Rivero-Arias, O., Gray, A., Jenkinson, C., & Burke, O. (2016). The current practice of handling and reporting missing outcome data in eight widely used PROMs in RCT publications: A review of the current literature. Quality of Life Research, 25, 1613–1623. doi:10.1007/s11136-015-1206-1
   PubMed Web of Science ®Google Scholar
• Rose, N., von Davier, M., & Xu, X. (2010). Modeling non-ignorable missing data with item response theory. Princeton, NJ: Educational Testing Company. Retrieved from https://www.ets.org/Media/Research/pdf/RR-10-11.pdf
   Google Scholar
• Roy, J. (2007). Latent class models and their application to missing-data patterns in longitudinal studies. Statistical Methods in Medical Research, 16, 441–456. doi:10.1177/0962280206075311
   PubMed Web of Science ®Google Scholar
• Rubin, D. B. (1976). Inference and missing data. Biometrika, 63, 581–592. doi:10.1093/biomet/63.3.581
   Web of Science ®Google Scholar
• Rubin, D. B. (1977). Formalizing subjective notions about the effect of nonrespondents in sample surveys. Journal of the American Statistical Association, 72, 538–543. doi:10.1080/01621459.1977.10480610
   Web of Science ®Google Scholar
• Schafer, J. L., & Graham, J. W. (2002). Missing data: Our view of the state of the art. Psychological Methods, 7, 147–177. doi:10.1037/1082-989X.7.2.147
   PubMed Web of Science ®Google Scholar
• Small, B., Hertzog, C., Hultsch, D., & Dixon, R. (2003). Stability and change in adult personality over 6 years: Findings from the Victoria Longitudinal Study. Journal of Gerontology, 58, 166–176. doi:10.1093/geronb/58.3.P166
   Google Scholar
• Souza, R., Eisen, R., Perera, S., Bantoto, B., Bawor, M., Dennis, B., … Thabane, L. (2016). Best (but oft-forgotten) practices: Sensitivity analyses in randomized controlled trials. American Journal of Clinical Nutrition, 103, 5–17. doi:10.3945/ajcn.115.121848
   PubMed Web of Science ®Google Scholar
• Sterba, S. K. (2013). Understanding linkages among mixture models. Multivariate Behavioral Research, 48, 775–815. doi:10.1080/00273171.2013.827564
   PubMed Web of Science ®Google Scholar
• Sterba, S. K. (2016). A latent transition analysis model for latent-state-dependent nonignorable missingness. Psychometrika, 82, 506–534. doi:10.1007/s11336-015-9442-4
   Google Scholar
• Sterba, S. K., & Gottfredson, N. (2015). Diagnosing global case influence on MAR versus MNAR model comparisons. Structural Equation Modeling, 22, 294–307. doi:10.1080/10705511.2014.936082
   Web of Science ®Google Scholar
• Thijs, H., Molenberghs, G., Michiels, B., Verbeke, G., & Curran, D. (2002). Strategies to fit pattern-mixture models. Biostatistics, 3, 245–265. doi:10.1093/biostatistics/3.2.245
   PubMed Web of Science ®Google Scholar
• Thomas, N., Harel, O., & Little, R. J. A. (2016). Analyzing clinical trial outcomes based on incomplete daily diary reports. Statistics in Medicine, 35, 2894–2906. doi:10.1002/sim.6890
   Google Scholar
• Tisak, J., & Meredith, W. (1991). Longitudinal factor analysis. In A. von Eye (Ed.), Statistical methods in longitudinal research: Vol. 1. Principles and structuring change (pp. 125–150). San Diego, CA: Academic.
   Google Scholar
• Tsonaka, R., Verbeke, G., & Lesaffre, E. (2009). A semi-parametric shared-parameter model to handle nonmonotone nonignorable missingness. Biometrics, 65, 81–87. doi:10.1111/j.1541-0420.2008.01021.x
   PubMed Web of Science ®Google Scholar
• Vandenberg, R., & Lance, C. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3, 4–70. doi:10.1177/109442810031002
   Web of Science ®Google Scholar
• Varni, J., Limbers, C., Newman, D., & Seid, M. (2008). Longitudinal factorial invariance of the PedsQL 4.0 Generic Core Scales Child Self-Report Version: One year prospective evidence from the California State Children’s Health Insurance Program (SCHIP). Quality of Life Research, 17, 1153–1162. doi:10.1007/s11136-008-9389-3
   PubMed Web of Science ®Google Scholar
• Verbeke, G., Molenbergs, G., & Beunckens, C. (2008). Formal and informal model selection with incomplete data. Statistical Science, 23, 201–218. doi:10.1214/07-STS253
   Web of Science ®Google Scholar
• Wang, M., Elhai, J., Daic, X., & Yao, S. (2012). Longitudinal invariance of posttraumatic stress disorder symptoms in adolescent earthquake survivors. Journal of Anxiety Disorders, 26, 263–270. doi:10.1016/j.janxdis.2011.12.009
   PubMed Web of Science ®Google Scholar
• Wang, Z., & Su, I. (2013). Longitudinal factor structure of general self-concept and locus of control among high school students. Journal of Psychoeducational Assessment, 31, 554–565. doi:10.1177/0734282913481651
   Web of Science ®Google Scholar
• Widaman, K. (1991). Qualitative transitions amid quantitative development: A challenge for measuring and representing change. In L. Collins & J. Horn (Eds.), Best methods for the analysis of change: Recent advances, unanswered questions, future directions (pp. 204–217). Washington, DC: American Psychological Association.
   Google Scholar
• Widaman, K., Ferrer, E., & Conger, R. (2010). Factorial invariance within longitudinal structural equation models: Measuring the same construct across time. Child Development Perspectives, 4, 10–18. doi:10.1111/j.1750-8606.2009.00110.x
   PubMed Web of Science ®Google Scholar
• Wirth, R. J. (2008). The effects of measurement non-invariance on parameter estimation in latent growth models ( Unpublished doctoral dissertation). University of North Carolina, Chapel Hill, NC.
   Google Scholar
• Wu, M., & Carroll, R. (1988). Estimation and comparison of changes in the presence of informative right censoring by modeling the censoring process. Biometrics, 44, 175–188. doi:10.2307/2531905
   Web of Science ®Google Scholar
• Wu, P.-C. (2015). Longitudinal measurement invariance of Beck Depression Inventory–II in early adolescents. Assessment. Advance online publication. doi:10.1177/1073191115608941
   PubMed Web of Science ®Google Scholar
• Xu, S., & Blozis, S. (2011). Sensitivity analyses of mixed models for incomplete longitudinal data. Journal of Educational and Behavioral Statistics, 36, 237–256. doi:10.3102/1076998610375836
   Web of Science ®Google Scholar
• Yang, M., & Maxwell, S. (2014). Estimation of treatment effects in randomized longitudinal designs with different types of non-ignorable dropout. Psychological Methods, 19, 188–210. doi:10.1037/a0033804
   PubMed Web of Science ®Google Scholar
• Yuan, K.-H., & Chan, W. (2016). Measurement invariance via multigroup SEM: Issues and solutions with chi-square-difference tests. Psychological Methods, 21, 405–426. doi:10.1037/met0000080
   PubMed Web of Science ®Google Scholar
• Yuan, K.-H., Chan, W., Marcoulides, G. A., & Bentler, P. M. (2016). Assessing structural equation models by equivalence testing with adjusted fit indices. Structural Equation Modeling, 23, 319–330. doi:10.1080/10705511.2015.1065414
   Web of Science ®Google Scholar