A Cautionary Note about Having the Right Mixture Model but Classifying the Wrong People

References

• Abar, B., & Loken, E. (2012). Consequences of fitting non-identified latent class models. Structural Equation Modeling: A Multidisciplinary Journal 19(1), 1–15. https://doi.org/10.1080/10705511.2012.634701
   Web of Science ®Google Scholar
• Asparouhov, T., & Muthén, B. (2014). Auxiliary variables in mixture modeling: Using the BCH method in mplus to estimate a distal outcome model and an arbitrary secondary model. Mplus Web Notes 21(2), 1–22.
   Google Scholar
• Bakk, Z., Tekle, F. B., & Vermunt, J. K. (2013). Estimating the association between latent class membership and external variables using bias-adjusted three-step approaches. Sociological Methodology 43(1), 272–311. https://doi.org/10.1177/0081175012470644
   Web of Science ®Google Scholar
• Baughman, A. L., Bisgard, K. M., Cortese, M. M., Thompson, W. W., Sanden, G. N., & Strebel, P. M. (2008). Utility of composite reference standards and latent class analysis in evaluating the clinical accuracy of diagnostic tests for pertussis. Clinical and Vaccine Immunology 15(1), 106–114.
   PubMedGoogle Scholar
• Bolck, A., Croon, M., & Hagenaars, J. (2004). Estimating latent structure models with categorical variables: One-step versus three-step estimators. Political Analysis 12(1), 3–27. https://doi.org/10.1093/pan/mph001
   Web of Science ®Google Scholar
• Bowers, A. J., & Sprott, R. (2012). Why tenth graders fail to finish high school: A dropout typology latent class analysis. Journal of Education for Students Placed at Risk (JESPAR) 17(3), 129–148. https://doi.org/10.1080/10824669.2012.692071
   Google Scholar
• Bray, B. C., Lanza, S. T., & Tan, X. (2015). Eliminating bias in classify-analyze approaches for latent class analysis. Structural Equation Modeling: A Multidisciplinary Journal 22(1), 1–11. https://doi.org/10.1080/10705511.2014.935265
   PubMed Web of Science ®Google Scholar
• Carragher, N., & McWilliams, L. A. (2011). A latent class analysis of DSM-IV criteria for pathological gambling: Results from the national epidemiologic survey on alcohol and related conditions. Psychiatry Research 187(1–2), 185–192. https://doi.org/10.1016/j.psychres.2010.12.022
   PubMed Web of Science ®Google Scholar
• Cole, V. T., Bauer, D. J., & Hussong, A. M. (2019). Assessing the robustness of mixture models to measurement noninvariance. Multivariate Behavioral Research 54(6), 882–905.
   PubMed Web of Science ®Google Scholar
• Cole, V. T., Bauer, D. J., Hussong, A. M., & Giordano, M. L. (2017). An empirical assessment of the sensitivity of mixture models to changes in measurement. Structural Equation Modeling: A Multidisciplinary Journal 24(2), 159–179. https://doi.org/10.1080/10705511.2016.1257354
   PubMed Web of Science ®Google Scholar
• Collins, L. M., & Lanza, S. T. (2009). Latent class and latent transition analysis: With applications in the social, behavioral, and health sciences (Vol. 718). John Wiley & Sons.
   Google Scholar
• Da Silva, D. R., Salekin, R. T., & Rijo, D. (2019). Psychopathic severity profiles: A latent profile analysis in youth samples with implications for the diagnosis of conduct disorder. Journal of Criminal Justice60, 74–83. https://doi.org/10.1016/j.jcrimjus.2018.12.003
   Web of Science ®Google Scholar
• Depaoli, S., Winter, S. D., Lai, K., & Guerra-Peña, K. (2019). Implementing continuous non-normal skewed distributions in latent growth mixture modeling: An assessment of specification errors and class enumeration. Multivariate Behavioral Research 54(6), 795–821.
   PubMed Web of Science ®Google Scholar
• Dziak, J. J., Bray, B. C., Zhang, J., Zhang, M., & Lanza, S. T. (2016). Comparing the performance of improved classify-analyze approaches for distal outcomes in latent profile analysis. Methodology : European Journal of Research Methods for the Behavioral & Social Sciences 12(4), 107–116.
   PubMed Web of Science ®Google Scholar
• Everitt, B. S. (1988). A Monte Carlo investigation of the likelihood ratio test for number of classes in latent class analysis. Multivariate Behavioral Research 23(4), 531–538. https://doi.org/10.1207/s15327906mbr2304_9
   PubMed Web of Science ®Google Scholar
• Henson, J. M., Reise, S. P., & Kim, K. H. (2007). Detecting mixtures from structural model differences using latent variable mixture modeling: A comparison of relative model fit statistics. Structural Equation Modeling: A Multidisciplinary Journal 14(2), 202–226. https://doi.org/10.1080/10705510709336744
   Web of Science ®Google Scholar
• Huang, G.-H., & Bandeen-Roche, K. (2004). Building an identifiable latent class model with covariate effects on underlying and measured variables. Psychometrika 69(1), 5–32. https://doi.org/10.1007/BF02295837
   Web of Science ®Google Scholar
• Hubert, L., & Arabie, P. (1985). Comparing partitions. Journal of Classification 2(1), 193–218. https://doi.org/10.1007/BF01908075
   Web of Science ®Google Scholar
• Jöreskog, K. G., & Sörbom, D. (1979). Advances in factor analysis and structural equation models. Abt.
   Google Scholar
• Keel, P. K., Fichter, M., Quadflieg, N., Bulik, C. M., Baxter, M. G., Thornton, L., Halmi, K. A., Kaplan, A. S., Strober, M., Woodside, D. B., Crow, S. J., Mitchell, J. E., Rotondo, A., Mauri, M., Cassano, G., Treasure, J., Goldman, D., Berrettini, W. H., & Kaye, W. H. (2004). Application of a latent class analysis to empirically define eating disorder phenotypes. Archives of General Psychiatry 61(2), 192–200. https://doi.org/10.1001/archpsyc.61.2.192
   PubMed Web of Science ®Google Scholar
• King, K. R., Lembke, E. S., & Reinke, W. M. (2016). Using latent class analysis to identify academic and behavioral risk status in elementary students. School Psychology Quarterly 31(1), 43–57.
   PubMed Web of Science ®Google Scholar
• Lanza, S. T., Tan, X., & Bray, B. C. (2013). Latent class analysis with distal outcomes: A flexible model-based approach. Structural Equation Modeling: A Multidisciplinary Journal 20(1), 1–26. https://doi.org/10.1080/10705511.2013.742377
   PubMed Web of Science ®Google Scholar
• Lazarsfeld, P. F. (1955). Recent developments in latent structure analysis. Sociometry 18(4), 391. https://doi.org/10.2307/2785875
   Google Scholar
• Liu, J., & Harring, J. R. (2019). A systematic investigation of within-subject and between-subject covariance structures in growth mixture models. In G. Hancock, J. Harring, & G. Macready (Eds.), Advances in latent class analysis: A Festschrift in honor of C. Mitchell Dayton (pp. 181–222). Information Age Publishing.
   Google Scholar
• Lo, Y. (2001). Testing the number of components in a normal mixture. Biometrika 88(3), 767–778. https://doi.org/10.1093/biomet/88.3.767
   Web of Science ®Google Scholar
• Loken, E., & Molenaar, P. (2007). Categories or continua? The correspondence between mixture models and factor models. In G. H. K. Samuelsen (Ed.), Advances in latent variable mixture models (pp. 277–297). Information Age Publishing.
   Google Scholar
• Lubke, G., & Muthén, B. O. (2007). Performance of factor mixture models as a function of model size, covariate effects, and class-specific parameters. Structural Equation Modeling: A Multidisciplinary Journal 14(1), 26–47. https://doi.org/10.1080/10705510709336735
   Web of Science ®Google Scholar
• Lubke, G., & Neale, M. C. (2006). Distinguishing between latent classes and continuous factors: Resolution by maximum likelihood? Multivariate Behavioral Research 41(4), 499–532.
   PubMed Web of Science ®Google Scholar
• Lubke, G., & Tueller, S. (2010). Latent class detection and class assignment: A comparison of the MAXEIG taxometric procedure and factor mixture modeling approaches. Structural Equation Modeling: A Multidisciplinary Journal 17(4), 605–628. https://doi.org/10.1080/10705511.2010.510050
   PubMed Web of Science ®Google Scholar
• Macia, K. S., & Wickham, R. E. (2019). The impact of item misspecification and dichotomization on class and parameter recovery in LCA of count data. Multivariate Behavioral Research 54(1), 113–145.
   PubMed Web of Science ®Google Scholar
• McCoach, D. B., Gable, R. K., & Madura, J. (2013). Instrument design in the affective domain. Springer.
   Google Scholar
• Muthén, L., Muthén, B. (2007). What is a good value of entropy. http://www.statmodel.com/discussion/messages/13/2562.html?1237580237.
   Google Scholar
• Nagin, D. S., & Tremblay, R. E. (2005). Developmental trajectory groups: Fact or a useful statistical fiction? Criminology: An Interdisciplinary Journal, 43(4), 873–904. https://doi.org/10.1111/j.1745-9125.2005.00026.x
   Google Scholar
• Nylund, K. L., Asparouhov, T., & Muthén, B. O. (2007). Deciding on the number of classes in latent class analysis and growth mixture modeling: A Monte Carlo simulation study. Structural Equation Modeling: A Multidisciplinary Journal 14(4), 535–569. https://doi.org/10.1080/10705510701575396
   Web of Science ®Google Scholar
• Nylund-Gibson, K., Grimm, R. P., & Masyn, K. E. (2019). Prediction from latent classes: A demonstration of different approaches to include distal outcomes in mixture models. Structural Equation Modeling: A Multidisciplinary Journal 26(6), 967–985. https://doi.org/10.1080/10705511.2019.1590146
   Web of Science ®Google Scholar
• R Core Team. (2020). R: A language and environment for statistical computing [Computer software manual]. R Core Team. https://www.R-project.org/
   Google Scholar
• Rindskopf, D. (2009). Latent class analysis. In R. Millsap & A. Maydeu-Olivares (Eds.), The Sage handbook of quantitative methods in psychology (pp. 199–215) Sage Publications Ltd.
   Google Scholar
• Scrucca, L., Fop, M., Murphy, T. B., & Raftery, A. E. (2016). Mclust 5: Clustering, classification and density estimation using worst-performing finite mixture models. The R Journal 8(1), 289–317. https://doi.org/10.32614/RJ-2016-021
   PubMedGoogle Scholar
• Shmueli, G. (2010). To explain or to predict? Statistical Science 25(3), 289–310. https://doi.org/10.1214/10-STS330
   Web of Science ®Google Scholar
• Steinley, D. (2004). Properties of the Hubert-Arabie adjusted rand index. Psychological Methods 9(3), 386–396. https://doi.org/10.1037/1082-989X.9.3.386
   PubMed Web of Science ®Google Scholar
• Steinley, D., & Brusco, M. J. (2011). Evaluating mixture modeling for clustering: Recommendations and cautions. Psychological Methods 16(1), 63–79.
   PubMed Web of Science ®Google Scholar
• Stephens, M. (2000). Dealing with label switching in mixture models. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 62(4), 795–809. https://doi.org/10.1111/1467-9868.00265
   Web of Science ®Google Scholar
• Sterba, S. K. (2013). Understanding linkages among mixture models. Multivariate Behavioral Research 48(6), 775–815. https://doi.org/10.1080/00273171.2013.827564
   PubMed Web of Science ®Google Scholar
• Tein, J.-Y., Coxe, S., & Cham, H. (2013). Statistical power to detect the correct number of classes in latent profile analysis. Structural Equation Modeling: A Multidisciplinary Journal 20(4), 640–657. https://doi.org/10.1080/10705511.2013.824781
   PubMed Web of Science ®Google Scholar
• Thomas, M. L., Lanyon, R. I., & Millsap, R. E. (2009). Validation of diagnostic measures based on latent class analysis: A step forward in response bias research. Psychological Assessment 21(2), 227–230.
   PubMed Web of Science ®Google Scholar
• Tofighi, D., & Enders, C. K. (2008). Identifying the correct number of classes in growth mixture models. In G. Hancock & K. Samuelsen (Eds.), Advances in latent variable mixture models (pp. 317–341). Information Age.
   Google Scholar
• Tueller, S., & Lubke, G. (2010). Evaluation of structural equation mixture models: Parameter estimates and correct class assignment. Structural Equation Modeling: A Multidisciplinary Journal 17(2), 165–192. https://doi.org/10.1080/10705511003659318
   PubMed Web of Science ®Google Scholar
• Vermunt, J. K. (2010). Latent class modeling with covariates: Two improved three-step approaches. Political Analysis 18(4), 450–469. https://doi.org/10.1093/pan/mpq025
   Web of Science ®Google Scholar
• Vermunt, J. K., & Magidson, J. (2002). Latent class cluster analysis. In J. A. Hagenaars & A. L. McCutcheon (Eds.), Applied latent class analysis (pp. 89–106). Cambridge University Press.
   Google Scholar
• Wendt, L. P., Wright, A. G. C., Pilkonis, P. A., Nolte, T., Fonagy, P., Montague, P. R., Benecke, C., Krieger, T., & Zimmermann, J. (2019). The latent structure of interpersonal problems: Validity of dimensional, categorical, and hybrid models. Journal of Abnormal Psychology, 128(8), 823–839. http://dx.doi.org/10.1037/abn0000460
   Google Scholar
• Wiegand, R. E., Cooley, G., Goodhew, B., Banniettis, N., Kohlhoff, S., Gwyn, S., & Martin, D. L. (2018). Latent class modeling to compare testing platforms for detection of antibodies against the chlamydia trachomatis antigen pgp3. Scientific Reports 8(1), 1–8. https://doi.org/10.1038/s41598-018-22708-9
   Google Scholar
• Wu, Q. (2009). Class extraction and classification accuracy in latent class models [unpublished doctoral dissertation]. Penn State Electronic Theses and Dissertations.
   Google Scholar
• Yarkoni, T., & Westfall, J. (2017). Choosing prediction over explanation in psychology: Lessons from machine learning. Perspectives on Psychological Science 12(6), 1100–1122.
   Web of Science ®Google Scholar