Multilevel Factor Mixture Modeling: A Tutorial for Multilevel Constructs

References

• Akaike, H. (1974). A new look at the statistical model identification. IEEE Transactions on Automatic Control, 19, 716–723. https://doi.org/10.1109/TAC.1974.1100705
   Web of Science ®Google Scholar
• Allan, N. P., MacPherson, L., Young, K. C., Lejuez, C. W., & Schmidt, N. B. (2014). Examining the latent structure of anxiety sensitivity in adolescents using factor mixture modeling. Psychological Assessment, 26, 741–751. https://doi.org/10.1037/a0036744
   PubMed Web of Science ®Google Scholar
• Allua, S., Stapleton, L. M., & Beretvas, S. N. (2008). Testing latent mean differences between observed and unobserved groups using multilevel factor mixture models. Educational and Psychological Measurement, 68, 357–378. https://doi.org/10.1177/0013164407312600
   Web of Science ®Google Scholar
• De Angelis, M., Giusino, D., Nielsen, K., Aboagye, E., Christensen, M., Innstrand, S. T., Mazzetti, G., van den Heuvel, M., Sijbom, R. B. L., Pelzer, V., Chiesa, R., & Pietrantoni, L. (2020). H-WORK project: Multilevel interventions to promote mental health in SMEs and public workplaces. International Journal of Environmental Research and Public Health, 17, 8035. https://doi.org/10.3390/ijerph17218035
   PubMed Web of Science ®Google Scholar
• Asparouhov, T., & Muthén, B. (2008). Multilevel mixture models. In G. R. Hancock & K. M. Samuelsen (Eds.), Advances in latent variable mixture modeling (pp. 27–51). Information Age.
   Google Scholar
• Beauducel, A., & Herzberg, P. Y. (2006). On the performance of maximum likelihood versus means and variance adjusted weighted least squares estimation in CFA. Structural Equation Modeling: A Multidisciplinary Journal, 13, 186–203. https://doi.org/10.1207/s15328007sem1302_2
   Web of Science ®Google Scholar
• Bernstein, A., Stickle, T. R., & Schmidt, N. B. (2013). Factor mixture model of anxiety sensitivity and anxiety psychopathology vulnerability. Journal of Affective Disorders, 149, 406–417. https://doi.org/10.1016/j.jad.2012.11.024
   PubMed Web of Science ®Google Scholar
• Bliese, P. D. (2000). Within-group agreement, non-independence, and reliability: Implications for data aggregation and analysis. In K. J. Kline & S.W. J. Kozlowski (Eds.), Multilevel theory, research, and methods inorganizations: Foundations, extensions, and new directions (pp. 349–381). Jossey-Bass.
   Google Scholar
• Bliese, P. D., Maltarich, M. A., & Hendricks, J. L. (2018). Back to basics with mixed-effects models: Nine takeaway points. Journal of Business and Psychology, 33, 1–23. https://doi.org/10.1007/s10869-017-9491-z
   Web of Science ®Google Scholar
• Bozdogan, H. (1993). Choosing the number of component clusters in the mixture-model using a new informational complexity criterion of the inverse-Fisher information matrix. In O. Opitz, B. Lausen, & R. Klar (Eds.), Studies in classification, data analysis, and knowledge organization. Springer-Verlag.
   Google Scholar
• Dun, E. C., Masyn, K. E., Yudron, M., Jones, S. M., & Subramanian, S. V. (2014). Translating multilevel theory into multilevel research: Challenges and opportunities for understanding social determinants of psychiatric disorders. Social Psychiatry and Psychiatric Epidemiology, 49, 859–872. https://doi.org/10.1007/s00127-013-0809-5
   PubMed Web of Science ®Google Scholar
• Finch, W. H., & French, B. F. (2014). Multilevel latent class analysis: Parametric and nonparametric models. The Journal of Experimental Education, 82, 307–333. https://doi.org/10.1080/00220973.2013.813361
   Web of Science ®Google Scholar
• Gao, M., Leite, W., & Hu, J. (2018). The performance of model fit indices for class enumeration in multilevel factor mixture models. American Journal of Theoretical and Applied Statistics, 7, 222–228.
   Google Scholar
• Geldhof, G. J., Preacher, K. J., & Zyphur, M. J. (2014). Reliability estimation in a multilevel confirmatory factor analysis framework. Psychological Methods, 19, 72–91. https://doi.org/10.1037/a0032138
   PubMed Web of Science ®Google Scholar
• Georgiades, S., Szatmari, P., Boyle, M., Hanna, S., Duku, E., Zwaigenbaum, L., Bryson, S., Fombonne, E., Volden, J., Mirenda, P., Smith, I., Roberts, W., Vaillancourt, T., Waddell, C., Bennett, T., & Thompson, A. (2012). Investigating phenotypic heterogeneity in children with autism spectrum disorder: A factor mixture modeling approach. Journal of Child Psychology and Psychiatry, and Allied Disciplines, 54, 206–215. https://doi.org/10.1111/j.1469-7610.2012.02588.x
   PubMed Web of Science ®Google Scholar
• Henry, K. L., & Muthén, B. (2010). Multilevel latent class analysis: An application of adolescent smoking typologies with individual and contextual predictors. Structural Equation Modeling: a Multidisciplinary Journal, 17, 193–215. https://doi.org/10.1080/10705511003659342
   PubMed Web of Science ®Google Scholar
• Jak, S., Oort, F. J., & Dolan, C. V. (2013). A test for cluster bias: Detecting violations of measurement invariance across clusters in multilevel data. Structural Equation Modeling: A Multidisciplinary Journal, 20, 265–282. https://doi.org/10.1080/10705511.2013.769392
   Web of Science ®Google Scholar
• Kim, E. S., Cao, C., Wang, Y., & Nguyen, D. (2017). Measurement invariance testing with many groups: A comparison of five approaches. Structural Equation Modeling: A Multidisciplinary Journal, 24, 524–544. https://doi.org/10.1080/10705511.2017.1304822
   Web of Science ®Google Scholar
• Kim, E. S., Joo, S.-H., Lee, P., Wang, Y., & Stark, S. (2016). Measurement invariance testing across between-level latent classes using multilevel factor mixture modeling. Structural Equation Modeling: A Multidisciplinary Journal, 23, 870–887. https://doi.org/10.1080/10705511.2016.1196108
   Web of Science ®Google Scholar
• Kim, E. S., Yoon, M., Wen, Y., Luo, W., & Kwok, O. (2015). Within-level group factorial invariance with multilevel data: Multilevel factor mixture and multilevel MIMIC model. Structural Equation Modeling: A Multidisciplinary Journal, 22, 603–616. https://doi.org/10.1080/10705511.2014.938217
   Web of Science ®Google Scholar
• Kim, E. S., Robert, F. D., Cao, C., & Ferron, J. M. (2016). Multilevel factor analysis: Reporting guidelines and a review of reporting practices. Multivariate Behavioral Research, 51, 881–898. https://doi.org/10.1080/00273171.2016.1228042
   PubMed Web of Science ®Google Scholar
• Kim, E. S., & Wang, Y. (2018). Investigating sources of heterogeneity with 3-step multilevel factor mixture modeling: Beyond testing measurement invariance in cross-national studies. Structural Equation Modeling: A Multidisciplinary Journal, 26, 165–181. https://doi.org/10.1080/10705511.2018.1521284
   Web of Science ®Google Scholar
• Kim, E. S., Nguyen, D., Liu, S., & Wang, Y. (2022). Mixed effect of item parceling on performance of factor mixture modeling. Structural Equation Modeling: A Multidisciplinary Journal, 29, 207–217. https://doi.org/10.1080/10705511.2021.1965483
   Web of Science ®Google Scholar
• Kim, E. S., Wang, Y., & Hsu, H.-Y. (2023). A systematic review of and reflection on the applications of factor mixture modeling. Psychological Methods. Advance online publication. https://doi.org/10.1037/met0000630
   Web of Science ®Google Scholar
• Kim, Y., & Muthén, B. O. (2009). Two-part factor mixture modeling: Application to an aggressive behavior measurement instrument. Structural Equation Modeling: a Multidisciplinary Journal, 16, 602–624. https://doi.org/10.1080/10705510903203516
   PubMed Web of Science ®Google Scholar
• Kozlowski, S. W. J., & Klein, K. J. (2000). A multi-level approach to theory and research in organizations: Contextual, temporal, and emergent processes. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multilevel theory, research, and methods in organizations: Foundations extensions, and new directions (pp. 3–90). Jossey-Bass.
   Google Scholar
• Leite, W. L., & Cooper, L. A. (2010). Detecting social desirability bias using factor mixture models. Multivariate Behavioral Research, 45, 271–293. https://doi.org/10.1080/00273171003680245
   PubMed Web of Science ®Google Scholar
• LeNoble, C. A., & Hudson, M. F. (2022). A multilevel approach for advancing organizational interventions. Industrial and Organizational Psychology, 15, 105–109. https://doi.org/10.1017/iop.2021.131
   Google Scholar
• Lo, Y., Mendell, N. R., & Rubin, D. B. (2001). Testing the number of components in a normal mixture. Biometrika, 88, 767–778. https://doi.org/10.1093/biomet/88.3.767
   Web of Science ®Google Scholar
• Lukočienė, O., Varriale, R., & Vermunt, J. K. (2010). The simultaneous decision(s) about the number of lower- and higher-level classes in multilevel latent class analysis. Sociological Methodology, 40, 247–283. https://doi.org/10.1111/j.1467-9531.2010.01231.x
   Web of Science ®Google Scholar
• Lüdtke, O., Marsh, H. W., Robitzsch, A., Trautwein, U., Asparouhov, T., & Muthén, B. (2008). The multilevel latent covariate model: A new, more reliable approach to group-level effects in contextual studies. Psychological Methods, 13, 203–229. https://doi.org/10.1037/a0012869
   PubMed Web of Science ®Google Scholar
• Lubke, G. H., & Muthén, B. (2005). Investigating population heterogeneity with factor mixture models. Psychological Methods, 10, 21–39. https://doi.org/10.1037/1082-989X.10.1.21
   PubMed Web of Science ®Google Scholar
• Lubke, G. H., & Muthén, B. O. (2007). Performance of factor mixture models as a function of model size, covariate effects, and class-specific parameters. Structural Equation Modeling: A Multidisciplinary Journal, 14, 26–47. https://doi.org/10.1080/10705510709336735
   Web of Science ®Google Scholar
• Lubke, G. H., & Neale, M. C. (2008). Distinguishing between latent classes and continuous factors with categorical outcomes: Class invariance of parameters of factor mix models. Multivariate Behavioral Research, 43, 592–620. https://doi.org/10.1080/00273170802490673
   PubMed Web of Science ®Google Scholar
• Mäkikangas, A., Tolvanen, A., Aunola, K., Feldt, T., Mauno, S., & Kinnunen, U. (2018). Multilevel latent profile analysis with covariates: Identifying job characteristics profiles in hierarchical data as an example. Organizational Research Methods, 21, 931–954. https://doi.org/10.1177/1094428118760690
   Web of Science ®Google Scholar
• Marsh, H. W., Lüdtke, O., Nagengast, B., Trautwein, U., Morin, A. J. S., Abduljabbar, A. S., & Köller, O. (2012). Classroom climate and contextual effects: Conceptual and methodological issues in the evaluation of group-level effects. Educational Psychologist, 47, 106–124. https://doi.org/10.1080/00461520.2012.670488
   Web of Science ®Google Scholar
• McLachlan, G., & Peel, D. (2000). Finite mixture models. John Wiley.
   Google Scholar
• Mehta, P. D., & Neale, M. C. (2005). People are variables too: Multilevel structural equations modeling. Psychological Methods, 10, 259–284. https://doi.org/10.1037/1082-989X.10.3.259
   PubMed Web of Science ®Google Scholar
• Muthén, L. K., & Muthén, B. O. (1998–2021). Mplus user’s guild. (8th ed.). Muthén & Muthén.
   Google Scholar
• Nagengast, B., & Marsh, H. W. (2013). Motivation and engagement in science around the globe: Testing measurement invariance with multigroup SEMs across 57 countries using PISA 2006. In L. Rutkowski, M. von Davier, & D. Rutkowski (Eds.), A handbook of international large-scale assessment (pp. 317–344). Chapman & Hall, CRC Press.
   Google Scholar
• Nylund, K. L., Asparouhov, T., & Muthén, B. O. (2007). Deciding on the number of classes in latent class analysis and growth mixture modeling: A Monte Carlo simulation study. Structural Equation Modeling: A Multidisciplinary Journal, 14, 535–569. https://doi.org/10.1080/10705510701575396
   Web of Science ®Google Scholar
• Paskett, E., Thompson, B., Ammerman, A. S., Ortega, A. N., Marsteller, J., & Richardson, D. (2016). Multilevel Interventions to address health disparities shown promise in improving population health. Health Affairs (Project Hope), 35, 1429–1434. https://doi.org/10.1377/hlthaff.2015.1360
   PubMed Web of Science ®Google Scholar
• Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models. (2nd ed.). Sage.
   Google Scholar
• Schwarz, G. (1978). Estimating the dimension of a model. Annals of Statistics, 6, 461–464.
   Web of Science ®Google Scholar
• Sclove, S. L. (1987). Application of model-selection criterion to some problems in multivariate analysis. Psychometrika, 52, 333–343. https://doi.org/10.1007/BF02294360
   Web of Science ®Google Scholar
• Stapleton, L. M., Yang, J. S., & Hancock, G. R. (2016). Construct meaning in multilevel settings. Journal of Educational and Behavioral Statistics, 41, 481–520. https://doi.org/10.3102/1076998616646200
   Web of Science ®Google Scholar
• Son, S., & Hong, S. (2021). Multiple group analysis in multilevel data across within-level groups: A comparison of multilevel factor mixture modeling and multilevel multiple-indicators multiple-causes modeling. Educational and Psychological Measurement, 81, 904–935. https://doi.org/10.1177/0013164420987899
   PubMed Web of Science ®Google Scholar
• Vermunt, J. K. (2003). Multilevel latent class models. Sociological Methodology, 33, 213–239. https://doi.org/10.1111/j.0081-1750.2003.t01-1-00131.x
   Web of Science ®Google Scholar
• Vermunt, J. K. (2008). Latent class and finite mixture models for multilevel data sets. Statistical Methods in Medical Research, 17, 33–51. https://doi.org/10.1177/0962280207081238
   PubMed Web of Science ®Google Scholar
• Vermunt, J. K., & Magidson, J. (2005). Latent GOLD 4.0 [computer program]. Statistical Innovations Inc.
   Google Scholar
• Vrieze, S. I. (2012). Model selection and psychological theory: A discussion of the differences between the Akaike information criterion (AIC) and the Bayesian information criterion (BIC). Psychological Methods, 17, 228–243. https://doi.org/10.1037/a0027127
   PubMed Web of Science ®Google Scholar
• Wang, Y., Hsu, H.-Y., & Kim, E. (2021). Investigating the impact of covariate inclusion on sample size requirements of factor mixture modeling: A Monte Carlo simulation study. Structural Equation Modeling: A Multidisciplinary Journal, 28, 716–724. https://doi.org/10.1080/10705511.2021.1910036
   Web of Science ®Google Scholar
• Wang, Y., Kim, E., Ferron, J. M., Dedrick, R. F., Tan, T. X., & Stark, S. (2021). Testing measurement invariance across unobserved groups: The role of covariates in factor mixture modeling. Educational and Psychological Measurement, 81, 61–89. https://doi.org/10.1177/0013164420925122
   PubMed Web of Science ®Google Scholar