Multilevel Modeling in the ‘Wide Format’ Approach with Discrete Data: A Solution for Small Cluster Sizes

References

• Agresti, A., & Yang, M.-C. (1987). An empirical investigation of some effects of sparseness in contingency tables. Computational Statistics & Data Analysis, 5, 9–21. doi:10.1016/0167-9473(87)90003-X
   Web of Science ®Google Scholar
• Arbuckle, J. L. (1996). Full information estimation in the presence of incomplete data. In G. In Marcoulides & R. Schumacker (Eds.), Advanced structural equation modeling: Issues and techniques (pp. 243–277). Mahwah, NJ: Erlbaum.
   Google Scholar
• Asparouhov, T., & Muthén, B. (2007, August). Computationally efficient estimation of multilevel high-dimensional latent variable models. In proceedings of the 2007 JSM meeting in Salt Lake City, Utah, Section on Statistics in Epidemiology (pp. 2531–2535).
   Google Scholar
• Asparouhov, T., & Muthén, B. (2010). Simple second order chi-square correction. Mplus technical appendix.
   Google Scholar
• Bauer, D. J. (2003). Estimating multilevel linear models as structural equation models. Journal of Educational and Behavioral Statistics, 28, 135–167. doi:10.3102/10769986028002135
   Web of Science ®Google Scholar
• Beauducel, A., & Herzberg, P. Y. (2006). On the performance of maximum likelihood versus means and variance adjusted weighted least squares estimation in cfa. Structural Equation Modeling, 13, 186–203. doi:10.1207/s15328007sem1302_2
   Web of Science ®Google Scholar
• Bellio, R., & Varin, C. (2005). A pairwise likelihood approach to generalized linear models with crossed random effects. Statistical Modelling, 5, 217–227. doi:10.1191/1471082X05st095oa
   Web of Science ®Google Scholar
• Bentler, P. M., & Dijkstra, T. (1985). Efficient estimation via linearization in structural models. In PR Krishnaiah (Ed.), Multivariate Analysis (Vol. 6, pp.9–42)..
   Google Scholar
• Bock, R. D., & Aitkin, M. (1981). Marginal maximum likelihood estimation of item parameters: Application of an em algorithm. Psychometrika, 46, 443–459. doi:10.1007/BF02293801
   Web of Science ®Google Scholar
• Bollen, K. A. (1989). Structural equations with latent variables. New York, NY: John Wiley & Sons.
   Google Scholar
• Boulton, A. J. (2011). Fit index sensitivity in multilevel structural equation modeling (PhD thesis). University of Kansas.
   Google Scholar
• Browne, M. W. (1984). Asymptotically distribution–Free methods for the analysis of covariance structures. British Journal of Mathematical and Statistical Psychology, 37, 62–83. doi:10.1111/bmsp.1984.37.issue-1
   PubMed Web of Science ®Google Scholar
• Browne, M. W. (1995). Covariance structures. In Topics in applied multivariate analysis (pages 72–141). ID M. Hawkins. Cambridge, UK: Cambridge University Press.
   Google Scholar
• Bryk, A. S., & Raudenbush, S. W. (1987). Application of hierarchical linear models to assessing change. Psychological Bulletin, 101, 147–158. doi:10.1037/0033-2909.101.1.147
   Web of Science ®Google Scholar
• Cai, L. (2010). A two-tier full-information item factor analysis model with applications. Psychometrika, 75, 581–612. doi:10.1007/s11336-010-9178-0
   Web of Science ®Google Scholar
• Cho, S.-J., & Rabe-Hesketh, S. (2011). Alternating imputation posterior estimation of models with crossed random effects. Computational Statistics & Data Analysis, 55, 12–25. doi:10.1016/j.csda.2010.04.015
   Web of Science ®Google Scholar
• Chou, C.-P., Bentler, P. M., & Pentz, M. A. (1998). Comparisons of two statistical approaches to study growth curves: The multilevel model and the latent curve analysis. Structural Equation Modeling, 5, 247–266. doi:10.1080/10705519809540104
   Web of Science ®Google Scholar
• Croon, M. A., & van Veldhoven, M. J. (2007). Predicting group-level outcome variables from variables measured at the individual level: A latent variable multilevel model. Psychological Methods, 12, 45. doi:10.1037/1082-989X.12.1.45
   PubMed Web of Science ®Google Scholar
• Curran, P. J. (2003). Have multilevel models been structural equation models all along? Multivariate Behavioral Research, 38, 529–569. doi:10.1207/s15327906mbr3804_5
   PubMed Web of Science ®Google Scholar
• Depaoli, S., & Clifton, J. P. (2015). A bayesian approach to multilevel structural equation modeling with continuous and dichotomous outcomes. Structural Equation Modeling, 22, 327–351. doi:10.1080/10705511.2014.937849
   Web of Science ®Google Scholar
• Dyer, N. G., Hanges, P. J., & Hall, R. J. (2005). Applying multilevel confirmatory factor analysis techniques to the study of leadership. The Leadership Quarterly, 16, 149–167. doi:10.1016/j.leaqua.2004.09.009
   Web of Science ®Google Scholar
• Flora, D. B., & Curran, P. J. (2004). An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychological Methods, 9, 466–491. doi:10.1037/1082-989X.9.4.466
   PubMed Web of Science ®Google Scholar
• Fox, J.-P. (2010). Bayesian item response modeling: Theory and applications. New York, NY: Springer Science & Business Media.
   Google Scholar
• Goldstein, H., & McDonald, R. P. (1988). A general model for the analysis of multilevel data. Psychometrika, 53, 455–467. doi:10.1007/BF02294400
   Web of Science ®Google Scholar
• Guo, B., Perron, B. E., & Gillespie, D. F. (2008). A systematic review of structural equation modelling in social work research. British Journal of Social Work, 39, 1556–1574. doi:10.1093/bjsw/bcn101
   Web of Science ®Google Scholar
• Hedeker, D., & Gibbons, R. D. (1994). A random-effects ordinal regression model for multilevel analysis. Biometrics, 933–944. doi:10.2307/2533433
   PubMed Web of Science ®Google Scholar
• Holtmann, J., Koch, T., Lochner, K., & Eid, M. (2016). A comparison of ml, wlsmv, and bayesian methods for multilevel structural equation models in small samples: A simulation study. Multivariate Behavioral Research, 51, 661–680. doi:10.1080/00273171.2016.1208074
   PubMed Web of Science ®Google Scholar
• Hox, J. J., Moerbeek, M., & Van de Schoot, R. (2017). Multilevel analysis: Techniques and applications. New York, NY: Routledge.
   Google Scholar
• Joe, H., & Lee, Y. (2009). On weighting of bivariate margins in pairwise likelihood. Journal of Multivariate Analysis, 100, 670–685. doi:10.1016/j.jmva.2008.07.004
   Web of Science ®Google Scholar
• Jöreskog, K. G. (1981). Analysis of covariance structures. Scandinavian Journal of Statistics, 8, 65–92.
   Web of Science ®Google Scholar
• Jöreskog, K. G., & Moustaki, I. (2001). Factor analysis of ordinal variables: A comparison of three approaches. Multivariate Behavioral Research, 36, 347–387. doi:10.1207/S15327906347-387
   PubMed Web of Science ®Google Scholar
• Katsikatsou, M., & Moustaki, I. (2016). Pairwise likelihood ratio tests and model selection criteria for structural equation models with ordinal variables. Psychometrika, 81, 1046–1068. doi:10.1007/s11336-016-9523-z
   PubMed Web of Science ®Google Scholar
• Katsikatsou, M., & Moustaki, I. (2017). Pairwise likelihood estimation for confirmatory factor analysis models with ordinal variables and data that are missing at random. Submitted to Journal of Royal Statistical Society Series C.
   Google Scholar
• Katsikatsou, M., Moustaki, I., Yang-Wallentin, F., & Jöreskog, K. G. (2012). Pairwise likelihood estimation for factor analysis models with ordinal data. Computational Statistics & Data Analysis, 56, 4243–4258. doi:10.1016/j.csda.2012.04.010
   Web of Science ®Google Scholar
• Kim, E. S., Yoon, M., Wen, Y., Luo, W., & Kwok, O.-M. (2015). Within-level group factorial invariance with multilevel data: Multilevel factor mixture and multilevel mimic models. Structural Equation Modeling, 22, 603–616. doi:10.1080/10705511.2014.938217
   Web of Science ®Google Scholar
• Koomen, H., Verschueren, K., & Pianta, R. C. (2007). Leerling leerkracht relatie vragenlijst- handleiding g. [Student–Teacher Relationship Scale: Manual]. Houten: Bohn Stafleu van Loghum.
   Google Scholar
• Koomen, H. M., Verschueren, K., van Schooten, E., Jak, S., & Pianta, R. C. (2012). Validating the student-teacher relationship scale: Testing factor structure and measurement invariance across child gender and age in a dutch sample. Journal of School Psychology, 50, 215–234. doi:10.1016/j.jsp.2011.09.001
   PubMed Web of Science ®Google Scholar
• Lee, J. (2009). Universals and specifics of math self-concept, math self-efficacy, and math anxiety across 41 pisa 2003 participating countries. Learning and Individual Differences, 19, 355–365. doi:10.1016/j.lindif.2008.10.009
   Web of Science ®Google Scholar
• Li, H., Fortner, C. K., & Lei, X. (2015). Relationships between the use of test results and us students’ academic performance. School Effectiveness and School Improvement, 26, 258–278. doi:10.1080/09243453.2014.898662
   Web of Science ®Google Scholar
• Lindsay, B. G. (1988). Composite likelihood methods. Contemporary Mathematics, 80, 221–239.
   Google Scholar
• Lüdtke, O., Marsh, H. W., Robitzsch, A., Trautwein, U., Asparouhov, T., & Muthén, B. (2008). The multilevel latent covariate model: A new, more reliable approach to group-level effects in contextual studies. Psychological Methods, 13, 203. doi:10.1037/a0012869
   PubMed Web of Science ®Google Scholar
• MacCallum, R. C., & Austin, J. T. (2000). Applications of structural equation modeling in psychological research. Annual Review of Psychology, 51, 201–226. doi:10.1146/annurev.psych.51.1.201
   PubMed Web of Science ®Google Scholar
• MacCallum, R. C., Kim, C., Malarkey, W. B., & Kiecolt-Glaser, J. K. (1997). Studying multivariate change using multilevel models and latent curve models. Multivariate Behavioral Research, 32, 215–253. doi:10.1207/s15327906mbr3203_1
   PubMed Web of Science ®Google Scholar
• Maydeu-Olivares, A. (2017). Assessing the size of model misfit in structural equation models. Psychometrika, 82, 533–558. doi:10.1007/s11336-016-9552-7
   Web of Science ®Google Scholar
• McArdle, J. J., & Epstein, D. (1987). Latent growth curves within developmental structural equation models. Child Development, pages 110–133. doi:10.2307/1130295
   Web of Science ®Google Scholar
• McDonald, R. P. (1993). A general model for two-level data with responses missing at random. Psychometrika, 58, 575–585. doi:10.1007/BF02294828
   Web of Science ®Google Scholar
• McDonald, R. P., & Goldstein, H. (1989). Balanced versus unbalanced designs for linear structural relations in two-level data. British Journal of Mathematical and Statistical Psychology, 42, 215–232. doi:10.1111/bmsp.1989.42.issue-2
   Web of Science ®Google Scholar
• Mehta, P. D., & Neale, M. C. (2005). People are variables too: Multilevel structural equations modeling. Psychological Methods, 10, 259–283. doi:10.1037/1082-989X.10.3.259
   PubMed Web of Science ®Google Scholar
• Meredith, W., & Tisak, J. (1990). Latent curve analysis. Psychometrika, 55, 107–122. doi:10.1007/BF02294746
   Web of Science ®Google Scholar
• Merz, E. L., & Roesch, S. C. (2011). Modeling trait and state variation using multilevel factor analysis with panas daily diary data. Journal of Research in Personality, 45, 2–9. doi:10.1016/j.jrp.2010.11.003
   PubMed Web of Science ®Google Scholar
• Muthén, B., Du Toit, S. H., & Spisic, D. (1997). Robust inference using weighted least squares and quadratic estimating equations in latent variable modeling with categorical and continuous outcomes. Psychometrika, 75, 1–45.
   Google Scholar
• Muthén, B. O. (1989). Latent variable modeling in heterogeneous populations. Psychometrika, 54, 557–585.
   Web of Science ®Google Scholar
• Muthén, B. O. (1990). Mean and covariance structure analysis of hierarchical data (Vol. 62, pp. 1–64). Los Angeles, LA: University of California: Department of Statistics (UCLA Statistics Series).
   Google Scholar
• Muthén, B. O., & Satorra, A. (1995). Technical aspects of Muthén’s liscomp approach to estimation of latent variable relations with a comprehensive measurement model. Psychometrika, 60, 489–503.
   Web of Science ®Google Scholar
• Muthén, L. K., & Muthén, B. O. (2010). Mplus: Statistical analysis with latent variables: User’s guide. Los Angeles, CA: Muthén &Muthén.
   Google Scholar
• Neale, M. C. (2000). Modeling longitudinal and multilevel data: Practical issues, applied approaches and specific examples. In T. D. Little, K. U. Schnabel, & J. Baumert (Eds.), Individual fit, heterogeneity, and missing data in multigroup sem (pp. 249–267). Hillsdale, NJ: Erlbaum.
   Google Scholar
• NLSAH. (2005). National longitudinal study of adolescent health. Retrieved from http//:www.cpc.unc.edu/addhealth
   Google Scholar
• Ogasawara, H. (2001). Standard errors of fit indices using residuals in structural equation modeling. Psychometrika, 66, 421–436. doi:10.1007/BF02294443
   Web of Science ®Google Scholar
• Olsson, U. (1979). Maximum likelihood estimation of the polychoric correlation coefficient. Psychometrika, 44, 443–460. doi:10.1007/BF02296207
   Web of Science ®Google Scholar
• Olsson, U., Drasgow, F., & Dorans, N. J. (1982). The polyserial correlation coefficient. Psychometrika, 47, 337–347. doi:10.1007/BF02294164
   Web of Science ®Google Scholar
• Rabe-Hesketh, S., Skrondal, A., & Pickles, A. (2004a). Generalized multilevel structural equation modeling. Psychometrika, 69, 167–190. doi:10.1007/BF02295939
   Web of Science ®Google Scholar
• Rabe-Hesketh, S., Skrondal, A., & Pickles, A. (2004b). Gllamm manual. uc berkeley division of biostatistics (working paper series 1160). University of California, Berkeley.
   Google Scholar
• Renard, D. (2002). Topics in modeling multilevel and longitudinal data (Doctoral dissertation). Belgium.
   Google Scholar
• Rosseel, Y. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48, 1–36. doi:10.18637/jss.v048.i02
   Web of Science ®Google Scholar
• Ryu, E., & West, S. G. (2009). Level-specific evaluation of model fit in multilevel structural equation modeling. Structural Equation Modeling, 16, 583–601. doi:10.1080/10705510903203466
   Web of Science ®Google Scholar
• Satorra, A. (2000). Scaled and adjusted restricted tests in multi-sample analysis of moment structures. In Innovations in multivariate statistical analysis (pp. pages 233–247). Boston, MA: Springer.
   Google Scholar
• Satorra, A., & Bentler, P. M. (1994). Corrections to test statistics and standard errors in covariance structure analysis. In Clogg and Clogg (Ed.), Latent variables analysis: Applications for developmental research (pp.399–419). Thousand Oaks, CA: Sage.
   Google Scholar
• Schilling, S., & Bock, R. D. (2005). High-dimensional maximum marginal likelihood item factor analysis by adaptive quadrature. Psychometrika, 70, 533–555.
   Web of Science ®Google Scholar
• Schmidt, W. H. (1969). Covariance structure analysis of the multivariate random effects model (PhD thesis). University of Chicago, Department of Education.
   Google Scholar
• Snijders, T., & Bosker, R. J. (1999). Multilevel analysis: An introduction to basic and advanced multilevel modeling. London, UK: Sage.
   Google Scholar
• Tibaldi, F. S., Verbeke, G., Molenberghs, G., Renard, D., Noortgate, W., & Boeck, P. (2007). Conditional mixed models with crossed random effects. British Journal of Mathematical and Statistical Psychology, 60, 351–365. doi:10.1348/000711006X110562
   PubMed Web of Science ®Google Scholar
• Varin, C. (2008). On composite marginal likelihoods. Advances in Statistical Analysis, 92, 1–28. doi:10.1007/s10182-008-0060-7
   Web of Science ®Google Scholar
• Willett, J. B., & Sayer, A. G. (1994). Using covariance structure analysis to detect correlates and predictors of individual change over time. Psychological Bulletin, 116, 363. doi:10.1037/0033-2909.116.2.363
   Web of Science ®Google Scholar
• Wirth, R., & Edwards, M. C. (2007). Item factor analysis: Current approaches and future directions. Psychological Methods, 12, 58. doi:10.1037/1082-989X.12.1.58
   PubMed Web of Science ®Google Scholar
• Yang, Y. (2018). Structural equation modelling. In P. Brough (Ed.), Advanced research methods for applied psychology (pp. 258–270). New York, NY: Routledge.
   Google Scholar
• Yang-Wallentin, F., Jöreskog, K. G., & Luo, H. (2010). Confirmatory factor analysis of ordinal variables with misspecified models. Structural Equation Modeling, 17, 392–423. doi:10.1080/10705511.2010.489003
   Web of Science ®Google Scholar