References
- Akaike, H. (1987). Factor analysis and AIC. Psychometrika, 52, 317–332. https://doi.org/10.1007/BF02294359
- Barendse, M. T., Oort, F. J., & Timmerman, M. E. (2015). Using exploratory factor analysis to determine the dimensionality of discrete responses. Structural Equation Modeling, 22, 87–101. https://doi.org/10.1080/10705511.2014.934850
- Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238–246. https://doi.org/10.1037/0033-2909.107.2.238
- Bozdogan, H. (2000). Akaike’s information criterion and recent developments in information complexity. Journal of Mathematical Psychology, 44, 62–91. https://doi.org/10.1006/jmps.1999.1277
- Browne, M. W., & Arminger, G. (1995). Specification and estimation of mean-and covariance-structure models. In G. Arminger, C. C. Clogg, & M. E. Sobel (Eds.), Handbook of statistical modeling for the social and behavioral sciences (pp. 185–249). Springer.
- Burnham, K. P., & Anderson, D. R. (1998). Model selection and inference: A practical information-theoretic approach. Springer-Verlag.
- Burnham, K. P., & Anderson, D. R. (2004). Multimodel inference: Understanding AIC and BIC in model selection. Sociological Methods & Research, 33, 261–304. https://doi.org/10.1177/0049124104268644
- Cattell, R. B. (1966). The scree test for the number of factors. Multivariate Behavioral Research, 1, 245–276. https://doi.org/10.1207/s15327906mbr0102_10
- Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14, 464–504. https://doi.org/10.1080/10705510701301834
- Chen, Q., Luo, W., Palardy, G. J., Glaman, R., & McEnturff, A. (2017). The efficacy of common fit indices for enumerating classes in growth mixture models when nested data structure is ignored: A Monte Carlo study. SAGE Open, 7, 1–19. https://doi.org/10.1177/2158244017700459
- Child, D. (1990). The essentials of factor analysis (2nd ed.). Cassel Educational Limited.
- Clark, D. A., & Bowles, R. P. (2018). Model fit and item factor analysis: Overfactoring, underfactoring, and a program to guide interpretation. Multivariate Behavioral Research, 53, 544–558. https://doi.org/10.1080/00273171.2018.1461058
- Conway, J. M., & Huffcutt, A. I. (2003). A review and evaluation of exploratory factor analysis practices in organizational research. Organizational Research Methods, 6, 147–168. https://doi.org/10.1177/1094428103251541
- Cudeck, R., & Henly, S. J. (2003). A realistic perspective on pattern representation in growth data: Comment on Bauer and Curran (2003). Psychological Methods, 8, 378–383. https://doi.org/10.1037/1082-989X.8.3.378
- D’Haenens, E., Van Damme, J., & Onghena, P. (2010). Multilevel exploratory factor analysis: Illustrating its surplus value in educational effectiveness research. School Effectiveness and School Improvement, 21, 209–235. https://doi.org/10.1080/09243450903581218
- Garrido, L. E., Abad, F. J., & Ponsoda, V. (2016). Are fit indices really fit to estimate the number of factors with categorical variables? Some cautionary findings via Monte Carlo simulation. Psychological Methods, 21, 93. https://doi.org/10.1037/met0000064
- Gerbing, D. W., & Anderson, J. C. (1992). Monte Carlo evaluations of goodness of fit indices for structural equation models. Sociological Methods & Research, 21, 132–160. https://doi.org/10.1177/0049124192021002002
- Hayashi, K., Bentler, P. M., & Yuan, K. H. (2007). On the likelihood ratio test for the number of factors in exploratory factor analysis. Structural Equation Modeling, 14, 505–526. https://doi.org/10.1080/10705510701301891
- Horn, J. L. (1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30, 179–185. https://doi.org/10.1007/BF02289447
- Hox, J. J., & Maas, C. J. (2001). The accuracy of multilevel structural equation modeling with pseudobalanced groups and small samples. Structural Equation Modeling, 8, 157–174. https://doi.org/10.1207/S15328007SEM0802_1
- Hox, J. J., Moerbeek, M., & Van De Schoot, R. (2010). Multilevel analysis techniques and applications (2nd ed.). Routledge.
- Hsu, H. Y., Kwok, O. M., Lin, J. H., & Acosta, S. (2015). Detecting misspecified multilevel structural equation models with common fit indices: A Monte Carlo study. Multivariate Behavioral Research, 50, 197–215. https://doi.org/10.1080/00273171.2014.977429
- Hsu, H. Y., Lin, J. H., Kwok, O. M., Acosta, S., & Willson, V. (2017). The impact of intraclass correlation on the effectiveness of level-specific fit indices in multilevel structural equation modeling: A Monte Carlo study. Educational and Psychological Measurement, 77, 5–31. https://doi.org/10.1177/0013164416642823
- Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55. https://doi.org/10.1080/10705519909540118
- Inglehart, R. (1993). World values survey 1990-1991: WVS program. J.D. Systems, S.L. ASEP S.A.
- Jöreskog, K. G. (1993). Testing structural equation models. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 294–306). Newbury Park, CA: Sage.
- Julian, M. W. (2001). The consequences of ignoring multilevel data structures in nonhierarchical covariance modeling. Structural Equation Modeling, 8, 325–352. https://doi.org/10.1207/S15328007SEM0803_1
- Kaiser, H. F. (1960). The application of electronic computers to factor analysis. Educational and Psychological Measurement, 20, 141–151. https://doi.org/10.1177/001316446002000116
- Kim, E. S., Kwok, O. M., & Yoon, M. (2012). Testing factorial invariance in multilevel data: A Monte Carlo study. Structural Equation Modeling, 19, 250–267. https://doi.org/10.1080/10705511.2012.659623
- Kim, M., Kwok, O. M., Yoon, M., Willson, V., & Lai, M. H. (2016). Specification search for identifying the correct mean trajectory in polynomial latent growth models. The Journal of Experimental Education, 84, 307–329. https://doi.org/10.1080/00220973.2014.984831
- Kuha, J. (2004). AIC and BIC: Comparisons of assumptions and performance. Sociological Methods & Research, 33, 188–229. https://doi.org/10.1177/0049124103262065
- Ledesma, R. D., & Valero-Mora, P. (2007). Determining the number of factors to retain in EFA: An easy-to-use computer program for carrying out parallel analysis. Practical Assessment, Research & Evaluation, 12, 1–11.
- Lopes, H. F., & West, M. (2004). Bayesian model assessment in factor analysis. Statistica Sinica, 14, 41–68. https://www.jstor.org/stable/24307179
- Lukočienė, O., Varriale, R., & Vermunt, J. K. (2010). The simultaneous decision(s) about the number of lower-and higher-level classes in multilevel latent class analysis. Sociological Methodology, 40, 247–283. https://doi.org/10.1111/j.1467-9531.2010.01231.x
- MacCallum, R. C. (2003). 2001 presidential address: Working with imperfect models. Multivariate Behavioral Research, 38, 113–139. https://doi.org/10.1207/S15327906MBR3801_5
- MacCallum, R. C., Browne, M. W., & Cai, L. (2007). Factor analysis at 100: Historical developments and future directions. Erlbaum.
- Marcoulides, K. M., & Yuan, K. H. (2017). New ways to evaluate goodness of fit: A note on using equivalence testing to assess structural equation models. Structural Equation Modeling, 24, 148–153. https://doi.org/10.1080/10705511.2016.1225260
- Marcoulides, K. M., & Yuan, K.-H. (2020). Using equivalence testing to evaluate goodness of fit in multilevel structural equation models. The International Journal of Research & Method in Education, 43, 431–443. https://doi.org/10.1080/1743727X.2020.1795113
- Meehl, P. E. (1990). Appraising and amending theories: The strategy of Lakatosian defense and two principles that warrant it. Psychological Inquiry, 1, 108–141. https://doi.org/10.1207/s15327965pli0102_1
- Montoya, A. K., & Edwards, M. C. (2021). The poor fit of model fit for selecting number of factors in exploratory factor analysis for scale evaluation. Educational and Psychological Measurement, 81, 413–440. https://doi.org/10.1177/0013164420942899
- Muthén, B. O. (1991). Multilevel factor analysis of class and student achievement components. Journal of Educational Measurement, 28, 338–354. https://www.jstor.org/stable/1434897
- Muthén, L., & Muthén, B. (2017). Mplus (Version 8)[computer software]. (1998-2017). Los Angeles, CA: Muthén & Muthén.
- Nye, C. D., Bradburn, J., Olenick, J., Bialko, C., & Drasgow, F. (2019). How big are my effects? Examining the magnitude of effect sizes in studies of measurement equivalence. Organizational Research Methods, 22, 678–709. https://doi.org/10.1177/1094428118761122
- Preacher, K. J., Zhang, G., Kim, C., & Mels, G. (2013). Choosing the optimal number of factors in exploratory factor analysis: A model selection perspective. Multivariate Behavioral Research, 48, 28–56. https://doi.org/10.1080/00273171.2012.710386
- Raftery, A. E. (1995). Bayesian model selection in social research. Sociological Methodology, 25, 111–163. https://doi.org/10.2307/271063
- Rappaport, L. M., Amstadter, A. B., & Neale, M. C. (2020). Model fit estimation for multilevel structural equation models. Structural Equation Modeling, 27, 318–329. https://doi.org/10.1080/10705511.2019.1620109
- Ryu, E., & West, S. G. (2009). Level-specific evaluation of model fit in multilevel structural equation modeling. Structural Equation Modeling, 16, 583–601. https://doi.org/10.1080/10705510903203466
- SAS Institute Inc. (2002). SAS/STAT® Version 9 [software]. Author.
- Schwarz, G. (1978). Estimating the dimension of a model. The Annals of Statistics, 6, 461–464. https://doi.org/10.1214/aos/1176344136
- Sclove, S. L. (1987). Application of model-selection criteria to some problems in multivariate analysis. Psychometrika, 52, 333–343. https://doi.org/10.1007/BF02294360
- Song, J., & Belin, T. R. (2008). Choosing an appropriate number of factors in factor analysis with incomplete data. Computational Statistics & Data Analysis, 52, 3560–3569. https://doi.org/10.1016/j.csda.2007.11.011
- Steiger, J. H. (1990). Structural model evaluation and modification: An interval estimation approach. Multivariate Behavioral Research, 25, 173–180. https://doi.org/10.1207/s15327906mbr2502_4
- Tein, J. Y., Coxe, S., & Cham, H. (2013). Statistical power to detect the correct number of classes in latent profile analysis. Structural Equation Modeling, 20, 640–657. https://doi.org/10.1080/10705511.2013.824781
- Thompson, B. (2004). Exploratory and confirmatory factor analysis: Understanding concepts and applications. American Psychological Association.
- Tucker, L. R., & Lewis, C. (1973). A reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38, 1–10. https://doi.org/10.1007/BF02291170
- Van de Vijver, F. J., & Poortinga, Y. H. (2002). Structural equivalence in multilevel research. Journal of Cross-Cultural Psychology, 33, 141–156. https://doi.org/10.1177/0022022102033002002
- Vrieze, S. I. (2012). Model selection and psychological theory: A discussion of the differences between the Akaike information criterion (AIC) and the Bayesian information criterion (BIC). Psychological Methods, 17, 228–243. https://doi.org/10.1037/a0027127
- Wu, J. Y., & Kwok, O. M. (2012). Using SEM to analyze complex survey data: A comparison between design-based single-level and model-based multilevel approaches. Structural Equation Modeling, 19, 16–35. https://doi.org/10.1080/10705511.2012.634703
- Yang, Y., & Xia, Y. (2015). On the number of factors to retain in exploratory factor analysis for ordered categorical data. Behavior Research Methods, 47, 756–772. https://doi.org/10.3758/s13428-014-0499-2
- Yuan, K. H., & Bentler, P. M. (2007). Multilevel covariance structure analysis by fitting multiple single-level models. Sociological Methodology, 37, 53–82. https://doi.org/10.1111/j.1467-9531.2007.00182.x
- Yuan, K. H., Chan, W., Marcoulides, G. A., & Bentler, P. M. (2016). Assessing structural equation models by equivalence testing with adjusted fit indexes. Structural Equation Modeling, 23, 319–330. https://doi.org/10.1080/10705511.2015.1065414