Assessing Fit in Ordinal Factor Analysis Models: SRMR vs. RMSEA

References

• Asparouhov, T., & Muthén, B. (2010). Simple second order chi-square correction scaled chi-square statistics (Technical appendix). Retrieved from https://www.statmodel.com/download/WLSMV_new_chi21.pdf
   Google Scholar
• Bandalos, D. L. (2014). Relative performance of categorical diagonally weighted least squares and robust maximum likelihood estimation. Structural Equation Modeling, 21, 102–116. doi:10.1080/10705511.2014.859510
   Web of Science ®Google Scholar
• Bollen, K. A., & Long, J. S. (1993). Testing structural equation models. Newbury Park, CA: Sage.
   Google Scholar
• Box, G. E. P. (1979). Some problems of statistics and everyday life. Journal of the American Statistical Association, 74, 1–4. doi:10.1080/01621459.1979.10481600
   Web of Science ®Google Scholar
• Brosseau-Liard, P. E., & Savalei, V. (2014). Adjusting incremental fit indices for nonnormality. Multivariate Behavioral Research, 49, 460–470. doi:10.1080/00273171.2014.933697
   PubMed Web of Science ®Google Scholar
• Brosseau-Liard, P. E., Savalei, V., & Li, L. (2012). An investigation of the sample performance of two nonnormality corrections for RMSEA. Multivariate Behavioral Research, 47, 904–930. doi:10.1080/00273171.2012.715252
   PubMed Web of Science ®Google Scholar
• Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 136–162). Newbury Park, CA: Sage.
   Google Scholar
• Chang, E. C., D’Zurilla, T. J., & Maydeu-Olivares, A. (1994). Assessing the dimensionality of optimism and pessimism using a multimeasure approach. Cognitive Therapy and Research, 18, 143–160. doi:10.1007/BF02357221
   Web of Science ®Google Scholar
• Chang, L., & McBride-Chang, C. (1996). The factor structure of the life orientation test. Educational and Psychological Measurement, 56, 325–329. doi:10.1177/0013164496056002013
   Web of Science ®Google Scholar
• Chen, F., Curran, P. J., Bollen, K. A., Kirby, J., & Paxton, P. (2008). An empirical evaluation of the use of fixed cutoff points in RMSEA test statistic in structural equation models. Sociological Methods & Research, 36, 462–494. doi:10.1177/0049124108314720
   PubMed Web of Science ®Google Scholar
• Curran, P. J., Bollen, K. A., Chen, F., Paxton, P., & Kirby, J. B. (2003). Finite sampling properties of the point estimates and confidence intervals of the RMSEA. Sociological Methods & Research, 32, 208–252. doi:10.1177/0049124103256130
   Web of Science ®Google Scholar
• DiStefano, C., & Morgan, G. B. (2014). A comparison of diagonal weighted least squares robust estimation techniques for ordinal data. Structural Equation Modeling, 21, 425–438. doi:10.1080/10705511.2014.915373
   Web of Science ®Google Scholar
• Fan, X., Thompson, B., & Wang, L. (1999). Effects of sample size, estimation methods, and model specification on structural equation modeling fit indexes. Structural Equation Modeling, 6, 56–83. doi:10.1080/10705519909540119
   Web of Science ®Google Scholar
• Forero, C. G., Maydeu-Olivares, A., & Gallardo-Pujol, D. (2009). Factor analysis with ordinal indicators: A monte carlo study comparing DWLS and ULS estimation. Structural Equation Modeling, 16, 625–641. doi:10.1080/10705510903203573
   Web of Science ®Google Scholar
• Hancock, G. R., Stapleton, L. M., & Mueller, R. O. (2018). The reviewer’s guide to quantitative methods (2nd ed.). New York, NY: Routledge.
   Google Scholar
• Hu, L., & Bentler, P. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3, 424–453. doi:10.1037/1082-989X.3.4.424
   Web of Science ®Google Scholar
• Jöreskog, K. G., & Sörbom, D. (1988). LISREL 7. A guide to the program and applications (2nd ed.). Chicago, IL: International Education Services.
   Google Scholar
• Kenny, D. A., Kaniskan, B., & McCoach, D. B. (2015). The performance of RMSEA in models with small degrees of freedom. Sociological Methods & Research, 44, 486–507. doi:10.1177/0049124114543236
   Web of Science ®Google Scholar
• Kenny, D. A., & McCoach, D. B. (2003). Effect of the number of variables on measures of fit in structural equation modeling. Structural Equation Modeling, 10, 333–351. doi:10.1207/S15328007SEM1003_1
   Web of Science ®Google Scholar
• MacCallum, R. C. (2003). Working with imperfect models. Multivariate Behavioral Research, 38(1), 113–139. doi:10.1207/S15327906MBR3801_5
   PubMed Web of Science ®Google Scholar
• Marsh, H., Hau, K., & Grayson, D. (2005). Goodness of fit in structural equation models. In A. Maydeu-Olivares & J. J. Mcardle (Eds.), Contemporary psychometrics: A festschrift for Roderick P. McDonald (pp. 275–340). Mahwah, NJ: Erlbaum.
   Google Scholar
• Marshall, G. N., Wortman, C. B., Kusulas, J. W., Hervig, L. K., & Vickers, R. R. (1992). Distinguishing optimism from pessimism: Relations to fundamental dimensions of mood and personality. Journal of Personality and Social Psychology, 62, 1067–1074. doi:10.1037/0022-3514.62.6.1067
   Web of Science ®Google Scholar
• Maydeu-Olivares, A. (2005). Linear item response theory, nonlinear item response theory, and factor analysis: A unified framework. In A. Maydeu-Olivares & J. J. McArdle (Eds.), Contemporary psychometrics. A festschrift for Roderick P. McDonald (pp. 73–100). Mahwah, NJ: Lawrence Erlbaum.
   Google Scholar
• Maydeu-Olivares, A. (2017). Assessing the size of model misfit in structural equation models. Psychometrika, 82, 533–558. doi:10.1007/s11336-016-9552-7
   Web of Science ®Google Scholar
• Maydeu-Olivares, A., Cai, L., & Hernández, A. (2011). Comparing the fit of item response theory and factor analysis models. Structural Equation Modeling, 18, 333–356. doi:10.1080/10705511.2011.581993
   Web of Science ®Google Scholar
• Maydeu-Olivares, A., Fairchild, A. J., & Hall, A. G. (2017). Goodness of fit in item factor analysis: Effect of the number of response alternatives. Structural Equation Modeling, 24, 495–505. doi:10.1080/10705511.2017.1289816
   Web of Science ®Google Scholar
• Maydeu-Olivares, A., Shi, D., & Rosseel, Y. (2018). Assessing fit in structural equation models: A monte-carlo evaluation of RMSEA versus SRMR confidence intervals and tests of close fit. Structural Equation Modeling, 25, 389–402. doi:10.1080/10705511.2017.1389611
   Web of Science ®Google Scholar
• McDonald, R. P., & Ho, M.-H. R. (2002). Principles and practice in reporting structural equation analyses. Psychological Methods, 7, 64–82. doi:10.1037//1082-989X.7.1.64
   PubMed Web of Science ®Google Scholar
• Muthén, B. (1978). Contributions to factor analysis of dichotomous variables. Psychometrika, 43, 551–560. doi:10.1007/BF02293813
   Web of Science ®Google Scholar
• Muthén, B. (1984). A general structural equation model with dichotomous, ordered categorical, and continuous latent variable indicators. Psychometrika, 49, 115–132. doi:10.1007/BF02294210
   Web of Science ®Google Scholar
• Muthén, B. (1993). Goodness of fit with categorical and other nonnormal variables. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 205–234). Newbury Park, CA: Sage.
   Google Scholar
• Muthén, B., & Kaplan, D. (1992). A comparison of some methodologies for the factor analysis of non-normal Likert variables: A note on the size of the model. British Journal of Mathematical and Statistical Psychology, 45, 19–30. doi:10.1111/j.2044-8317.1992.tb00975.x
   Web of Science ®Google Scholar
• Muthén, B. O., Toit, S. H. C., & Spisic, D. (1997). Robust inference using weighted least squares and quadratic estimating equations in latent variable modeling with categorical and continuous outcomes. Retrieved from http://pages.gseis.ucla.edu/faculty/muthen/articles/Article_075.pdf
   Google Scholar
• Muthén, L. K., & Muthén, B. (2017). MPLUS 8 [computer program]. Los Angeles, CA: Muthén & Muthén.
   Google Scholar
• Nasser, F., & Wisenbaker, J. (2003). A monte carlo study investigating the impact of item parceling on measures of fit in confirmatory factor analysis. Educational and Psychological Measurement, 63, 729–757. doi:10.1177/0013164403258228
   Web of Science ®Google Scholar
• Nevitt, J., & Hancock, G. R. (2000). Improving the root mean square error of approximation for nonnormal conditions in structural equation modeling. The Journal of Experimental Education, 68, 251–268. doi:10.1080/00220970009600095
   Web of Science ®Google Scholar
• Olsson, U. (1979). Maximum likelihood estimation of the polychoric correlation coefficient. Psychometrika, 44, 443–460. doi:10.1007/BF02296207
   Web of Science ®Google Scholar
• Pornprasertmanit, S., Miller, P., & Schoemann, A. (2013). simsem: Simulated structural equation modeling. R Package Version 0.5-3.
   Google Scholar
• R Development Core Team. (2018). R: A language and environment for statistical computing. Vienna, Austria. Available online at https://www.R-project.org/.
   Google Scholar
• Rhemtulla, M., Brosseau-Liard, P. É & Savalei, V. (2012). When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions. Psychological Methods, 17, 354–373. doi:10.1037/a0029315
   PubMed Web of Science ®Google Scholar
• Robinson-Whelen, S., Kim, C., MacCallum, R. C., & Kiecolt-Glaser, J. K. (1997). Distinguishing optimism from pessimism in older adults: Is it more important to be optimistic or not to be pessimistic?. Journal of Personality and Social Psychology, 73, 1345–1353. doi:10.1037/0022-3514.73.6.1345
   PubMed Web of Science ®Google Scholar
• Rosseel, Y. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48, 1–36. doi:10.18637/jss.v048.i02
   Web of Science ®Google Scholar
• Saris, W. E., Satorra, A., & van der Veld, W. M. (2009). Testing structural equation models or detection of misspecifications? Structural Equation Modeling, 16, 561–582. doi:10.1080/10705510903203433
   Web of Science ®Google Scholar
• Satorra, A., & Bentler, P. M. (1994). Corrections to test statistics and standard errors in covariance structure analysis. In A. Von Eye & C. C. Clogg (Eds.), Latent variable analysis. Applications for developmental research (pp. 399–419). Thousand Oaks, CA: Sage.
   Google Scholar
• Savalei, V. (2012). The relationship between root mean square error of approximation and model misspecification in confirmatory factor analysis models. Educational and Psychological Measurement, 72, 910–932. doi:10.1177/0013164412452564
   Web of Science ®Google Scholar
• Savalei, V. (2018). On the computation of the rmsea and cfi from the mean-and-variance corrected test statistic with nonnormal data in sem. Multivariate Behavioral Research, 53, 419–429. doi: 10.1080/00273171.2018.1455142
   PubMed Web of Science ®Google Scholar
• Savalei, V., & Rhemtulla, M. (2013). The performance of robust test statistics with categorical data. British Journal of Mathematical and Statistical Psychology, 66, 201–223. doi:10.1111/bmsp.2013.66.issue-2
   PubMed Web of Science ®Google Scholar
• Scheier, M. F., & Carver, C. S. (1985). Optimism, coping, and health: Assessment and implications of generalized outcome expectancies. Health Psychology, 4, 219–247. doi:10.1037/0278-6133.4.3.219
   PubMed Web of Science ®Google Scholar
• Shi, D., DiStefano, C., McDaniel, H. L., & Jiang, Z. (2018). Examining chi-square test statistics under conditions of large model size and ordinal data. Structural Equation Modeling, 25, 924–945. doi: 10.1080/10705511.2018.1449653
   Web of Science ®Google Scholar
• Shi, D., Lee, T., & Maydeu-Olivares, A. (2019). Understanding the model size effect on SEM fit indices. Educational and Psychological Measurement, 79, 310–334. doi: 10.1177/0013164418783530
   PubMed Web of Science ®Google Scholar
• Shi, D., Lee, T., & Terry, R. A. (2015). Abstract: Revisiting the model size effect in structural equation modeling (SEM). Multivariate Behavioral Research, 50, 142–142. doi: 10.1080/00273171.2014.989012
   PubMed Web of Science ®Google Scholar
• Shi, D., Lee, T., & Terry, R. A. (2018). Revisiting the model size effect in structural equation modeling. Structural Equation Modeling, 25, 21–40. doi: 10.1080/10705511.2017.1369088
   Web of Science ®Google Scholar
• Shi, D., Maydeu-Olivares, A., & DiStefano, C. (2018). The relationship between the standardized root mean square residual and model misspecification in factor analysis models. Multivariate Behavioral Research, 1–19. doi:10.1080/00273171.2018.1476221
   PubMed Web of Science ®Google Scholar
• Steiger, J. H. (1989). EzPATH: A supplementary module for SYSTAT and SYGRAPH. Evanston, IL: Systat, Inc.
   Google Scholar
• Steiger, J. H. (1990). Structural model evaluation and modification: An interval estimation approach. Multivariate Behavioral Research, 25, 173–180. doi:10.1207/s15327906mbr2502_4
   PubMed Web of Science ®Google Scholar
• Steiger, J. H., & Lind, J. C. (1980). Statistically-based tests for the number of common factors. Iowa: Paper presented at the Annual Meeting of the Psychometric Society. Iowa City, IA.
   Google Scholar
• Xia, Y. (2016). Investigating the chi-square-based model-fit indexes for WLSMV and ULSMV estimators. Unpublished doctoral dissertation. Florida State University.
   Google Scholar