What Causes the Mean Bias of the Likelihood Ratio Statistic with Many Variables?

References

• Algina, J., Oshima, T. C., & Lin, W. (1994). Type I error rates for Welch’s test and James’s second-order test under nonnormality and inequality of variance when there are two groups. Journal of Educational and Behavioral Statistics, 19(3), 275–291. doi:10.3102/10769986019003275
   Web of Science ®Google Scholar
• Amemiya, Y., & Anderson, T. W. (1990). Asymptotic chi-square tests for a large class of factor analysis models. The Annals of Statistics, 18(3), 1453–1463. doi:10.1214/aos/1176347760
   Web of Science ®Google Scholar
• Anderson, J. C., & Gerbing, D. W. (1984). The effect of sampling error on convergence, improper solutions, and goodness-of-fit indices for maximum likelihood confirmatory factor analysis. Psychometrika, 49(2), 155–173. doi:10.1007/BF02294170
   Web of Science ®Google Scholar
• Bartlett, M. S. (1951). The effect of standardization on a χ2 approximation in factor analysis. Biometrika, 38, 337–344. doi:10.1093/biomet/38.3-4.337
   Web of Science ®Google Scholar
• Bentler, P. M. (2006). EQS 6 structural equations program manual. Encino, CA: Multivariate Software.
   Google Scholar
• Bentler, P. M., & Chou, C.-P. (1987). Practical issues in structural modeling. Sociological Methods & Research, 16, 78–117. doi:10.1177/0049124187016001004
   Web of Science ®Google Scholar
• Bentler, P. M., & Yuan, K.-H. (1999). Structural equation modeling with small samples: Test statistics. Multivariate Behavioral Research, 34(2), 181–197. doi:10.1207/S15327906Mb340203
   PubMed Web of Science ®Google Scholar
• Bollen, K. A., & Stine, R. (1992). Bootstrapping goodness-of-fit measures in structural equation models. Sociological Methods & Research, 21(2), 205–229. doi:10.1177/0049124192021002004
   Web of Science ®Google Scholar
• Box, G. E. P., & Cox, D. R. (1964). An analysis of transformations. Journal of the Royal Statistical Society B, 26(2), 211–252. doi: 10.1.1.321.3819
   Google Scholar
• Burden, R. L., & Faires, D. J. (2005). Numerical analysis (8th ed.). Belmont, CA: Thomson Brooks Cole Publishing.
   Google Scholar
• Chen, S. X., Zhang, L.-X., & Zhong, P.-S. (2010). Tests for high-dimensional covariance matrices. Journal of the American Statistical Association, 105(490), 810–819. doi:10.1198/jasa.2010.tm09560
   Web of Science ®Google Scholar
• Efron, B., & Tibshirani, R. J. (1993). An introduction to the bootstrap. New York: Chapman & Hall. doi:10.1137/1036171
   Google Scholar
• Fouladi, R. T. (2000). Performance of modified test statistics in covariance and correlation structure analysis under conditions of multivariate nonnormality. Structural Equation Modeling, 7(3), 356–410. doi:10.1207/S15328007SEM0703_2
   Web of Science ®Google Scholar
• Gerbing, D. W., & Anderson, J. C. (1985). The effects of sampling error and model characteristics on parameter estimation for maximum likelihood confirmatory factor analysis. Multivariate Behavioral Research, 20(3), 255–271. doi:10.1207/s15327906mbr2003_2
   PubMed Web of Science ®Google Scholar
• Gorsuch, R. L. (1983). Factor analysis (2nd ed.). Hillsdale, NJ: Erlbaum.
   Google Scholar
• Harman, H. H. (1976). Modern factor analysis (3rd ed.). Chicago, IL: University of Chicago Press. doi:10.1002/bimj.19700120119
   Google Scholar
• Hastie, T., Tibshirani, R., & Friedman, J. (2009). The elements of statistical learning (2nd. ed.). New York: Springer. doi: 10.1007/978-0-387-84858-7.
   Google Scholar
• Holzinger, K., & Swineford, F. (1939). A study in factor analysis: The stability of a bifactor solution (Supplementary Educational Monograph no. 48). Chicago, IL: University of Chicago Press. doi:10.1086/457783
   Google Scholar
• Hu, L.-T., & Bentler, P. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3(4), 424–453. doi:10.1037/1082-989X.3.4.424
   Web of Science ®Google Scholar
• Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55. doi:10.1080/10705519909540118
   Web of Science ®Google Scholar
• Hu, L. T., Bentler, P. M., & Kano, Y. (1992). Can test statistics in covariance structure analysis be trusted? Psychological Bulletin, 112(2), 351–362. doi:10.1037/0033-2909.112.2.351
   PubMed Web of Science ®Google Scholar
• Huang, P.-H., Chen, H., & Weng, L.-J. (2017). A penalized likelihood method for structural equation modeling. Psychometrika, 82(2), 329–354. doi:10.1007/s11336-017-9566-9
   PubMed Web of Science ®Google Scholar
• Jackson, D. L. (2001). Sample size and number of parameter estimates in maximum likelihood confirmatory factor analysis: A Monte Carlo investigation. Structural Equation Modeling, 8(2), 205–223. doi:10.1207/S15328007SEM0802_3
   Web of Science ®Google Scholar
• Jackson, D. L. (2003). Revisiting sample size and number of parameter estimates: Some support for the N:q hypothesis. Structural Equation Modeling, 10(1), 128–141. doi:10.1207/S15328007SEM1001_6
   Web of Science ®Google Scholar
• Jöreskog, K. G. (1969). A general approach to confirmatory maximum likelihood factor analysis. Psychometrika, 34(2), 183–202. doi:10.1007/BF02289343
   Web of Science ®Google Scholar
• Lawley, D. N. (1956). A general method for approximating to the distribution of likelihood ratio criteria. Biometrika, 43(3-4), 295–303. doi:10.1093/biomet/43.3-4.295
   Web of Science ®Google Scholar
• Lawley, D. N., & Maxwell, A. E. (1971). Factor analysis as a statistical method (2nd ed.). New York: American Elsevier. doi:10.1177/001316447603600256
   Google Scholar
• Ledoit, O., & Wolf, M. (2002). Some hypothesis tests for the covariance matrix when the dimension is large compare to the sample size. The Annals of Statistics, 30, 1081–1102. doi:10.1214/aos/1031689018
   Web of Science ®Google Scholar
• Mardia, K. V. (1970). Measure of multivariate skewness and kurtosis with applications. Biometrika, 57(3), 519–530. doi:10.1093/biomet/57.3.519
   Web of Science ®Google Scholar
• Marsh, H. W., Hau, K.-T., Balla, J. R., & Grayson, D. (1998). Is more ever too much? The number of indicators per factor in confirmatory factor analysis. Multivariate Behavioral Research, 33(2), 181–220. doi:10.1207/s15327906mbr3302_1
   PubMed Web of Science ®Google Scholar
• Mooijaart, A., & Bentler, P. M. (1991). Robustness of normal theory statistics in structural equation models. Statistica Neerlandica, 45(2), 159–171. doi:10.1111/j.1467-9574.1991.tb01301.x
   Google Scholar
• Moshagen, M. (2012). The model size effect in SEM: Inflated goodness-of-fit statistics are due to the size of the covariance matrix. Structural Equation Modeling, 19(1), 86–98. doi:10.1080/10705511.2012.634724
   Web of Science ®Google Scholar
• Nevitt, J., & Hancock, G. R. (2004). Evaluating small sample approaches for model test statistics in structural equation modeling. Multivariate Behavioral Research, 39(3), 439–478. doi:10.1207/S15327906MBR3903_3
   Web of Science ®Google Scholar
• Polansky, A. M. (2000). Stabilizing bootstrap-t confidence intervals for small samples. Canadian Journal of Statistics, 28(3), 501–516. doi:10.2307/3315961
   Web of Science ®Google Scholar
• Satorra, A., & Bentler, P. M. (1988). Scaling corrections for chi-square statistics in covariance structure analysis. In American Statistical Association 1988 Proceedings of Business and Economics Sections (pp. 308–313). Alexandria, VA: American Statistical Association.
   Google Scholar
• Satorra, A., & Bentler, P. M. (1994). Corrections to test statistics and standard errors in covariance structure analysis. In A. von Eye & C. C. Clogg (Eds.), Latent variables analysis: Applications for developmental research (pp. 399–419). Newbury Park, CA: Sage.
   Google Scholar
• Schott, J. R. (2007). A test for the equality of covariance matrices when the dimension is large relative to the sample size. Computational Statistics & Data Analysis, 51, 6535–6542. doi:10.1016/j.csda.2007.03.004
   Web of Science ®Google Scholar
• Shapiro, A., & Browne, M. (1987). Analysis of covariance structures under elliptical distributions. Journal of the American Statistical Association, 82(400), 1092–1097. doi:10.1080/01621459.1987.10478544
   Web of Science ®Google Scholar
• Shi, D., Lee, T., & Terry, R. A. (2018). Revisiting the model size effect in structural equation modeling. Structural Equation Modeling, 25(1), 21–40. doi:10.1080/10705511.2017.1369088
   Web of Science ®Google Scholar
• Sörbom, D. (1989). Model modification. Psychometrika, 54(3), 371–384. doi:10.1007/BF02294623
   Web of Science ®Google Scholar
• Srivastava, M. S., & Yanagihara, H. (2010). Testing the equality of several covariance matrices with fewer observations than the dimension. Journal of Multivariate Analysis, 101(6), 1319–1329. doi:10.1016/j.jmva.2009.12.010
   Web of Science ®Google Scholar
• Srivastava, M. S., Yanagihara, H., & Kubokawa, T. (2014). Tests for covariance matrices in high dimension with less sample size. Journal of Multivariate Analysis, 130, 289–309. doi:10.1016/j.jmva.2014.06.003
   Web of Science ®Google Scholar
• Swain, A. J. (1975). Analysis of parametric structures for variance matrices. Doctoral dissertation, University of Adelaide, Australia.
   Google Scholar
• Tanaka, J. S. (1987). “How big is big enough?”: Sample size and goodness of fit in structural equation models with latent variables. Child Development, 58(1), 134–146. doi:10.2307/1130296
   Web of Science ®Google Scholar
• Yanagihara, H., & Yuan, K.-H. (2005). Four improved statistics for contrasting means by correcting skewness and kurtosis. British Journal of Mathematical and Statistical Psychology, 58(2), 209–237. doi:10.1348/000711005X64060
   PubMedGoogle Scholar
• Yuan, K.-H. (2005). Fit indices versus test statistics. Multivariate Behavioral Research, 40(1), 115–148. doi:10.1207/s15327906mbr4001_5
   PubMed Web of Science ®Google Scholar
• Yuan, K.-H., & Bentler, P. M. (1998). Normal theory based test statistics in structural equation modeling. British Journal of Mathematical and Statistical Psychology, 51(2), 289–309. doi:10.1111/j.2044-8317.1998.tb00682.x
   PubMed Web of Science ®Google Scholar
• Yuan, K.-H., & Bentler, P. M. (1999). On normal theory and associated test statistics in covariance structure analysis under two classes of nonnormal distributions. Statistica Sinica, 9, 831–853. Retrieved from http://www3.stat.sinica.edu.tw/statistica/oldpdf/A9n311.pdf.
   Web of Science ®Google Scholar
• Yuan, K.-H., Bentler, P. M., & Zhang, W. (2005). The effect of skewness and kurtosis on mean and covariance structure analysis: The univariate case and its multivariate implication. Sociological Methods & Research, 34, 249–258. doi:10.1177/0049124105280200
   Web of Science ®Google Scholar
• Yuan, K.-H., & Chan, W. (2008). Structural equation modeling with near singular covariance matrices. Computational Statistics & Data Analysis, 52, 4842–4858. doi:10.1016/j.csda.2008.03.030
   Web of Science ®Google Scholar
• Yuan, K.-H., Jiang, G., & Yang, M. (2018). Mean and mean-and-variance corrections with big data. Structural Equation Modeling, 25(2), 214–229. doi:10.1080/10705511.2017.1379012
   Web of Science ®Google Scholar
• Yuan, K.-H., & Marshall, L. L. (2004). A new measure of misfit for covariance structure models. Behaviormetrika, 31(1), 67–90. doi:10.2333/bhmk.31.67
   Google Scholar
• Yuan, K.-H., Tian, Y., & Yanagihara, H. (2015). Empirical correction to the likelihood ratio statistic for structural equation modeling with many variables. Psychometrika, 80(2), 379–405. doi:10.1007/s11336-013-9386-5
   PubMed Web of Science ®Google Scholar
• Yuan, K.-H., Yang, M., & Jiang, G. (2017). Empirically corrected rescaled statistics for SEM with small N and large. Multivariate Behavioral Research, 52(6), 673–698. p. doi:10.1080/00273171.2017.1354759
   PubMed Web of Science ®Google Scholar
• Yung, Y. F., & Bentler, P. M. (1996). Bootstrapping techniques in analysis of mean and covariance structures. In G. A. Marcoulides and R. E. Schumacker (Eds), Advanced structural equation modeling: Techniques and issues (pp. 195–226). Hillsdale, NJ: Lawrence Erlbaum.
   Google Scholar