Common Factor Analysis versus Principal Component Analysis: A Comparison of Loadings by Means of Simulations

References

• Anderson, T.W., Rubin, H. (1956). Statistical inference in factor analysis. In: Neyman J., ed., Proceedings of the Third Berkeley Symposium on Mathematical Statistics and Probability, Vol. 45, pp. 111–150.
   Google Scholar
• Beauducel, A. (2001). On the generalizability of factors: The influence of changing contexts of variables on different methods of factor extraction. Methods of Psychological Research Online 6:69–96.
   Google Scholar
• Bentler, P.M., Kano, Y. (1990). On the equivalence of factors and components. Multivariate Behavioral Research 25:67–74.
   PubMed Web of Science ®Google Scholar
• Bernaards, C.A., Jennrich, R.I. (2005). Gradient projection algorithms and software for arbitrary rotation criteria in factor analysis. Educational and Psychological Measurement 65:676–696.
   Web of Science ®Google Scholar
• Bookstein, F.L. (1990). Least squares and latent variables. Multivariate Behavioral Research 25:75–80.
   PubMed Web of Science ®Google Scholar
• Borsboom, D., Mellenbergh, G.J., Van Heerden, J. (2003). The theoretical status of latent variables. Psychological Review 110:203–219.
   PubMed Web of Science ®Google Scholar
• Conway, J.M., Huffcutt, A.I. (2003). A review and evaluation of exploratory factor analysis practices in organizational research. Organizational Research Methods 6:147–168.
   Web of Science ®Google Scholar
• Costello, A.B., Osborne, J.W. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research & Evaluation 10.
   Google Scholar
• De Winter, JF.. C.F., Dodou, D. (2012). Factor recovery by principal axis factoring and maximum likelihood factor analysis as a function of factor pattern and sample size. Journal of Applied Statistics 39:695–710.
   Web of Science ®Google Scholar
• De Winter, JF. C.F., Dodou, D., Wieringa, P.A. (2009). Exploratory factor analysis with small sample sizes. Multivariate Behavioral Research 44:147–181.
   PubMed Web of Science ®Google Scholar
• DiStefano, C., Zhu, M., Mîndrilã, D. (2009). Understanding and using factor scores: Considerations for the applied researcher. Practical Assessment, Research & Evaluation 14.
   Google Scholar
• Everett, J.E. (1983). Factor comparability as a means of determining the number of factors and their rotation. Multivariate Behavioral Research 18:197–218.
   PubMed Web of Science ®Google Scholar
• Fabrigar, L.R., Wegener, D.T., MacCallum, R.C., Strahan, E.J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods 4:272–299.
   Web of Science ®Google Scholar
• Fava, J.L., Velicer, W.F. (1992a). An empirical comparison of factor, image, component, and scale scores. Multivariate Behavioral Research 27:301–322.
   PubMed Web of Science ®Google Scholar
• Fava, J.L., Velicer, W.F. (1992b). The effects of overextraction on factor and component analysis. Multivariate Behavioral Research 27:387–415.
   PubMed Web of Science ®Google Scholar
• Fava, J.L., Velicer, W.F. (1996). The effects of underextraction in factor and component analyses. Educational and Psychological Measurement 56:907–929.
   Web of Science ®Google Scholar
• Floyd, F.J., Widaman, K.F. (1995). Factor analysis in the development and refinement of clinical assessment instruments. Psychological Assessment 7:286–299.
   Web of Science ®Google Scholar
• Ford, J.K., MacCallum, R.C., Tait, M. (1986). The application of exploratory factor analysis in applied psychology: A critical review and analysis. Personnel Psychology 39:291–314.
   Web of Science ®Google Scholar
• Glass, G.V., Taylor, P.A. (1966). Factor analytic methodology. Review of Educational Research 36:566–587.
   Web of Science ®Google Scholar
• Goldberg, L.R. (1990). An alternative “description of personality”: The Big Five factor structure. Personality Processes and Individual Differences 59:1216–1229.
   PubMed Web of Science ®Google Scholar
• Gorsuch, R.L. (1990). Common factor analysis versus component analysis: Some well and little known facts. Multivariate Behavioral Research 25:33–39.
   PubMed Web of Science ®Google Scholar
• Gorsuch, R.L. (2003). Factor analysis. In: Schinka, J.A., Velicer, F. eds., Handbook of Psychology: Vol. 2. Research Methods in Psychology. Hoboken, NJ: John Wiley, pp. 143–164.
   Google Scholar
• Gower, J.C. (1966). Some distance properties of latent root and vector methods used in multivariate analysis. Biometrika 53:325–338.
   Web of Science ®Google Scholar
• Grice, J.W. (2001). Computing and evaluating factor scores. Psychological Methods 6:430–450.
   PubMed Web of Science ®Google Scholar
• Henson, R.K., Roberts, J.K. (2006). Use of exploratory factor analysis in published research: Common errors and some comment on improved practice. Educational and Psychological Measurement 66:393–416.
   Web of Science ®Google Scholar
• Hong, S. (1999). Generating correlation matrices with model error for simulation studies in factor analysis: A combination of the Tucker-Koopman-Linn model and Wijsman's algorithm. Behavior Research Methods, Instruments, & Computers 31:727–730.
   PubMedGoogle Scholar
• Indeterminacy. (1996). [Special commentary section]. Multivariate Behavioral Research 31:517–689.
   PubMed Web of Science ®Google Scholar
• Jensen, A.R. (1983). The definition of intelligence and factor-score indeterminacy. The Behavioral and Brain Sciences 6:313–315.
   Web of Science ®Google Scholar
• Jensen, A.R., Weng, L.-J. (1994). What is a good g? Intelligence 18:231–258.
   Web of Science ®Google Scholar
• Johnson, W., Bouchard, T.J. , Jr., Krueger, R.F., McGue, M., Gottesman, I.I. (2004). Just one g: Consistent results from three test batteries. Intelligence 32:95–107.
   Web of Science ®Google Scholar
• Jolliffe, I.T. (2002). Principal Component Analysis 2nd ed. New York: Springer.
   Google Scholar
• Kaiser, H.F., Dickman, K. (1962). Sample and population score matrices and sample correlation matrices from an arbitrary population correlation matrix. Psychometrika 27:179–182.
   Web of Science ®Google Scholar
• Kaplunovsky, A.S. (2005). Factor analysis in environmental studies. HAIT Journal of Science and Engineering B 2:54–94.
   Google Scholar
• Lawrence, F.R., Hancock, G.R. (1999). Conditions affecting integrity of a factor solution under varying degrees of overextraction. Educational and Psychological Measurement 59:549–579.
   Web of Science ®Google Scholar
• Loehlin, J.C. (1990). Component analysis versus common factor analysis: A case of disputed authorship. Multivariate Behavioral Research 25:29–31.
   PubMed Web of Science ®Google Scholar
• MacCallum, R.C., Tucker, L.R. (1991). Representing sources of error in the common-factor model: Implications for theory and practice. Psychological Bulletin 109:502–511.
   Web of Science ®Google Scholar
• MacCallum, R.C., Widaman, K.F., Zhang, S., Hong, S. (1999). Sample size in factor analysis. Psychological Methods 4:84–99.
   Web of Science ®Google Scholar
• MacCallum, R.C., Widaman, K.F., Preacher, K.J., Hong, S. (2001). Sample size in factor analysis: The role of model error. Multivariate Behavioral Research 36:611–637.
   PubMed Web of Science ®Google Scholar
• Maraun, M.D. (1996). Metaphor taken as math: indeterminancy in the factor analysis model. Multivariate Behavioral Research 31:517–538.
   PubMed Web of Science ®Google Scholar
• McArdle, J.J. (1990). Principles versus principals of structural factor analyses. Multivariate Behavioral Research 25:81–87.
   PubMed Web of Science ®Google Scholar
• McCloy, C.H., Metheny, A., Knott, V. (1938). A comparison of the Thurnstone method of multiple factors with the Hotelling method of principal components. Psychometrika 3:61–67.
   Google Scholar
• Mulaik, S.A. (1987). A brief history of the philosophical foundations of exploratory factor analysis. Multivariate Behavioral Research 22:267–305.
   PubMed Web of Science ®Google Scholar
• Mulaik, S.A. (1990). Blurring the distinction between component analysis and common factor analysis. Multivariate Behavioral Research 25:53–59.
   PubMed Web of Science ®Google Scholar
• Mulaik, S.A. (2010). Foundations of Factor Analysis. 2nd ed. Boca Raton, FL: Chapman and Hall/CRC.
   Google Scholar
• Ogasawara, H. (2000). Some relationships between factors and components. Psychometrika 65:167–185.
   Web of Science ®Google Scholar
• Ogasawara, H. (2003). Oblique factors and components with independent clusters. Psychometrika 68:299–321.
   Web of Science ®Google Scholar
• Park, H.S., Dailey, R., Lemus, D. (2002). The use of exploratory factor analysis and principal components analysis in communication research. Human Communication Research 28:562–577.
   Web of Science ®Google Scholar
• Parmet, Y., Schechtman, E., Sherman, M. (2010). Factor analysis revisited—How many factors are there? Communications in Statistics—Simulation and Computation 39:1893–1908.
   Web of Science ®Google Scholar
• Paschou, P., Ziv, E., Burchard, E.G., Choudhry, S., Rodriguez-Cintron, W., Mahoney, M.W., Drineas, P. (2007). PCA-correlated SNPs for structure identification in worldwide human populations. PLoS Genetics 3:1672–1686.
   PubMed Web of Science ®Google Scholar
• Peterson, R.A. (2000). A meta-analysis of variance accounted for and factor loadings in exploratory factor analysis. Marketing Letters 11:261–275.
   Google Scholar
• Preacher, K.J., Zhang, G., Kim, C., Mels, G. (2013). Choosing the optimal number of factors in exploratory factor analysis: A model selection perspective. Multivariate Behavioral Research 48:28–56.
   PubMed Web of Science ®Google Scholar
• Rao, C.R. (1955). Estimation and tests of significance in factor analysis. Psychometrika 20:93–111.
   Web of Science ®Google Scholar
• Rao, C.R. (1996). Principal Component and Factor Analyses (No. TR-96-04). Pennsylvania State University: Center for Multivariate Analysis. Retrieved from http://www.dtic.mil/cgi-bin/GetTRDoc?AD=ADA313617
   Google Scholar
• Reich, D., Price, A.L., Patterson, N. (2008). Principal component analysis of genetic data. Nature Genetics 40:491–492.
   PubMed Web of Science ®Google Scholar
• Rozeboom, W.W. (1990). Whatever happened to broad perspective? Multivariate Behavioral Research 25:61–65.
   PubMed Web of Science ®Google Scholar
• Russell, D.W. (2002). In search of underlying dimensions: The use (and abuse) of factor analysis in Personality and Social Psychology Bulletin. Personality and Social Psychology Bulletin 28:1629–1646.
   Web of Science ®Google Scholar
• Sato, M. (1990). Some remarks on principal component analysis as a substitute for factor analysis in monofactor cases. Journal of the Japan Statistical Society 20:23–31.
   Google Scholar
• Schmidt, T.A. (2011). Current methodological considerations in exploratory and confirmatory factor analysis. Journal of Psychoeducational Assessment 29:304–321.
   Web of Science ®Google Scholar
• Schönemann, P.H. (1990). Facts, fictions, and common sense about factors and components. Multivariate Behavioral Research 25:47–51.
   PubMed Web of Science ®Google Scholar
• Schönemann, P.H., Steiger, J.H. (1978). On the validity of indeterminate factor scores. Bulletin of the Psychonomic Society 12:287–290.
   Google Scholar
• Schneeweiss, H. (1997). Factors and principal components in the near spherical case. Multivariate Behavioral Research 32:375–401.
   PubMed Web of Science ®Google Scholar
• Schneeweiss, H., Mathes, H. (1995). Factor analysis and principal components. Journal of Multivariate Analysis 55:105–124.
   Web of Science ®Google Scholar
• Snook, S.C., Gorsuch, R.L. (1989). Component analysis versus common factor analysis: A Monte Carlo study. Psychological Bulletin 106:148–154.
   Web of Science ®Google Scholar
• Steiger, J.H. (1990). Some additional thoughts on components, factors, and factor indeterminacy. Multivariate Behavioral Research 25:41–45.
   PubMed Web of Science ®Google Scholar
• Steiger, J.H. (1994). Factor analysis in the 1980's and the 1990's: Some old debates and some new developments. In: Borg, I.Ph. Mohler, P.Ph. eds., Trends and Perspectives in Empirical Social Research. Berlin: Walter de Gruyter, pp. 201–224.
   Google Scholar
• Steiger, J.H. (1996). Dispelling some myths about factor indeterminancy. Multivariate Behavioral Research 31:539–550.
   PubMed Web of Science ®Google Scholar
• Steiger, J.H. (2004). Paul Meehl and the evolution of statistical methods in psychology. Applied & Preventive Psychology 11:69–72.
   Web of Science ®Google Scholar
• Trendafilov, N.T., Unkel, S., Krzanowski, W. (2013). Exploratory factor and principal component analyses: some new aspects. Statistics and Computing 23:209–220.
   Web of Science ®Google Scholar
• Tucker, L.R. (1951). A Method for Synthesis of Factor Analysis Studies (Personnel Research Section Report No. 984). Washington, DC: Department of the Army.
   Google Scholar
• Tucker, L.R, Koopman, R.F., Linn, R.L. (1969). Evaluation of factor analytic research procedures by means of simulated correlation matrices. Psychometrika 34:421–459.
   Web of Science ®Google Scholar
• Velicer, W.F. (1974). A comparison of the stability of factor analysis, principal component analysis, and rescaled image analysis. Educational and Psychological Measurement 34:563–572.
   Web of Science ®Google Scholar
• Velicer, W.F. (1976a). Determining the number of components from the matrix of partial correlations. Psychometrika 41:321–327.
   Web of Science ®Google Scholar
• Velicer, W.F. (1976b). The relation between factor score estimates, image scores, and principal component scores. Educational and Psychological Measurement 36:149–159.
   Web of Science ®Google Scholar
• Velicer, W.F. (1977). An empirical comparison of the similarity of principal component, image, and factor patterns. The Journal of Multivariate Behavioral Research 12:3–22.
   PubMed Web of Science ®Google Scholar
• Velicer, W.F., Fava, J.L. (1987). An evaluation of the effects of variable sampling on component, image, and factor analysis. Multivariate Behavioral Research 22:193–209.
   PubMed Web of Science ®Google Scholar
• Velicer, W.F., Fava, J.L. (1998). Effects of variable and subject sampling on factor pattern recovery. Psychological Methods 3:231–251.
   Web of Science ®Google Scholar
• Velicer, W.F., Jackson, D.N. (1990a). Component analysis versus common factor analysis: Some issues in selecting an appropriate procedure. Multivariate Behavioral Research 25:1–28.
   PubMed Web of Science ®Google Scholar
• Velicer, W.F., Jackson, D.N. (1990b). Component analysis versus common factor analysis: Some further observations. Multivariate Behavioral Research 25:97–114.
   PubMed Web of Science ®Google Scholar
• Velicer, W.F., Peacock, A.C., Jackson, D.N. (1982). A comparison of component and factor patterns: A Monte Carlo approach. Multivariate Behavioral Research 17:371–388.
   PubMed Web of Science ®Google Scholar
• Widaman, K.F. (1990). Bias in pattern loadings represented by common factor analysis and component analysis. Multivariate Behavioral Research 25:89–95.
   PubMed Web of Science ®Google Scholar
• Widaman, K.F. (1993). Common factor analysis versus principal component analysis: Differential bias in representing model parameters? Multivariate Behavioral Research 28:263–311.
   PubMed Web of Science ®Google Scholar
• Widaman, K.F. (2007). Common factors versus components: Principals and principles, errors and misconceptions. In: Cudeck, R.C. MacCallum, R.C. eds., Factor Analysis at 100: Historical Developments and Future Directions, Mahwah, NJ: Lawrence Erlbaum Associates, pp. 177–203.
   Google Scholar