On the Performance of Different Regularization Methods in Bifactor-(S-1) Models with Explanatory Variables—Caveats, Recommendations, and Future Directions

References

• Bezanson, J., Edelman, A., Karpinski, S., & Shah, V. B. (2017). Julia: A fresh approach to numerical computing. SIAM Review, 59, 65–98. https://doi.org/10.1137/141000671
   Web of Science ®Google Scholar
• Brandmaier, A. M., & Jacobucci, R. C. (in press). Machine-learning approaches to structural equation modeling. In R. H. Hoyle (Ed.), Handbook of structural equation modeling (2nd rev. ed.). New York: Guilford Press.
   Google Scholar
• Brandmaier, A. M., Prindle, J. J., McArdle, J. J., & Lindenberger, U. (2016). Theory-guided exploration with structural equation model forests. Psychological Methods, 21, 566–582. https://doi.org/10.1037/met0000090
   PubMed Web of Science ®Google Scholar
• Bullain, S., & Doody, R. (2020). What works and what does not work in Alzheimer’s disease? From interventions on risk factors to anti‐amyloid trials. Journal of Neurochemistry, 155, 120–136. https://doi.org/10.1111/jnc.15023
   PubMed Web of Science ®Google Scholar
• Burns, G. L., Geiser, C., Servera, M., Becker, S. P., & Beauchaine, T. P. (2020). Application of the bifactor S–1 model to multisource ratings of ADHD/ODD symptoms: An appropriate bifactor model for symptom ratings. Journal of Abnormal Child Psychology, 48, 881–894. https://doi.org/10.1007/s10802-019-00608-4
   PubMed Web of Science ®Google Scholar
• Chanal, J., & Guay, F. (2015). Are autonomous and controlled motivations school-subjects-specific? PloS One, 10, e0134660. https://doi.org/10.1371/journal.pone.0134660
   PubMed Web of Science ®Google Scholar
• Chzhen, E., Hebiri, M., & Salmon, J. (2019). On lasso refitting strategies. Bernoulli, 25, 3175–3200. https://doi.org/10.3150/18-BEJ1085
   Web of Science ®Google Scholar
• Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Routledge. https://doi.org/10.4324/9780203771587
   Google Scholar
• Danay, E., & Ziegler, M. (2011). Is there really a single factor of personality? A multirater approach to the apex of personality. Journal of Research in Personality, 45, 560–567. https://doi.org/10.1016/j.jrp.2011.07.003
   Web of Science ®Google Scholar
• Eid, M. (2020). Multi-faceted constructs in abnormal psychology: Implications of the bifactor S-1 model for individual clinical assessment. Journal of Abnormal Child Psychology, 48, 895–900. https://doi.org/10.1007/s10802-020-00624-9
   PubMed Web of Science ®Google Scholar
• Eid, M., Geiser, C., Koch, T., & Heene, M. (2017). Anomalous results in G-factor models: Explanations and alternatives. Psychological Methods, 22, 541–562. https://doi.org/10.1037/met0000083
   PubMed Web of Science ®Google Scholar
• Ernst, M. S., & Peikert, A. (2022a). ProximalSEM.jl [Computer Software.] https://doi.org/10.5281/zenodo.7223919 (Original work published 2021.)
   Google Scholar
• Ernst, M. S., & Peikert, A. (2022b). StructuralEquationModels.jl [Computer software.] https://doi.org/10.5281/zenodo.6719627
   Google Scholar
• Friedman, J., Hastie, T., & Tibshirani, R. (2010). Regularization paths for generalized linear models via coordinate descent. Journal of Statistical Software, 33, 1–22. https://doi.org/10.18637/jss.v033.i01
   PubMed Web of Science ®Google Scholar
• Fu, W. J. (1998). Penalized regressions: the bridge versus the lasso. Journal of Computational and Graphical Statistics, 7, 397–416. https://doi.org/10.2307/1390712
   Web of Science ®Google Scholar
• Gäde, J. C., Schermelleh-Engel, K., & Klein, A. G. (2017). Disentangling the common variance of perfectionistic strivings and perfectionistic concerns: A bifactor model of perfectionism. Frontiers in Psychology, 8, 160. https://doi.org/10.3389/fpsyg.2017.00160
   PubMed Web of Science ®Google Scholar
• Geiser, C., Eid, M., & Nussbeck, F. W. (2008). On the meaning of the latent variables in the CT-C (M-1) model: A comment on Maydeu-Olivares and Coffman. Psychological Methods, 13, 49–57. https://doi.org/10.1037/1082-989X.13.1.49
   PubMed Web of Science ®Google Scholar
• Gelman, A., & Carlin, J. (2014). Beyond power calculations: Assessing type S (sign) and type M (magnitude) errors. Perspectives on Psychological Science: A Journal of the Association for Psychological Science, 9, 641–651. https://doi.org/10.1177/1745691614551642
   PubMedGoogle Scholar
• Grewal, R., Cote, J. A., & Baumgartner, H. (2004). Multicollinearity and measurement error in structural equation models: Implications for theory testing. Marketing Science, 23, 519–529. https://doi.org/10.1287/mksc.1040.0070
   Web of Science ®Google Scholar
• Hastie, T., Tibshirani, R., & Friedman, J. (2009). The Elements of Statistical Learning: Data Mining, Inference, and Prediction. New York: Springer Science & Business Media. https://doi.org/10.1007/978-0-387-84858-7
   Google Scholar
• Heinrich, M., Zagorscak, P., Eid, M., & Knaevelsrud, C. (2020). Giving G a meaning: An application of the bifactor-(S-1) approach to realize a more symptom-oriented modeling of the Beck depression inventory–II. Assessment, 27, 1429–1447. https://doi.org/10.1177/1073191118803738
   PubMed Web of Science ®Google Scholar
• Hoerl, A. E., & Kennard, R. W. (1970). Ridge regression: Biased estimation for nonorthogonal problems. Technometrics, 12, 55–67. https://doi.org/10.2307/1267351
   Web of Science ®Google Scholar
• Huang, P.-H. (2020). lslx: Semi-confirmatory structural equation modeling via penalized likelihood. Journal of Statistical Software, 93, 1–37. https://doi.org/10.18637/jss.v093.i07
   Web of Science ®Google Scholar
• Huang, P.-H., Chen, H., & Weng, L.-J. (2017). A penalized likelihood method for structural equation modeling. Psychometrika, 82, 329–354. https://doi.org/10.1007/s11336-017-9566-9
   PubMed Web of Science ®Google Scholar
• Jacobucci, R., Brandmaier, A. M., & Kievit, R. A. (2019). A practical guide to variable selection in structural equation modeling by using regularized multiple-indicators, multiple-causes models. Advances in Methods and Practices in Psychological Science, 2, 55–76. https://doi.org/10.1177/2515245919826527
   PubMedGoogle Scholar
• Jacobucci, R., Grimm, K. J., & McArdle, J. J. (2016). Regularized structural equation modeling. Structural Equation Modeling: A Multidisciplinary Journal, 23, 555–566. https://doi.org/10.1080/10705511.2016.1154793
   PubMed Web of Science ®Google Scholar
• Koch, T., Holtmann, J., Bohn, J., & Eid, M. (2018). Explaining general and specific factors in longitudinal, multimethod, and bifactor models: Some caveats and recommendations. Psychological Methods, 23, 505–523. https://doi.org/10.1037/met0000146
   PubMed Web of Science ®Google Scholar
• Koch, T., Schultze, M., Eid, M., & Geiser, C. (2014). A longitudinal multilevel CFA-MTMM model for interchangeable and structurally different methods. Frontiers in Psychology, 5, 311. https://doi.org/10.3389/fpsyg.2014.00311
   PubMed Web of Science ®Google Scholar
• Mason, C. H., & Perreault, W. D., Jr. (1991). Collinearity, power, and interpretation of multiple regression analysis. Journal of Marketing Research, 28, 268–280. https://doi.org/10.2307/3172863
   Web of Science ®Google Scholar
• Ooi, H. (2021). glmnetUtils: Utilities for ‘Glmnet’. In https://CRAN.R-project.org/package=glmnetUtils
   Google Scholar
• R Core Team. (2021). R: A Language and Environment for Statistical Computing. In R Foundation for Statistical Computing. Vienna, Austria. https://www.R-project.org/
   Google Scholar
• Rindskopf, D. (1984). Structural equation models: Empirical identification, Heywood cases, and related problems. Sociological Methods & Research, 13, 109–119. https://doi.org/10.1177/0049124184013001004
   Web of Science ®Google Scholar
• Rosseel, Y. (2012). Lavaan: An R package for structural equation modeling and more. Version 0.5–12 (BETA). Journal of Statistical Software, 48, 1–36. https://doi.org/10.18637/jss.v048.i02
   Web of Science ®Google Scholar
• Sainani, K. L. (2014). Explanatory versus predictive modeling. PM & R: The Journal of Injury, Function, and Rehabilitation, 6, 841–844. https://doi.org/10.1016/j.pmrj.2014.08.941
   PubMedGoogle Scholar
• Scharf, F., & Nestler, S. (2019). Should regularization replace simple structure rotation in exploratory factor analysis? Structural Equation Modeling: A Multidisciplinary Journal, 26, 576–590. https://doi.org/10.1080/10705511.2018.1558060
   Web of Science ®Google Scholar
• Scharf, F., Pförtner, J., & Nestler, S. (2021). Can ridge and elastic net structural equation modeling be used to stabilize parameter estimates when latent factors are correlated? Structural Equation Modeling: A Multidisciplinary Journal, 28, 928–940. https://doi.org/10.1080/10705511.2021.1927736
   Web of Science ®Google Scholar
• Schwarz, G. (1978). Estimating the dimension of a model. The Annals of Statistics, 6, 461–464. https://doi.org/10.1214/aos/1176344136
   Web of Science ®Google Scholar
• Shmueli, G. (2010). To explain or to predict? Statistical Science, 25, 289–310. https://doi.org/10.1214/10-STS330
   Web of Science ®Google Scholar
• Su, W., Bogdan, M., & Candes, E. (2017). False discoveries occur early on the lasso path. The Annals of Statistics, 45, 2133–2150. https://doi.org/10.1214/16-AOS1521
   Web of Science ®Google Scholar
• Tibshirani, R. (1996). Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society: Series B (Methodological), 58, 267–288. https://doi.org/10.1111/j.2517-6161.1996.tb02080.x
   Web of Science ®Google Scholar
• Zou, H., & Hastie, T. (2005). Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 67, 301–320. https://doi.org/10.1111/j.1467-9868.2005.00503.x
   Web of Science ®Google Scholar