274
Views
0
CrossRef citations to date
0
Altmetric
Teacher's Corner

Regression-Equivalent Effect Sizes for Latent Growth Modeling and Associated Null Hypothesis Significance Tests

Pages 672-685 | Received 14 Oct 2022, Accepted 20 Oct 2022, Published online: 28 Nov 2022

References

  • Arend, M. G., & Schäfer, T. (2019). Statistical power in two-level models: A tutorial based on Monte Carlo simulation. Psychological Methods, 24, 1–19. https://doi.org/10.1037/met0000195.
  • Baguley, T. (2009). Standardized or simple effect size: What should be reported? British Journal of Psychology, 100, 603–617. https://doi.org/10.1348/000712608X377117
  • Banjanovic, E. S., & Osborne, J. W. (2016). Confidence intervals for effect sizes: Applying bootstrap resampling. Practical Assessment, Research & Evaluation, 21, 1–18. https://doi.org/10.7275/DZ3R-8N08
  • Baraldi, A. N., & Enders, C. K. (2010). An introduction to modern missing data analyses. Journal of School Psychology, 48, 5–37. https://doi.org/10.1016/j.jsp.2009.10.001
  • Benichou, J., & Gail, M. H. (1989). A delta method for implicitly defined random variables. The American Statistician, 43, 41–44.
  • Bollen, K. A., & Curran, P. J. (2006). Latent curve models: A structural equation perspective. Wiley.
  • Brandmaier, A. M., von Oertzen, T., Ghisletta, P., Lindenberger, U., & Hertzog, C. (2018). Precision, reliability, and effect size of slope variance in latent growth curve models: Implications for statistical power analysis. Frontiers in Psychology, 9, 294. https://doi.org/10.3389/fpsyg.2018.00294
  • Cheung, M. W. (2009). Comparison of methods for constructing confidence intervals of standardized indirect effects. Behavior Research Methods, 41, 425–438. https://doi.org/10.3758/BRM.41.2.425
  • Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Erlbaum.
  • Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2003). Applied multiple regression/correlation analysis for the behavioral analysis (3rd ed.). Erlbaum.
  • Collins, L. M., & Sayer, A. G. (Eds.) (1991). New methods for the analysis of change. American Psychological Association.
  • Cumming, G. (2013). Understanding the new statistics: Effect sizes, confidence intervals, and meta-analysis. Routledge.
  • Curran, P. J., & Bauer, D. J. (2011). The disaggregation of within-person and between-person effects in longitudinal models of change. Annual Review of Psychology, 62, 583–619. https://doi.org/10.1146/annurev.psych.093008.100356
  • Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, Series B, 39, 1–38.
  • Devlieger, I., Mayer, A., & Rosseel, Y. (2016). Hypothesis testing using factor score regression: A comparison of four methods. Educational and Psychological Measurement, 76, 741–770. https://doi.org/10.1177/0013164415607618
  • DiStefano, C., Zhu, M., & Mîndrilã, D. (2009). Understanding and using factor scores: Considerations for the applied researcher. Practical Assessment, Research, and Evaluation, 14 Article 20. https://doi.org/10.7275/da8t-4g52
  • Efron, B., & Tibshirani, R. (1993). An introduction to the bootstrap. Chapman & Hall.
  • Feingold, A. (2009). Effect sizes for growth-modeling analysis for controlled clinical trials in the same metric as for classical analysis. Psychological Methods, 14, 43–53. https://doi.org/10.1037/a0014699
  • Feingold, A. (2013). A regression framework for effect size assessments in longitudinal modeling of group differences. Review of General Psychology : Journal of Division 1, of the American Psychological Association, 17, 111–121. https://doi.org/10.1037/a0030048
  • Feingold, A. (2017). Meta-analysis with standardized effect sizes from multilevel and latent growth models. Journal of Consulting and Clinical Psychology, 85, 262–266. https://doi.org/10.1037/ccp0000162
  • Feingold, A. (2019). Time-varying effect sizes for quadratic growth models in multilevel and latent growth modeling. Structural Equation Modeling: A Multidisciplinary Journal, 26, 418–429. https://doi.org/10.1080/10705511.2018.1547110
  • Feingold, A. (2021). Effect of parameterization on statistical power and effect size estimation in latent growth modeling. Structural Equation Modeling: A Multidisciplinary Journal, 28, 609–621. https://doi.org/10.1080/10705511.2021.1878895
  • Feingold, A. (2022). Growth curve modeling. In G. J. G. Asmundson (Ed.), Comprehensive clinical psychology (2nd ed., Vol. 3, pp. 189–200). Elsevier. https://doi.org/10.1016/B978-0-12-818697-8.00014-5
  • Feingold, A., MacKinnon, D. P., & Capaldi, D. M. (2019). Mediation analysis with binary outcomes: Direct and indirect effects of pro-alcohol influences on alcohol use disorders. Addictive Behaviors, 94, 26–35. https://doi.org/10.1016/j.addbeh.2018.12.018
  • Goldstein, H. (2011). Multilevel statistical models (4th ed.). Wiley.
  • Gottman, J. M. (Ed.) (1995). The analysis of change. Erlbaum.
  • Grimm, K. J., Ram, N., & Estabrook, R. (2016). Growth modeling: Structural equation and multilevel modeling approaches. Guilford.
  • Grissom, R. J., & Kim, J. J. (2012). Effect sizes for research: Univariate and multivariate application (2nd ed.). Routledge.
  • Hayes, A. F. (2013). Introduction to mediation, moderation, and conditional process analysis: A regression-based approach. Guilford.
  • Hedeker, D., & Gibbons, R. D. (2006). Longitudinal data analysis. Wiley.
  • Hedges, L. V., Pustejovsky, J. E., & Shadish, W. R. (2012). A standardized mean difference effect size for single case designs. Research Synthesis Methods, 3, 224–239. https://doi.org/10.1002/jrsm.1052
  • Hinkelmann, K., & Kempthorne, O. (2008). Design and analysis of experiments (Volume I): Introduction to experimental design (2nd ed.). Wiley.
  • Hox, J. J., Moerbeek, M., & van de Schoot, R. (2010). Multilevel analysis: Techniques and applications. Routledge.
  • Hoyle, R. H. (Ed.). (2012). Handbook of structural equation modeling. Guilford Press.
  • Jöreskog, K. G., & Sörbom, D. (2006). LISREL 8.80 for Windows. Scientific Software International, Inc.
  • Kelley, K., & Preacher, K. J. (2012). On effect size. Psychological Methods, 17, 137–152. https://doi.org/10.1037/a0028086
  • Keith, T. Z. (2019). Multiple regression and beyond: An introduction to multiple regression and structural equation modeling. Routledge.
  • Kline, R. B. (2015). Principles and practice of structural equation modeling (3rd ed). Guilford.
  • Kuljanin, G., Braun, M. T., & DeShon, R. P. (2011). A cautionary note on modeling growth trends in longitudinal data. Psychological Methods, 16, 249–264. https://doi.org/10.1037/a0023348.
  • Kendall, M., & Stuart, A. (1977). The advanced theory of statistics: Volume 1 (4th ed.). MacMillan.
  • Lai, M. H. (2020). Bootstrap confidence intervals for multilevel standardized effect size. Multivariate Behavioral Research, 56, 558–578. https://doi.org/10.1177/1094428110391673
  • Little, R. J., & Rubin, D. B. (2019). Statistical analysis with missing data (3rd ed.). John Wiley & Sons.
  • Lu, I. R. R., & Thomas, D. R. (2008). Avoiding and correcting bias in score-based latent variable regression with discrete manifest items. Structural Equation Modeling: A Multidisciplinary Journal, 15, 462–490. https://doi.org/10.1080/10705510802154323
  • Marcoulides, K. M., & Khojasteh, J. (2018). Analyzing longitudinal data using natural cubic smoothing splines. Structural Equation Modeling: A Multidisciplinary Journal, 25, 965–971. https://doi.org/10.1080/10705511.2018.1449113
  • Miočević, M., O'Rourke, H. P., MacKinnon, D. P., & Brown, H. C. (2018). Statistical properties of four effect-size measures for mediation models. Behavior Research Methods, 50, 285–301. https://doi.org/10.3758/s13428-017-0870-1
  • Muthén, B. O., & Curran, P. J. (1997). General longitudinal modeling of individual differences in experimental designs: A latent variable framework for analysis and power estimation. Psychological Methods, 2, 371–402. https://doi.org/10.1037/1082-989X.2.4.371
  • Muthén, B. O., & Muthén, L. K. (2000). The development of heavy drinking and alcohol-related problems from ages 18 to 37 in a U.S. national sample. Journal of Studies on Alcohol, 61, 290–300. https://doi.org/10.15288/jsa.2000.61.290
  • Muthén, B. O., Muthén, L. K., & Asparouhov, T. (2016). Regression and mediation analysis using Mplus. Muthén & Muthén.
  • Muthén, L. K., & Muthén, B. O. (2002). How to use a Monte Carlo study to decide on sample size and determine power. Structural Equation Modeling, 4, 599–620. https://doi.org/10.1207/S15328007SEM0904_8
  • Muthén, L. K., & Muthén, B. O. (2017). Mplus user’s guide (8th ed.). Muthén & Muthén.
  • Pek, J., & Flora, D. B. (2018). Reporting effect sizes in original psychological research: A discussion and tutorial. Psychological Methods, 23, 208–225. https://doi.org/10.1037/met0000126
  • Preacher, K. J., & Kelley, K. (2011). Effect size measures for mediation models: Quantitative strategies for communicating indirect effects. Psychological Methods, 16, 93–115. https://doi.org/10.1037/a0022658.
  • Preacher, K. J., Wichman, A. L., MacCallum, R. C., & Briggs, N. E. (2008). Latent growth modeling. Sage. https://doi.org/10.1037/a0022658
  • Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Sage.
  • Raudenbush, S. W., & Xiao-Feng, L. (2001). Effects of study duration, frequency of observation, and sample size on power in studies of group differences in polynomial change. Psychological Methods, 6, 387–401. https://doi.org/10.1037/1082-989X.6.4.387.
  • Rights, J. D., & Sterba, S. K. (2021). Effect size measures for longitudinal growth analyses: Extending a framework of multilevel model R‐squareds to accommodate heteroscedasticity, autocorrelation, nonlinearity, and alternative centering strategies. New Directions for Child and Adolescent Development, 65–110. https://doi.org/10.1002/cad.20387
  • Rosseel, Y. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48, 1–36. https://doi.org/10.18637/jss.v048.i02
  • SAS Institute, Inc. (2011). SAS/STAT® 9.3 user’s guide. SAS Institute Inc.
  • Satorra, A., & Saris, W. (1985). Power of the likelihood ratio test in covariance structure analysis. Psychometrika, 50, 83–90. https://doi.org/10.1007/BF02294150
  • Selya, A. S., Rose, J. S., Dierker, L. C., Hedeker, D., & Mermelstein, R. J. (2012). A practical guide to calculating Cohen’s f2, a measure of local effect size, from PROC MIXED. Frontiers in Psychology, 3, 111. https://doi.org/10.3389/fpsyg.2012.00111
  • Spybrook, J., Raudenbush, S. W., Liu, X., & Congdon, R. (2008). Optimal design for longitudinal and multilevel research: Documentation for the “Optimal Design” software [Unpublished manuscript]. University of Michigan.
  • Stone, A. L., Becker, L. G., Huber, A. M., & Catalano, R. F. (2012). Review of risk and protective factors of substance use and problem use in emerging adulthood. Addictive Behaviors, 37, 747–775. https://doi.org/10.1016/j.addbeh.2012.02.014
  • Tabachnick, B. G., Fidell, L. S., & Ullman, J. B. (2018). Using multivariate statistics (7th ed.). Pearson.
  • Yuan, K. H., & Deng, L. (2021). Equivalence of partial-least-squares SEM and the methods of factor score regression. Structural Equation Modeling. Advance online publication. 28, 557–571. https://doi.org/10.1080/10705511.2021.1894940
  • Zitzmann, S., & Helm, C. (2021). Multilevel analysis of mediation, moderation, and nonlinear effects in small samples, using expected a posteriori estimates of factor scores. Structural Equation Modeling. Advance online publication. 28, 529–546. https://doi.org/10.1080/10705511.2020.1855076

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.