Sample Size Planning for Detecting Mediation Effects: A Power Analysis Procedure Considering Uncertainty in Effect Size Estimates

References

• Anderson, S. F., Kelley, K., & Maxwell, S. E. (2017). Sample-size planning for more accurate statistical power: A method adjusting sample effect sizes for publication bias and uncertainty. Psychological Science, 28(11), 1547–1562. doi:10.1177/0956797617723724
   PubMed Web of Science ®Google Scholar
• Anderson, S. F., & Maxwell, S. E. (2017). Addressing the “replication crisis”: Using original studies to design replication studies with appropriate statistical power. Multivariate Behavioral Research, 52(3), 305–324. doi:10.1080/00273171.2017.1289361
   PubMed Web of Science ®Google Scholar
• Baron, R. M., & Kenny, D. A. (1986). The moderator–mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. Journal of Personality and Social Psychology, 51(6), 1173–1182. doi:10.1.1.169.4836
   PubMed Web of Science ®Google Scholar
• Berry, K. J., & Mielke, P. W. Jr. (2002). Least sum of Euclidean regression residuals: Estimation of effect size. Psychological Reports, 91(3), 955–962. doi:10.2466/pr0.2002.91.3.955
   PubMed Web of Science ®Google Scholar
• Cheung, M. W. (2009). Comparison of methods for constructing confidence intervals of standardized indirect effects. Behavior Research Methods, 41(2), 425–438. doi:10.3758/BRM.41.2.42
   PubMed Web of Science ®Google Scholar
• de Heus, P. (2012). R squared effect-size measures and overlap between direct and indirect effect in mediation analysis. Behavior Research Methods, 44(1), 213–221. doi:10.3758/s13428-011-0141-5
   PubMed Web of Science ®Google Scholar
• Diener, E., Ng, W., Harter, J., & Arora, R. (2010). Wealth and happiness across the world: Material prosperity predicts life evaluation, whereas psychosocial prosperity predicts positive feeling. Journal of Personality and Social Psychology, 99(1), 52–61. doi:10.1037/a0018066
   PubMed Web of Science ®Google Scholar
• Du, H., & Wang, L. (2016). A bayesian power analysis procedure considering uncertainty in effect size estimates from a meta-analysis. Multivariate Behavioral Research, 51(5), 589–605. doi:10.1080/00273171.2016.1191324
   PubMed Web of Science ®Google Scholar
• Efron, B., & Tibshirani, R. J. (1993). An introduction to the bootstrap: Monographs on statistics and applied probability (No. 57). New York, NY: Chapman & Hall/CRC.
   Google Scholar
• Fairchild, A. J., MacKinnon, D. P., Taborga, M. P., & Taylor, A. B. (2009). R 2 effect-size measures for mediation analysis. Behavior Research Methods, 41(2), 486–498. doi:10.3758/BRM.41.2.486
   PubMed Web of Science ®Google Scholar
• Fritz, M. S., & MacKinnon, D. P. (2007). Required sample size to detect the mediated effect. Psychological Science, 18(3), 233–239. doi:10.1111/j.1467-9280.2007.01882.x
   PubMed Web of Science ®Google Scholar
• Fritz, M. S., Taylor, A. B., & MacKinnon, D. P. (2012). Explanation of two anomalous results in statistical mediation analysis. Multivariate Behavioral Research, 47(1), 61–87. doi:10.1080/00273171.2012.640596
   PubMed Web of Science ®Google Scholar
• Hayes, A. F. (2013). Introduction to mediation, moderation, and conditional process analysis: A regression-based approach. New York, NY: Guilford Press.
   Google Scholar
• Hoyle, R. H. (1999). Statistical strategies for small sample research. Los Angeles, CA: SAGE Publications Sage CA.
   Google Scholar
• Joanes, D., & Gill, C. (1998). Comparing measures of sample skewness and kurtosis. Journal of the Royal Statistical Society: Series D (The Statistician)), 47(1), 183–189. doi:10.1111/1467-9884.00122
   Google Scholar
• Kelley, K., Darku, F., & Chattopadhyay, B. (2018). Accuracy in parameter estimation for a general class of effect sizes: A sequential approach. Psychological Methods, 23(2), 226–243. doi:10.1037/met0000127
   PubMed Web of Science ®Google Scholar
• Kelley, K., & Maxwell, S. E. (2003). Sample size for multiple regression: Obtaining regression coefficients that are accurate, not simply significant. Psychological Methods, 8(3), 305–321. doi:10.1037/1082-989X.8.3.305
   PubMed Web of Science ®Google Scholar
• Kelley, K., & Maxwell, S. E. (2012). Sample size planning. APA Handbook of Research Methods in Psychology, 1, 181–202. doi:10.1037/13619-012
   Google Scholar
• Kelley, K., & Rausch, J. R. (2006). Sample size planning for the standardized mean difference: Accuracy in parameter estimation via narrow confidence intervals. Psychological Methods, 11(4), 363–385. doi:10.1037/1082-989X.11.4.363
   PubMed Web of Science ®Google Scholar
• Kenny, D. A., & Judd, C. M. (2014). Power anomalies in testing mediation. Psychological Science, 25(2), 334–339. doi:10.1177/0956797613502676
   PubMed Web of Science ®Google Scholar
• Kraemer, H. C. (2014). A mediator effect size in randomized clinical trials. International Journal of Methods in Psychiatric Research, 23(4), 401–410. doi: http://doi.org/10.1002/mpr.1445
   PubMed Web of Science ®Google Scholar
• Lachowicz, M. J., Preacher, K. J., & Kelley, K. (2017). A novel measure of effect size for mediation analysis. Psychological Methods, 23(2), 244–261. doi:10.1037/met0000165
   PubMed Web of Science ®Google Scholar
• Lindley, D. V. (1997). The choice of sample size. Journal of the Royal Statistical Society: Series D (The Statistician)), 46(2), 129–138. doi:10.1111/1467-9884.00068
   Google Scholar
• Liu, F. (2010). An extension of Bayesian expected power and its application in decision making. Journal of Biopharmaceutical Statistics, 20(5), 941–953. doi:10.1080/10543401003618967
   PubMed Web of Science ®Google Scholar
• MacKinnon, D. P. (2008). Introduction to statistical mediation analysis. New York, NY: Taylor & Francis Group/Lawrence Erlbaum Associates.
   Google Scholar
• MacKinnon, D. P., Fairchild, A. J., & Fritz, M. S. (2007). Mediation analysis. Annual Review of Psychology, 58(1), 593–614. doi:10.1146/annurev.psych.58.110405.085542
   PubMed Web of Science ®Google Scholar
• MacKinnon, D. P., Fritz, M. S., Williams, J., & Lockwood, C. M. (2007). Distribution of the product confidence limits for the indirect effect: Program PRODCLIN. Behavior Research Methods, 39(3), 384–389. doi:10.3758/BF03193007
   PubMed Web of Science ®Google Scholar
• MacKinnon, D. P., Lockwood, C. M., Hoffman, J. M., West, S. G., & Sheets, V. (2002). A comparison of methods to test mediation and other intervening variable effects. Psychological Methods, 7(1), 83–104. doi:10.1037/1082-989X.7.1.83
   PubMed Web of Science ®Google Scholar
• MacKinnon, D. P., Lockwood, C. M., & Williams, J. (2004). Confidence limits for the indirect effect: Distribution of the product and resampling methods. Multivariate Behavioral Research, 39(1), 99–128. doi:10.1207/s15327906
   PubMed Web of Science ®Google Scholar
• Maxwell, S. E., Delaney, H. D., & Kelley, K. (2017). Designing experiments and analyzing data: A model comparison perspective. New York, NY: Routledge. doi:10.1111/j.1467-985X.2006.00438.x
   Google Scholar
• Maxwell, S. E., & Kelley, K. (2011). Ethics and sample size planning. In A. T. Panter & S. K. Sterba (Eds.), Multivariate applications series. Handbook of ethics in quantitative methodology (pp. 159–184). New York, NY: Routledge/Taylor & Francis.
   Google Scholar
• Maxwell, S. E., Kelley, K., & Rausch, J. R. (2008). Sample size planning for statistical power and accuracy in parameter estimation. Annual Review of Psychology, 59(1), 537–563. doi:10.1146/annurev.psych.59.103006.093735
   PubMed Web of Science ®Google Scholar
• Maxwell, S. E., Lau, M. Y., & Howard, G. S. (2015). Is psychology suffering from a replication crisis? What does “failure to replicate” really mean?. American Psychologist, 70(6), 487–498. doi:10.1037/a0039400
   PubMed Web of Science ®Google Scholar
• McShane, B. B., & Böckenholt, U. (2016). Planning sample sizes when effect sizes are uncertain: The power-calibrated effect size approach. Psychological Methods, 21(1), 47–60. doi:10.1037/met0000036
   PubMed Web of Science ®Google Scholar
• O’Brien, E., & Roney, E. (2017). Worth the wait? Leisure can be just as enjoyable with work left undone. Psychological Science, 28(7), 1000–1015. doi:10.1177/0956797617701749
   PubMed Web of Science ®Google Scholar
• Pan, H., Liu, S., Miao, D., & Yuan, Y. (2018). Sample size determination for mediation analysis of longitudinal data. BMC Medical Research Methodology, 18(1), 32. doi:10.1186/s12874-018-0473-2
   PubMed Web of Science ®Google Scholar
• Perugini, M., Gallucci, M., & Costantini, G. (2014). Safeguard power as a protection against imprecise power estimates. Perspectives on Psychological Science, 9(3), 319–332. doi:10.1177/1745691614528519
   Web of Science ®Google Scholar
• Preacher, K. J. (2015). Advances in mediation analysis: A survey and synthesis of new developments. Annual Review of Psychology, 66(1), 825–852. doi:10.1146/annurev-psych-010814-015258
   PubMed Web of Science ®Google Scholar
• Preacher, K. J., & Hayes, A. F. (2004). SPSS and SAS procedures for estimating indirect effects in simple mediation models. Behavior Research Methods, Instruments, & Computers, 36(4), 717–731. doi:10.3758/BF03206553
   PubMedGoogle Scholar
• Preacher, K. J., & Hayes, A. F. (2008). Asymptotic and resampling strategies for assessing and comparing indirect effects in multiple mediator models. Behavior Research Methods, 40(3), 879–891. doi:10.3758/BRM.40.3.87
   PubMed Web of Science ®Google Scholar
• Preacher, K. J., & Kelley, K. (2011). Effect size measures for mediation models: Quantitative strategies for communicating indirect effects. Psychological Methods, 16(2), 93–115. doi:10.1037/a0022658
   PubMed Web of Science ®Google Scholar
• Reyes, M. R., Brackett, M. A., Rivers, S. E., White, M., & Salovey, P. (2012). Classroom emotional climate, student engagement, and academic achievement. Journal of Educational Psychology, 104(3), 700–712. doi:10.1037/a0027268
   Web of Science ®Google Scholar
• Roth, D. L., & MacKinnon, D. P. (2012). Mediation analysis with longitudinal data. In J. T. Newsom, R. N. Jones, & S. M. Hofer (Eds.), Multivariate application series: Vol. 18. Longitudinal data analysis: A practical guide for researchers in aging, health, and social sciences (pp. 181–216). New York, NY: Routledge/Taylor & Francis Group.
   Google Scholar
• Schoemann, A. M., Boulton, A. J., & Short, S. D. (2017). Determining power and sample size for simple and complex mediation models. Social Psychological and Personality Science, 8(4), 379–386. doi:10.1177/1948550617715068
   Web of Science ®Google Scholar
• Selig, J. P., & Preacher, K. J. (2009). Mediation models for longitudinal data in developmental research. Research in Human Development, 6(2-3), 144–164. doi:10.1080/15427600902911247
   Web of Science ®Google Scholar
• Shrout, P. E., & Bolger, N. (2002). Mediation in experimental and nonexperimental studies: New procedures and recommendations. Psychological Methods, 7(4), 422–445. doi:10.1037/1082-989X.7.4.422
   PubMed Web of Science ®Google Scholar
• Sobel, M. E. (1982). Asymptotic confidence intervals for indirect effects in structural equation models. Sociological Methodology, 13, 290–312. doi:10.2307/270723
   Google Scholar
• Spiegelhalter, D. J., Abrams, K. R., & Myles, J. P. (2004). Bayesian approaches to clinical trials and health-care evaluation (Vol. 13). Chichester, UK: John Wiley & Sons.
   Google Scholar
• Spiegelhalter, D. J., Freedman, L. S., & Blackburn, P. R. (1986). Monitoring clinical trials: Conditional or predictive power? Controlled Clinical Trials, 7(1), 8–17. doi:10.1016/0197-2456(86)90003-6
   PubMedGoogle Scholar
• Taylor, D. J., & Muller, K. E. (1996). Bias in linear model power and sample size calculation due to estimating noncentrality. Communications in Statistics-Theory and Methods, 25(7), 1595–1610. doi:10.1080/03610929708831953
   Web of Science ®Google Scholar
• Valente, M. J., Gonzalez, O., Miočević, M., & MacKinnon, D. P. (2016). A note on testing mediated effects in structural equation models: Reconciling past and current research on the performance of the test of joint significance. Educational and Psychological Measurement, 76(6), 889–911. doi:10.1177/0013164415618992
   PubMed Web of Science ®Google Scholar
• Vittinghoff, E., & Neilands, T. B. (2015). Sample size for joint testing of indirect effects. Prevention Science: The Official Journal of the Society for Prevention Research, 16(8), 1128–1135. doi: 0.1007/s11121-014-0528-5 doi:10.1007/s11121-014-0528-5
   PubMed Web of Science ®Google Scholar
• Waldinger, R. J., & Schulz, M. S. (2016). The long reach of nurturing family environments: Links with midlife emotion-regulatory styles and late-life security in intimate relationships. Psychological Science, 27(11), 1443–1450. doi:10.1177/0956797616661556
   PubMed Web of Science ®Google Scholar
• Wang, K. (2017). Understanding power anomalies in mediation analysis. Psychometrika, 83(2), 387–406. doi:10.1007/s11336-017-9598-1
   PubMed Web of Science ®Google Scholar
• Wang, L., & Preacher, K. J. (2015). Moderated mediation analysis using Bayesian methods. Structural Equation Modeling: A Multidisciplinary Journal, 22(2), 249–263. doi:10.1080/10705511.2014.935256
   Web of Science ®Google Scholar
• Wang, L., & Zhang, Z. (2011). Estimating and testing mediation effects with censored data. Structural Equation Modeling, 18(1), 18–34. doi:10.1080/10705511.2011.534324
   Web of Science ®Google Scholar
• Wen, Z., & Fan, X. (2015). Monotonicity of effect sizes: Questioning kappa-squared as mediation effect size measure. Psychological Methods, 20(2), 193–203. doi:10.1037/met0000029
   PubMed Web of Science ®Google Scholar
• Yuan, Y., & MacKinnon, D. P. (2009). Bayesian mediation analysis. Psychological Methods, 14(4), 301–322. doi:10.1037/a0016972
   PubMed Web of Science ®Google Scholar
• Zhang, Z. (2014). Monte Carlo based statistical power analysis for mediation models: Methods and software. Behavior Research Methods, 46(4), 1184–1198. doi:10.3758/s13428-013-0424-0
   PubMed Web of Science ®Google Scholar
• Zhang, Z., & Wang, L. (2013). bmem: Mediation analysis with missing data using bootstrap. R Package Version 1.5. Retrieved from http://nd.psychstat.org
   Google Scholar