Indirect Effects in Sequential Mediation Models: Evaluating Methods for Hypothesis Testing and Confidence Interval Formation

References

• Adamczyk, K. (2018). Direct and indirect effects of relationship status through unmet need to belong and fear of being single on young adults’ romantic loneliness. Personality and Individual Differences, 124, 124–129. doi: 10.1016/j.paid.2017.12.011
   Web of Science ®Google Scholar
• Andreassen, T. W., Lorentzen, B. G., & Olsson, U. H. (2006). The impact of non-normality and estimation methods in SEM on satisfaction research in marketing. Quality & Quantity, 40, 39–58. doi: 10.1007/s11135-005-4510-y
   Google Scholar
• Astivia, O. L. O., & Zumbo, B. D. (2015). A cautionary note on the use of the Vale and Maurelli method to generate multivariate, nonnormal data for simulation purposes. Educational and Psychological Measurement, 75(4), 541–567. doi: 10.1177/0013164414548894
   PubMed Web of Science ®Google Scholar
• Ato García, M., Vallejo Seco, G., & Ato Lozano, E. (2014). Classical and causal inference approaches to statistical mediation analysis. Psicothema, 26(2), 252–259. https://doi.org/10.7334/psicothema2013.314
   PubMed Web of Science ®Google Scholar
• Bernier, A., McMahon, C. A., & Perrier, R. (2017). Maternal mind-mindedness and children’s school readiness: A longitudinal study of developmental processes. Developmental Psychology, 53(2), 210–221. doi: 10.1037/dev0000225
   PubMed Web of Science ®Google Scholar
• Biesanz, J. C., Falk, C. F., & Savalei, V. (2010). Assessing mediational models: Testing and interval estimation for indirect effects. Multivariate Behavioral Research, 45(4), 661–701. doi: 10.1080/00273171.2010.498292
   PubMed Web of Science ®Google Scholar
• Bollen, K. A., & Stine, R. A. (1990). Direct and indirect effects: Classical and bootstrap estimates of variabilty. Sociological Methodology, 20, 115–140. doi: 10.2307/271084
   Google Scholar
• Bollen, K. A., & Stine, R. A. (1992). Bootstrapping goodness-of-fit measures in structural equation models. Sociological Methods & Research, 21, 205–229. doi: 10.1177/0049124192021002004
   Web of Science ®Google Scholar
• Bradley, J. V. (1978). Robustness? British Journal of Mathematical and Statistical Psychology, 31(2), 144–152. doi: 10.1111/j.2044-8317.1978.tb00581.x
   Web of Science ®Google Scholar
• Cain, M. K., Zhang, Z., & Yuan, K.-H. (2017). Univariate and multivariate skewness and kurtosis for measuring nonnormality: Prevalence, influence and estimation. Behavior Research Methods, 49(5), 1716–1735. doi: 10.3758/s13428-016-0814-1
   PubMed Web of Science ®Google Scholar
• Canty, A., & Ripley, B. D. (2017). Boot: Bootstrap R (S-Plus) Functions (Version 1.3-20). [Computer software]. Available from https://cran.r-project.org/web/packages/boot/index.html
   Google Scholar
• Chen, J., Choi, J., Weiss, B. A., & Stapleton, L. (2014). An empirical evaluation of mediation effect analysis with manifest and latent variables using Markov Chain Monte Carlo and alternative estimation methods. Structural Equation Modeling: A Multidisciplinary Journal, 21(2), 253–262. doi: 10.1080/10705511.2014.882688
   Web of Science ®Google Scholar
• Chernick, M. R., & LaBudde, R. A. (2011). An introduction to bootstrap methods with applications to R. Hoboken, NJ: Wiley.
   Google Scholar
• Cheung, M. W. L. (2007). Comparison of approaches to constructing confidence intervals for mediating effects using structural equation models. Structural Equation Modeling: A Multidisciplinary Journal, 14(2), 227–246. doi: 10.1080/10705510709336745
   Web of Science ®Google Scholar
• Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
   Google Scholar
• Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2003). Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). Mahwah, NJ: Erlbaum.
   Google Scholar
• Cox, D. R., & Hinkley, D. V. (2000). Theoretical statistics. Boca Raton, FL: Chapman & Hall/CRC.
   Google Scholar
• Cox, M. G., Kisbu-Sakarya, Y., Miočević, M., & MacKinnon, D. P. (2013). Sensitivity plots for confounder bias in the single mediator model. Evaluation Review, 37(5), 405–431. doi: 10.1177/0193841X14524576
   PubMed Web of Science ®Google Scholar
• Craig, C. C. (1936). On the frequency function of xy. The Annals of Mathematical Statistics, 7(1), 1–15. doi: 10.1214/aoms/1177732541
   Google Scholar
• Curran, P. J., West, S. G., & Finch, J. F. (1996). The robustness of test statistics to nonnormality and specification error in confirmatory factor analysis. Psychological Methods, 1(1), 16–29. doi: 10.1037/1082-989X.1.1.16
   Web of Science ®Google Scholar
• Davison, A. C. (2003). Statistical models. Cambridge, UK: Cambridge University Press.
   Google Scholar
• Davison, A. C. & Hinkley, D. V. (1997). Bootstrap methods and their application. New York, NY: Cambridge University Press.
   Google Scholar
• Deković, M., Asscher, J. J., Manders, W. A., Prins, P. J. M., & van der Laan, P. (2012). Within-intervention change: Mediators of intervention effects during multisystemic therapy. Journal of Consulting and Clinical Psychology, 80(4), 574–587. doi: 10.1037/a0028482
   PubMed Web of Science ®Google Scholar
• Duane, S., Kennedy, A. D., Pendleton, B. J., & Roweth, D. (1987). Hybrid Monte Carlo. Physics Letters B, 195(2), 216–222. doi: 10.1016/0370-2693(87)91197-X
   Web of Science ®Google Scholar
• Efron, B. (1987). Better bootstrap confidence intervals. Journal of the American Statistical Association, 82(397), 171–185. doi: 10.2307/2289144
   Web of Science ®Google Scholar
• Efron, B., & Tibshirani, R. J. (1993). An introduction to the bootstrap. New York, NY: Chapman and Hall.
   Google Scholar
• Falk, C. F. (2018). Are robust standard errors the best approach for interval estimation with nonnormal data in structural equation modeling? Structural Equation Modeling: A Multidisciplinary Journal, 25(2), 244–266. doi: 10.1080/10705511.2017.1367254
   Web of Science ®Google Scholar
• Falk, C. F., & Biesanz, J. C. (2015). Inference and interval estimation methods for indirect effects with latent variable models. Structural Equation Modeling: A Multidisciplinary Journal, 22, 24–38. doi: 10.1080/10705511.2014.935266
   Google Scholar
• Finch, J. F., West, S. G., & MacKinnon, D. P. (1997). Effects of sample size and nonnormality on the estimation of mediated effects in latent variable models. Structural Equation Modeling: A Multidisciplinary Journal, 4(2), 87–107. doi: 10.1080/10705519709540063
   Web of Science ®Google Scholar
• Fox, J. (2016). Applied regression analysis and generalized linear models (3rd ed.). Los Angeles, CA: SAGE.
   Google Scholar
• Freedman, D. A. (2006). On the so-called “Huber Sandwich Estimator” and “Robust Standard Errors.”. The American Statistician, 60(4), 299–302. doi: 10.1198/000313006X152207
   Web of Science ®Google Scholar
• Fritz, M. S., Taylor, A. B., & MacKinnon, D. P. (2012). Explanation of two anomalous results in statistical mediation analysis. Multivariate Behavioral Research, 47(1), 61–87. doi: 10.1080/00273171.2012.640596
   PubMed Web of Science ®Google Scholar
• Gabry, J., & Goodrich, B. (2018, April 13). Prior distributions for rstanarm models. Retrieved September 26, 2018, from Prior distributions for rstanarm models website: http://mc-stan.org/rstanarm/articles/priors.html#how-to-specify-flat-priors-and-why-you-typically-shouldnt
   Google Scholar
• Geman, S., & Geman, D. (1984). Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Transactions on Pattern Analysis and Machine Intelligence, PAMI-6(6), 721–741. doi: 10.1109/TPAMI.1984.4767596
   Web of Science ®Google Scholar
• Gilks, W. R., Richardson, S., & Spiegelhalter, D. J. (Eds.). (1998). Markov chain Monte Carlo in practice. Boca Raton, FL: Chapman & Hall.
   Google Scholar
• Graham, J. D., Martin Ginis, K. A., & Bray, S. R. (2017). Exertion of self-control increases fatigue, reduces task self-efficacy, and impairs performance of resistance exercise. Sport, Exercise, and Performance Psychology, 6(1), 70–88. doi: 10.1037/spy0000074
   Web of Science ®Google Scholar
• Hastings, W. K. (1970). Monte Carlo sampling methods using Markov chains and their applications. Biometrika, 57(1), 97–109. doi: 10.1093/biomet/57.1.97
   Web of Science ®Google Scholar
• Hayes, A. F. (2013). Introduction to mediation, moderation, and conditional process analysis: A regression-based approach. New York, NY: The Guilford Press.
   Google Scholar
• Hayes, A. F., & Scharkow, M. (2013). The relative trustworthiness of inferential tests of the indirect effect in statistical mediation analysis does method really matter? Psychological Science, 24(10), 1918–1927. doi: 10.1177/0956797613480187
   PubMed Web of Science ®Google Scholar
• Henze, N., & Zirkler, B. (1990). A class of invariant consistent tests for multivariate normality. Communications in Statistics - Theory and Methods, 19(10), 3595–3617. doi: 10.1080/03610929008830400
   Web of Science ®Google Scholar
• Holland, P. W. (1988). Causal inference, path analysis, and recursive structural equations models. Sociological Methodology, 18, 449–484. doi: 10.2307/271055
   Google Scholar
• Huber, P. J. (1967). The behavior of maximum likelihood estimates under nonstandard conditions. Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, I, 221–233. Berkeley, CA: University of California Press.
   Google Scholar
• Huertas-Valdivia, I., Llorens-Montes, F. J., & Ruiz-Moreno, A. (2018). Achieving engagement among hospitality employees: A serial mediation model. International Journal of Contemporary Hospitality Management, 30(1), 217–241. doi: 10.1108/IJCHM-09-2016-0538
   Web of Science ®Google Scholar
• Imai, K., Keele, L., & Tingley, D. (2010). A general approach to causal mediation analysis. Psychological Methods, 15(4), 309–334. doi: 10.1037/a0020761
   PubMed Web of Science ®Google Scholar
• Jaccard, J., & Wan, C. K. (1995). Measurement error in the analysis of interaction effects between continuous predictors using multiple regression: Multiple indicator and structural equation approaches. Psychological Bulletin, 117(2), 348–357. doi: 10.1037/0033-2909.117.2.348
   Web of Science ®Google Scholar
• Kline, R. B. (2016). Principles and practice of structural equation modeling (4th ed.). New York, NY: Guilford.
   Google Scholar
• Koning, I. M., Maric, M., MacKinnon, D., & Vollebergh, W. A. M. (2015). Effects of a combined parent–student alcohol prevention program on intermediate factors and adolescents’ drinking behavior: A sequential mediation model. Journal of Consulting and Clinical Psychology, 83(4), 719–727. doi: 10.1037/a0039197
   PubMed Web of Science ®Google Scholar
• Lehmann, E. L., & Romano, J. P. (2005). Testing statistical hypotheses (3rd ed.). New York, NY: Springer.
   Google Scholar
• MacCallum, R. C., & Austin, J. T. (2000). Applications of structural equation modeling in psychological research. Annual Review of Psychology, 51(1), 201–226. doi: 10.1146/annurev.psych.51.1.201
   PubMed Web of Science ®Google Scholar
• MacKinnon, D. P. (2008). Introduction to statistical mediation analysis. New York, NY: Erlbaum.
   Google Scholar
• MacKinnon, D. P., Lockwood, C. M., Hoffman, J. M., West, S. G., & Sheets, V. (2002). A comparison of methods to test mediation and other intervening variable effects. Psychological Methods, 7(1), 83–104. doi: 10.1037//1082-989X.7.1.83
   PubMed Web of Science ®Google Scholar
• MacKinnon, D. P., Lockwood, C. M., & Williams, J. (2004). Confidence limits for the indirect effect: Distribution of the product and resampling methods. Multivariate Behavioral Research, 39(1), 99–128. doi: 10.1207/s15327906mbr3901_4
   PubMed Web of Science ®Google Scholar
• MacKinnon, D. P., & Pirlott, A. G. (2015). Statistical approaches for enhancing causal interpretation of the M to Y relation in mediation analysis. Personality and Social Psychology Review, 19(1), 30–43. doi: 10.1177/1088868314542878
   PubMed Web of Science ®Google Scholar
• Mardia, K. V. (1970). Measures of multivariate skewness and kurtosis with applications. Biometrika, 57(3), 519–530. doi: 10.1093/biomet/57.3.519
   Web of Science ®Google Scholar
• McConahay, J. B. (1986). Modern racism, ambivalence, and the Modern Racism Scale. In J. F. Dovidio & S. L. Gaertner (Eds.), Prejudice, discrimination, and racism (pp. 91–126). Orlando, FL: Academic Press.
   Google Scholar
• McElreath, R. (2016). Statistical rethinking: A Bayesian course with examples in R and Stan. Boca Raton, FL: CRC Press.
   Google Scholar
• Mecklin, C. J., & Mundfrom, D. J. (2005). A Monte Carlo comparison of the Type I and Type II error rates of tests of multivariate normality. Journal of Statistical Computation and Simulation, 75(2), 93–107. doi: 10.1080/0094965042000193233
   Web of Science ®Google Scholar
• Meeker, W. Q., & Escobar, L. A. (1995). Teaching about approximate confidence regions based on maximum likelihood estimation. The American Statistician, 49, 48. doi: 10.2307/2684811
   Web of Science ®Google Scholar
• Metropolis, N., & Ulam, S. (1949). The Monte Carlo method. Journal of the American Statistical Association, 44(247), 335–341. doi: 10.2307/2280232
   PubMed Web of Science ®Google Scholar
• Micceri, T. (1989). The unicorn, the normal curve, and other improbable creatures. Psychological Bulletin, 105(1), 156–166. doi: 10.1037/0033-2909.105.1.156
   Web of Science ®Google Scholar
• Muth, C., Oravecz, Z., & Gabry, J. (2018). User-friendly Bayesian regression modeling: A tutorial with rstanarm and shinystan. The Quantitative Methods for Psychology, 14(2), 99–119. doi: 10.20982/tqmp.14.2.p099
   Web of Science ®Google Scholar
• Muthén, B. O., & Asparouhov, T. (2012). Bayesian structural equation modeling: A more flexible representation of substantive theory. Psychological Methods, 17(3), 313–335. doi: 10.1037/a0026802
   PubMed Web of Science ®Google Scholar
• Neal, R. M. (2011). MCMC using Hamiltonian dynamics. In S. Brooks, A. Gelman, G. L. Jones, & X.-L. Meng (Eds.), Handbook of Markov Chain Monte Carlo (pp. 113–162). Boca Raton, FL: Chapman & Hall/CRC.
   Google Scholar
• Neale, M. C., Hunter, M. D., Pritikin, J. N., Zahery, M., Brick, T. R., Kirkpatrick, R. M., … Boker, S. M. (2016). OpenMx 2.0: Extended structural equation and statistical modeling. Psychometrika, 81(2), 535–549. doi: 10.1007/s11336-014-9435-8
   PubMed Web of Science ®Google Scholar
• Neale, M. C., & Miller, M. B. (1997). The use of likelihood-based confidence intervals in genetic models. Behavior Genetics, 27(2), 113–120.
   PubMed Web of Science ®Google Scholar
• Nevitt, J., & Hancock, G. (2001). Performance of bootstrapping approaches to model test statistics and parameter standard error estimation in structural equation modeling. Structural Equation Modeling: A Multidisciplinary Journal, 8(3), 353–377. doi: 10.1207/S15328007SEM0803_2
   Web of Science ®Google Scholar
• Olsson, U. H., Foss, T., Troye, S. V., & Howell, R. D. (2000). The performance of ML, GLS, and WLS estimation in structural equation modeling under conditions of misspecification and nonnormality. Structural Equation Modeling: A Multidisciplinary Journal, 7(4), 557–595. doi: 10.1207/S15328007SEM0704_3
   Web of Science ®Google Scholar
• Pawitan, Y. (2001). In all likelihood: Statistical modelling and inference using likelihood. New York, NY: Oxford University Press.
   Google Scholar
• Pek, J., & Wu, H. (2015). Profile likelihood-based confidence intervals and regions for structural equation models. Psychometrika, 80(4), 1123–1145. doi: 10.1007/s11336-015-9461-1
   PubMed Web of Science ®Google Scholar
• Pratto, F., Sidanius, J., Stallworth, L. M., & Malle, B. F. (1994). Social dominance orientation: A personality variable predicting social and political attitudes. Journal of Personality and Social Psychology, 67(4), 741–763. doi: 10.1037//0022-3514.67.4.741
   Web of Science ®Google Scholar
• Preacher, K. J., & Hayes, A. F. (2008). Asymptotic and resampling strategies for assessing and comparing indirect effects in multiple mediator models. Behavior Research Methods, 40(3), 879–891. doi: 10.3758/BRM.40.3.879
   PubMed Web of Science ®Google Scholar
• Preacher, K. J., & Selig, J. P. (2012). Advantages of Monte Carlo confidence intervals for indirect effects. Communication Methods and Measures, 6(2), 77–98. doi: 10.1080/19312458.2012.679848
   Google Scholar
• Reh, S., Tröster, C., & Van Quaquebeke, N. (2018). Keeping (future) rivals down: Temporal social comparison predicts coworker social undermining via future status threat and envy. Journal of Applied Psychology, 103(4), 399–415. doi: 10.1037/apl0000281
   PubMed Web of Science ®Google Scholar
• Rosseel, Y. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48, 1–36.
   Web of Science ®Google Scholar
• Sanchez, D. T., Chaney, K. E., Manuel, S. K., Wilton, L. S., & Remedios, J. D. (2017). Stigma by prejudice transfer: Racism threatens White women and sexism threatens men of color. Psychological Science, 28(4), 445–461. doi: 10.1177/0956797616686218
   PubMed Web of Science ®Google Scholar
• Satorra, A., & Bentler, P. M. (2010). Ensuring positiveness of the scaled difference chi-square test statistic. Psychometrika, 75(2), 243–248. doi: 10.1007/s11336-009-9135-y
   PubMed Web of Science ®Google Scholar
• Savalei, V. (2014). Understanding robust corrections in structural equation modeling. Structural Equation Modeling: A Multidisciplinary Journal, 21(1), 149–160. doi: 10.1080/10705511.2013.824793
   Web of Science ®Google Scholar
• Shrout, P. E., & Bolger, N. (2002). Mediation in experimental and nonexperimental studies: New procedures and recommendations. Psychological Methods, 7(4), 422–445. doi: 10.1037//1082-989X.7.4.422
   PubMed Web of Science ®Google Scholar
• Springer, M. D., & Thompson, W. E. (1966). The distribution of products of independent random variables. SIAM Journal on Applied Mathematics, 14(3), 511–526. doi: 10.1137/0114046
   Web of Science ®Google Scholar
• Stan Development Team. (2018). rstanarm: Bayesian applied regression modeling via Stan (Version 2.17.4). Retrieved from http://mc-stan.org/
   Google Scholar
• Taylor, A. B., MacKinnon, D. P., & Tein, J.-Y. (2008). Tests of the three-path mediated effect. Organizational Research Methods, 11(2), 241–269. doi: 10.1177/1094428107300344
   Web of Science ®Google Scholar
• Thoemmes, F., MacKinnon, D. P., & Reiser, M. R. (2010). Power analysis for complex mediational designs using Monte Carlo methods. Structural Equation Modeling : A Multidisciplinary Journal, 17(3), 510–534. doi: 10.1080/10705511.2010.489379
   PubMed Web of Science ®Google Scholar
• Tofighi, D., Hsiao, Y.-Y., Kruger, E. S., MacKinnon, D. P., Van Horn, M. L., & Witkiewitz, K. (2019). Sensitivity analysis of the no-omitted confounder assumption in latent growth curve mediation models. Structural Equation Modeling: A Multidisciplinary Journal, 26(1), 94–109. https://doi.org/10.1080/10705511.2018.1506925
   PubMed Web of Science ®Google Scholar
• Tofighi, D., & Kelley, K. (2016). Assessing omitted confounder bias in multilevel mediation models. Multivariate Behavioral Research, 51(1), 86–105. https://doi.org/10.1080/00273171.2015.1105736
   PubMed Web of Science ®Google Scholar
• Tofighi, D., & MacKinnon, D. P. (2016). Monte Carlo confidence intervals for complex functions of indirect effects. Structural Equation Modeling: A Multidisciplinary Journal, 23(2), 194–205. https://doi.org/10.1080/10705511.2015.1057284
   Web of Science ®Google Scholar
• Vale, C. D., & Maurelli, V. A. (1983). Simulating multivariate nonnormal distributions. Psychometrika, 48(3), 465–471. doi: 10.1007/BF02293687
   Web of Science ®Google Scholar
• VanderWeele, T. J. (2015). Explanation in causal inference: Methods for mediation and interaction. New York, NY: Oxford University Press.
   Google Scholar
• West, S. G., Finch, J. F., & Curran, P. J. (1995). Structural equation models with nonnormal variables: Problems and remedies. In R. H. Hoyle (Ed.), Structural equation modeling: Concepts, issues, and applications (pp. 56–75). Thousand Oaks, CA: SAGE.
   Google Scholar
• White, H. (1980). A heteroskedasticity-consistent covariance matrix estimator and a direct test for heteroskedasticity. Econometrica, 48(4), 817–838. doi: 10.2307/1912934
   Web of Science ®Google Scholar
• Williams, J., & MacKinnon, D. P. (2008). Resampling and distribution of the product methods for testing indirect effects in complex models. Structural Equation Modeling: A Multidisciplinary Journal, 15(1), 23–51. doi: 10.1080/10705510701758166
   PubMed Web of Science ®Google Scholar
• Yuan, K.-H., Hayashi, K., & Yanagihara, H. (2007). A class of population covariance matrices in the bootstrap approach to covariance structure analysis. Multivariate Behavioral Research, 42(2), 261–281. doi: 10.1080/00273170701360662
   PubMed Web of Science ®Google Scholar
• Yuan, Y., & MacKinnon, D. P. (2009). Bayesian mediation analysis. Psychological Methods, 14(4), 301–322. doi: 10.1037/a0016972
   PubMed Web of Science ®Google Scholar
• Zhang, X., & Savalei, V. (2016). Bootstrapping confidence intervals for fit indexes in structural equation modeling. Structural Equation Modeling: A Multidisciplinary Journal, 23(3), 392–408. doi: 10.1080/10705511.2015.1118692
   Web of Science ®Google Scholar
• Zhang, Z. (2016). Modeling error distributions of growth curve models through Bayesian methods. Behavior Research Methods, 48(2), 427–444. doi: 10.3758/s13428-015-0589-9
   PubMed Web of Science ®Google Scholar