Detecting Prior-Data Disagreement in Bayesian Structural Equation Modeling

References

• Baldwin, S. A., & Fellingham, G. W. (2013). Bayesian methods for the analysis of small sample multilevel data with a complex variance structure. Psychological Methods, 18, 151–164.
   PubMed Web of Science ®Google Scholar
• Bauer, D. J., & Curran, P. J. (2003). Distributional assumptions of growth mixture models: Implications for overextraction of latent trajectory classes. Psychological Methods, 8, 338–363.
   PubMed Web of Science ®Google Scholar
• Betancourt, M. (2018). A conceptual introduction to Hamiltonian Monte Carlo.
   Google Scholar
• Bousquet, N. (2008). Diagnostics of prior-data agreement in applied Bayesian analysis. Journal of Applied Statistics, 35, 1011–1029.
   Web of Science ®Google Scholar
• Box, G. E. P. (1980). Sampling and Bayes’ inference in scientific modelling and robustness. Journal of the Royal Statistical Society. Series A (General), 143, 383.
   Web of Science ®Google Scholar
• Cover, T. M., & Thomas, J. A. T. (2006). Elements of information theory (2nd ed.). Hoboken, NJ: Wiley Interscience.
   Google Scholar
• Depaoli, S. (2013). Mixture class recovery in GMM under varying degrees of class separation: frequentist versus Bayesian estimation. Psychological Methods, 18, 186–219.
   PubMed Web of Science ®Google Scholar
• Depaoli, S. (2014). The impact of inaccurate “informative” priors for growth parameters in Bayesian growth mixture modeling. Structural Equation Modeling: A Multidisciplinary Journal, 21, 239–252.
   Web of Science ®Google Scholar
• Depaoli, S., & Clifton, J. P. (2015). A Bayesian approach to multilevel structural equation modeling with continuous and dichotomous outcomes. Structural Equation Modeling: A Multidisciplinary Journal, 22, 327–351.
   Web of Science ®Google Scholar
• Depaoli, S., Winter, S. D., & Visser, M. (2020). The importance of prior sensitivity analysis in Bayesian statistics: Demonstrations using an interactive shiny app. Frontiers in Psychology, 11, 608045.
   PubMed Web of Science ®Google Scholar
• Depaoli, S., Yang, Y., & Felt, J. (2017). Using Bayesian statistics to model uncertainty in mixture models: A sensitivity analysis of priors. Structural Equation Modeling: A Multidisciplinary Journal, 24, 198–215.
   Web of Science ®Google Scholar
• Egidi, L., Pauli, F., & Torelli, N. (2021). Avoiding prior-data conflict in regression models via mixture priors.
   Google Scholar
• Evans, M., & Moshonov, H. (2006). Checking for prior-data conflict. Bayesian Analysis, 1, 893–914.
   Web of Science ®Google Scholar
• Finch, W. H., & Miller, J. E. (2019). The use of incorrect informative priors in the estimation of MIMIC model parameters with small sample sizes. Structural Equation Modeling: A Multidisciplinary Journal, 26, 497–508.
   Web of Science ®Google Scholar
• Flora, D. B., & Curran, P. J. (2004). An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychological Methods, 9, 466–491.
   PubMed Web of Science ®Google Scholar
• García-Donato, G., & Chen, M.-H. (2005). Calibrating Bayes factor under prior predictive distributions. Statistica Sinic, 15, 359–380.
   Web of Science ®Google Scholar
• Gelman, A. (2008). Objections to Bayesian statistics. Bayesian Analysis, 3, 445–450.
   Web of Science ®Google Scholar
• Gelman, A., Simpson, D., & Betancourt, M. (2017). The prior can often only be understood in the context of the likelihood. Entropy, 19, 555.
   Web of Science ®Google Scholar
• Gronau, Q. F., Singmann, H., & Wagenmakers, E. J. (2020). Bridgesampling: An R package for estimating normalizing constants. Journal of Statistical Software, 92, 1–29.
   PubMed Web of Science ®Google Scholar
• Hoffman, M. D., & Gelman, A. (2014). The No-U-Turn sampler: Adaptively setting path lengths in Hamiltonian Monte Carlo. Journal of Machine Learning Research, 15, 1593–1623. http://mcmc-jags.sourceforge.net
   Web of Science ®Google Scholar
• Hoijtink, H., Mulder, J., Van Lissa, C., & Gu, X. (2019). A tutorial on testing hypotheses using the Bayes factor. Psychological Methods, 24, 539–556.
   PubMed Web of Science ®Google Scholar
• Holtmann, J., Koch, T., Lochner, K., & Eid, M. (2016). A comparison of ML, WLSMV, and Bayesian methods for multilevel structural equation models in small samples: A simulation study. Multivariate Behavioral Research, 51, 661–680.
   PubMed Web of Science ®Google Scholar
• Jeffreys, H. (1961). Theory of probability. Oxford, England: Clarendon Press.
   Google Scholar
• Kass, R. E., & Greenhouse, J. B. (1989). [Investigating therapies of potentially great benefit: ECMO]: Comment: A Bayesian perspective. Institute of Mathematical Statistics, 4, 310–317.
   Google Scholar
• Kass, R. E., & Raftery, A. E. (1995). Bayes factors. Journal of the American Statistical Association, 90, 773–795.
   Web of Science ®Google Scholar
• Kerr, N. L. (1998). HARKing: Hypothesizing after the results are known. Personality and Social Psychology Review, 2, 196–217.
   PubMedGoogle Scholar
• Kullback, S., & Leibler, R. A. (1951). On information and sufficiency. The Annals of Mathematical Statistics, 22, 79–86.
   Google Scholar
• Lek, K., & van de Schoot, R. (2019). How the choice of distance measure influences the detection of prior-data conflict. Entropy, 21, 446–463.
   PubMed Web of Science ®Google Scholar
• Liang, X., Kamata, A., & Li, J. (2020). Hierarchical Bayes approach to estimate the treatment effect for randomized controlled trials. Educational and Psychological Measurement, 80, 1090–1114.
   PubMed Web of Science ®Google Scholar
• Liu, C. C., & Aitkin, M. (2008). Bayes factors: Prior sensitivity and model generalizability. Journal of Mathematical Psychology, 52, 362–375.
   Web of Science ®Google Scholar
• Marcoulides, K. M. (2018). Careful with those priors: A note on Bayesian estimation in two-parameter logistic item response theory models. Measurement: Interdisciplinary Research and Perspectives, 16, 92–99.
   Web of Science ®Google Scholar
• McNeish, D. M. (2016). Using data-dependent priors to mitigate small sample bias in latent growth models: A discussion and illustration using Mplus. Journal of Educational and Behavioral Statistics, 41, 27–56.
   Web of Science ®Google Scholar
• McNeish, D. M., & Harring, J. R. (2017). Correcting model fit criteria for small sample latent growth models with incomplete data. Educational and Psychological Measurement, 77, 990–1018.
   PubMed Web of Science ®Google Scholar
• Merkle, E. C., & Rosseel, Y. (2018). blavaan: Bayesian structural equation models via parameter expansion. Journal of Statistical Software, 85, 1–30.
   PubMed Web of Science ®Google Scholar
• Miočević, M., Levy, R., Mackinnon, D. P., & Mio Cevi, C. A.,M. (2021). Different roles of prior distributions in the single mediator model with latent variables. Multivariate Behavioral Research, 56, 20–40.
   PubMed Web of Science ®Google Scholar
• Morey, R. D., & Rouder, J. N. (2011). Bayes factor approaches for testing interval null hypotheses. Psychological Methods, 16, 406–419.
   PubMed Web of Science ®Google Scholar
• Muthén, B. O., & Asparouhov, T. (2012). Bayesian structural equation modeling: A more flexible representation of substantive theory. Psychological Methods, 17, 313–335.
   PubMed Web of Science ®Google Scholar
• Muthén, L. K., & Muthén, B. O. (2017). Mplus user’s guide (8th ed.). Los Angeles, CA: Muthén & Muthén.
   Google Scholar
• R Core Team (2020). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. https://www.r-project.org/
   Google Scholar
• Rosseel, Y. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48, 1–36.
   Web of Science ®Google Scholar
• Rouder, J. N., Haaf, J. M., & Snyder, H. K. (2019). Minimizing mistakes in psychological science. Advances in Methods and Practices in Psychological Science, 2, 3–11.
   Google Scholar
• Rufo, M. J., Pérez, C. J., & Martín, J. (2010). Merging experts’ opinions: A Bayesian hierarchical model with mixture of prior distributions. European Journal of Operational Research, 207, 284–289.
   Web of Science ®Google Scholar
• Shi, D., & Tong, X. (2017). The impact of prior information on Bayesian latent basis growth model estimation. SAGE Open, 7, 215824401772703.
   Web of Science ®Google Scholar
• Shrout, P. E., & Rodgers, J. L. (2018). Psychology, science, and knowledge construction: Broadening perspectives from the replication crisis. Annual Review of Psychology, 69, 487–510.
   PubMed Web of Science ®Google Scholar
• Smid, S. C., & Winter, S. D. (2020). Dangers of the defaults: A tutorial on the impact of default priors when using Bayesian SEM with small samples. Frontiers in Psychology, 11, 611963.
   PubMed Web of Science ®Google Scholar
• Smid, S. C., Depaoli, S., & van de Schoot, R. (2020). Predicting a distal outcome variable from a latent growth model: ML versus Bayesian estimation. Structural Equation Modeling: A Multidisciplinary Journal, 27, 169–191.
   Web of Science ®Google Scholar
• Spiegelhalter, D. J., Freedman, L. S., & Parmar, M. K. B. (1994). Bayesian approaches to randomized trials. Journal of the Royal Statistical Society. Series A (Statistics in Society), 157, 357.
   Web of Science ®Google Scholar
• Stan Development Team (2020). RStan: The R interface to Stan. R package version 2.21.2. http://mc-stan.org/
   Google Scholar
• Thiele, C. (2021). cutpointr: Determine and Evaluate Optimal Cutpoints in Binary Classification Tasks (R package version 1.1.0.). https://cran.r-project.org/package=cutpointr
   Google Scholar
• van Erp, S., Mulder, J., & Oberski, D. L. (2018). Prior sensitivity analysis in default Bayesian structural equation modeling. Psychological Methods, 23, 363–388.
   PubMed Web of Science ®Google Scholar
• Vanpaemel, W. (2010). Prior sensitivity in theory testing: An apologia for the Bayes factor. Journal of Mathematical Psychology, 54, 491–498.
   Web of Science ®Google Scholar
• Veen, D., Egberts, M. R., van Loey, N. E. E., & van de Schoot, R. (2020). Expert elicitation for latent growth curve models: The case of posttraumatic stress symptoms development in children with burn injuries. Frontiers in Psychology, 11, 1197.
   PubMed Web of Science ®Google Scholar
• Veen, D., Stoel, D., Schalken, N., Mulder, K., & van de Schoot, R. (2018). Using the data agreement criterion to rank experts’ beliefs. Entropy, 20, 592–517.
   Web of Science ®Google Scholar
• Winter, S. D., & Depaoli, S. (in press). Sensitivity of Bayesian model fit indices to the prior specification of latent growth models. Structural Equation Modeling: A Mutlidisciplinary Journal.
   Google Scholar
• Young, K. D. S., & Pettit, L. I. (1996). Measuring discordancy between prior and data. Journal of the Royal Statistical Society: Series B (Methodological), 58, 679–689.
   Google Scholar
• Zitzmann, S., & Hecht, M. (2019). Going beyond convergence in Bayesian estimation: Why precision matters too and how to assess it. Structural Equation Modeling: A Multidisciplinary Journal, 26, 646–661.
   Web of Science ®Google Scholar