Bayesian evaluation of behavior change interventions: a brief introduction and a practical example

References

• Abraham, C., Johnson, B. T., de Bruin, M., & Luszczynska, A. (2014). Enhancing reporting of behavior change intervention evaluations. JAIDS Journal of Acquired Immune Deficiency Syndromes, 66, S293–S299. doi: 10.1097/QAI.0000000000000231
   PubMed Web of Science ®Google Scholar
• Andrews, M., & Baguley, T. (2013). Prior approval: The growth of Bayesian methods in psychology. British Journal of Mathematical and Statistical Psychology, 66(1), 1–7. doi: 10.1111/bmsp.12004
   PubMed Web of Science ®Google Scholar
• Beard, E., Dienes, Z., Muirhead, C., & West, R. (2016). Using Bayes factors for testing hypotheses about intervention effectiveness in addictions research. Addiction, 111(12), 2230–2247. doi: 10.1111/add.13501
   PubMed Web of Science ®Google Scholar
• Beard, E., & West, R. (2017). Using Bayesian statistics in health psychology: A comment on Depaoli et al. (2017). Health Psychology Review, 11(3), 298–301. doi: 10.1080/17437199.2017.1349544
   PubMed Web of Science ®Google Scholar
• Benjamin, D. J., Berger, J. O., Johannesson, M., Nosek, B. A., Wagenmakers, E.-J., Berk, R., … Johnson, V. E. (2017). Redefine statistical significance. Nature Human Behaviour, 2, 6–10. doi: 10.1038/s41562-017-0189-z
   Web of Science ®Google Scholar
• Bolger, N., & Laurenceau, J.-P. (2013). Intensive longitudinal methods: An introduction to diary and experience sampling research. New York, NY: Guilford Press.
   Google Scholar
• Bürkner, P.-C. (2017). brms: An R package for Bayesian multilevel models using stan. Journal of Statistical Software, 80(1), 1–28. doi: 10.18637/jss.v080.i01
   Google Scholar
• Bürkner, P.-C., & Vuorre, M. (2018). Ordinal regression models in psychological research: A tutorial. Retrieved from https://psyarxiv.com/x8swp
   Google Scholar
• Craig, P., Dieppe, P., Macintyre, S., Michie, S., Nazareth, I., & Petticrew, M. (2008). Developing and evaluating complex interventions: The new medical research council guidance. BMJ, 337, a1655. doi: 10.1136/bmj.a1655
   PubMed Web of Science ®Google Scholar
• Cumming, G. (2014). The New Statistics. Psychological Science, 25(1), 7–29. doi: 10.1177/0956797613504966
   PubMed Web of Science ®Google Scholar
• Depaoli, S. (2013). Mixture class recovery in GMM under varying degrees of class separation: Frequentist versus Bayesian estimation. Psychological Methods, 18(2), 186. doi: 10.1037/a0031609
   PubMed Web of Science ®Google Scholar
• Depaoli, S., & Clifton, J. P. (2015). A Bayesian approach to multilevel structural equation modeling with continuous and dichotomous outcomes. Structural Equation Modeling: A Multidisciplinary Journal, 22(3), 327–351. doi: 10.1080/10705511.2014.937849
   Web of Science ®Google Scholar
• Depaoli, S., Rus, H. M., Clifton, J. P., Schoot, R. van de, & Tiemensma, J. (2017). An introduction to Bayesian statistics in health psychology. Health Psychology Review, 11(3), 248–264. doi: 10.1080/17437199.2017.1343676
   PubMed Web of Science ®Google Scholar
• Depaoli, S., & van de Schoot, R. (2017). Improving transparency and replication in Bayesian statistics: The WAMBS-checklist. Psychological Methods, 22(2), 240–261. doi: 10.1037/met0000065
   PubMed Web of Science ®Google Scholar
• Dienes, Z. (2008). Understanding psychology as a science: An introduction to scientific and statistical inference. Hampshire: Palgrave Macmillan.
   Google Scholar
• Efron, B. (2013). A 250-year argument: Belief, behavior, and the bootstrap. Bulletin of the American Mathematical Society, 50(1), 129–146. doi: 10.1090/S0273-0979-2012-01374-5
   Web of Science ®Google Scholar
• Eldridge, S. M., Lancaster, G. A., Campbell, M. J., Thabane, L., Hopewell, S., Coleman, C. L., & Bond, C. M. (2016). Defining feasibility and pilot studies in preparation for randomised controlled trials: Development of a conceptual framework. Plos One, 11(3), e0150205. doi: 10.1371/journal.pone.0150205
   PubMed Web of Science ®Google Scholar
• Etz, A. (2015). Using Bayes factors to get the most Out of linear regression: A practical guide using R. The Winnower. [online].
   Google Scholar
• Etz, A. (2017). Introduction to the concept of likelihood and its applications. PsyArXiv. doi: 10.17605/OSF.IO/85YWT
   Google Scholar
• Etz, A., Gronau, Q. F., Dablander, F., Edelsbrunner, P. A., & Baribault, B. (2017). How to become a Bayesian in eight easy steps: An annotated reading list. Psychonomic Bulletin & Review. doi: 10.3758/s13423-017-1317-5
   Web of Science ®Google Scholar
• Etz, A., & Vandekerckhove, J. (2017). Introduction to Bayesian inference for psychology. ‌Psychonomic Bulletin & Review, 25(1), 1–30.
   Web of Science ®Google Scholar
• Gabry, J. (2017). Bayesplot: Plotting for Bayesian models.
   Google Scholar
• Gelman, A. (2006). Prior distributions for variance parameters in hierarchical models (comment on article by Browne and Draper). Bayesian Analysis, 1(3), 515–534. doi: 10.1214/06-BA117A
   Web of Science ®Google Scholar
• Gelman, A. (2011). Induction and deduction in Bayesian data analysis. Rationality, Markets and Morals, 2, 67–78.
   Google Scholar
• Gelman, A., Carlin, J. B., Stern, H. S., Dunson, D. B., Vehtari, A., & Rubin, D. B. (2013). Bayesian data analysis, third edition. Boca Raton: Chapman and Hall/CRC.
   Google Scholar
• Gelman, A., & Hennig, C. (2017). Beyond subjective and objective in statistics. Journal of the Royal Statistical Society: Series A (Statistics in Society), 180(4), 967–1033. doi: 10.1111/rssa.12276
   Web of Science ®Google Scholar
• Gelman, A., & Hill, J. (2007). Data analysis using regression and multilevel/hierarchical models. New York, NY: Cambridge University Press.
   Google Scholar
• Gelman, A., & Rubin, D. B. (1995). Avoiding model selection in Bayesian social research. Sociological Methodology, 25, 165–173. doi: 10.2307/271064
   Web of Science ®Google Scholar
• Gelman, A., & Shalizi, C. R. (2013). Philosophy and the practice of Bayesian statistics. British Journal of Mathematical and Statistical Psychology, 66(1), 8–38. doi: 10.1111/j.2044-8317.2011.02037.x
   PubMed Web of Science ®Google Scholar
• Gigerenzer, G. (2004). Mindless statistics. The Journal of Socio-Economics, 33(5), 587–606. doi: 10.1016/j.socec.2004.09.033
   Google Scholar
• Gigerenzer, G., Krauss, S., & Vitouch, O. (2004). The null ritual. In D. Kaplan (Ed.), The Sage handbook of quantitative methodology for the social sciences (pp. 391–408). Thousand Oaks, CA: Sage.
   Google Scholar
• Gigerenzer, G., & Marewski, J. N. (2015). Surrogate science. Journal of Management, 41(2), 421–440. doi: 10.1177/0149206314547522
   Web of Science ®Google Scholar
• Gronau, Q. F., & Singmann, H. (2017). Bridge sampling: Bridge sampling for marginal likelihoods and Bayes factors. Retrieved from https://CRAN.R-project.org
   Google Scholar
• Haig, B. D. (2016). Tests of statistical significance made sound. Educational and Psychological Measurement. doi: 10.1177/0013164416667981
   PubMed Web of Science ®Google Scholar
• Hand, D. J. (1994). Deconstructing statistical questions. Journal of the Royal Statistical Society. Series A (Statistics in Society), 157(3), 317–356. doi: 10.2307/2983526
   Web of Science ®Google Scholar
• Hankonen, N., Heino, M. T. J., Araujo-Soares, V., Sniehotta, F. F., Sund, R., Vasankari, T., … Haukkala, A. (2016). ‘Let’s Move It’ – a school-based multilevel intervention to increase physical activity and reduce sedentary behaviour among older adolescents in vocational secondary schools: A study protocol for a cluster-randomised trial. BMC Public Health, 16, 247–466. doi: 10.1186/s12889-016-3094-x
   PubMed Web of Science ®Google Scholar
• Hankonen, N., Heino, M. T. J., Hynynen, S.-T., Laine, H., Araújo-Soares, V., Sniehotta, F. F., … Haukkala, A. (2017). Randomised controlled feasibility study of a school-based multi-level intervention to increase physical activity and decrease sedentary behaviour among vocational school students. International Journal of Behavioral Nutrition and Physical Activity, 14, 247. doi: 10.1186/s12966-017-0484-0
   Web of Science ®Google Scholar
• Hynynen, S.-T., van Stralen, M. M., Sniehotta, F. F., Araújo-Soares, V., Hardeman, W., Chinapaw, M. J. M., … Hankonen, N. (2016). A systematic review of school-based interventions targeting physical activity and sedentary behaviour among older adolescents. International Review of Sport and Exercise Psychology, 9(1), 22–44. doi: 10.1080/1750984X.2015.1081706
   PubMed Web of Science ®Google Scholar
• Jaeger, T. F. (2008). Categorical data analysis: Away from ANOVAs (transformation or not) and towards logit mixed models. Journal of Memory and Language, 59(4), 434–446. doi: 10.1016/j.jml.2007.11.007
   PubMed Web of Science ®Google Scholar
• Jamovi project. (2017). Jamovi.
   Google Scholar
• JASP Team, T. (2017). JASP.
   Google Scholar
• Kass, R. E. (2011). Statistical inference: The big picture. Statistical Science, 26(1), 1–9. doi: 10.1214/10-STS337
   PubMed Web of Science ®Google Scholar
• Kruschke, J. K. (2010). What to believe: Bayesian methods for data analysis. Trends in Cognitive Sciences, 14(7), 293–300. doi: 10.1016/j.tics.2010.05.001
   PubMed Web of Science ®Google Scholar
• Kruschke, J. K. (2013). Bayesian estimation supersedes the t test. Journal of Experimental Psychology: General, 142(2), 573–603. doi: 10.1037/a0029146
   PubMed Web of Science ®Google Scholar
• Kruschke, J. K. (2014). Doing Bayesian data analysis: A tutorial introduction with R (2nd ed.). Burlington, MA: Academic Press.
   Google Scholar
• Lakens, D., Adolfi, F. G., Albers, C., Anvari, F., Apps, M. A., Argamon, S. E., … Benning, S. D. (2017). Justify your alpha: A response to “redefine statistical significance”.
   Google Scholar
• Makel, M. C., Plucker, J. A., & Hegarty, B. (2012). Replications in psychology research? Perspectives on Psychological Science, 7(6), 537–542. doi: 10.1177/1745691612460688
   Web of Science ®Google Scholar
• Marsman, M., & Wagenmakers, E.-J. (2016). Three insights from a Bayesian interpretation of the one-sided P value. Educational and Psychological Measurement. doi: 10.1177/0013164416669201
   Web of Science ®Google Scholar
• Mayo, D. G. (1996). Error and the growth of experimental knowledge. Chicago: University of Chicago Press.
   Google Scholar
• Mayo, D. G. (2013a). Discussion: Bayesian methods: Applied? Yes. Philosophical defense? In flux. The American Statistician, 67(1), 11–15. doi: 10.1080/00031305.2012.752410
   Web of Science ®Google Scholar
• Mayo, D. G. (2013b). The error-statistical philosophy and the practice of Bayesian statistics: Comments on Gelman and Shalizi: ‘Philosophy and the practice of Bayesian statistics’. British Journal of Mathematical and Statistical Psychology, 66(1), 57–64. doi: 10.1111/j.2044-8317.2012.02064.x
   PubMed Web of Science ®Google Scholar
• Mayo, D. G. (2018). Statistical inference as severe testing: How to get beyond the statistics wars. Cambridge: Cambridge University Press.
   Google Scholar
• McElreath, R. (2016). Statistical rethinking: A Bayesian course with examples in R and Stan. Boca Raton, FL: CRC Press.
   Google Scholar
• McElreath, R. (2017). There is always prior information. Elements of Evolutionary Anthropology. Retrieved from https://web.archive.org/web/20171120224555/http://elevanth.org/blog/2017/08/22/there-is-always-prior-information/
   Google Scholar
• McGrayne, S. B. (2011). The theory that would not die: How Bayes’ rule cracked the enigma code, hunted down Russian submarines, & emerged triumphant from two centuries of controversy. New Haven: Yale University Press.
   Google Scholar
• McShane, B. B., Gal, D., Gelman, A., Robert, C., & Tackett, J. L. (2017). Abandon statistical significance. arXiv Preprint arXiv:1709.07588.
   Google Scholar
• Moore, G. F., Audrey, S., Barker, M., Bond, L., Bonell, C., Hardeman, W., … Baird, J. (2015). Process evaluation of complex interventions: Medical Research Council guidance. BMJ, 350, h1258. doi: 10.1136/bmj.h1258
   PubMed Web of Science ®Google Scholar
• Morey, R. D., Hoekstra, R., Rouder, J. N., Lee, M. D., & Wagenmakers, E.-J. (2015). The fallacy of placing confidence in confidence intervals. Psychonomic Bulletin & Review. doi: 10.3758/s13423-015-0947-8
   Web of Science ®Google Scholar
• Munafò, M. R., Nosek, B. A., Bishop, D. V. M., Button, K. S., Chambers, C. D., Sert, N. P. du, … Ioannidis, J. P. A. (2017). A manifesto for reproducible science. Nature Human Behaviour, 1, 0021. doi: 10.1038/s41562-016-0021
   PubMed Web of Science ®Google Scholar
• Navarro, D. J. (2015). Learning Statistics with R. Lulu.com
   Google Scholar
• Ng, J. Y., Ntoumanis, N., Thøgersen-Ntoumani, C., Deci, E. L., Ryan, R. M., Duda, J. L., & Williams, G. C. (2012). Self-determination theory applied to health contexts. Perspectives on Psychological Science, 7(4), 325–340. doi: 10.1177/1745691612447309
   PubMed Web of Science ®Google Scholar
• Nickerson, R. S. (2000). Null hypothesis significance testing: A review of an old and continuing controversy. Psychological Methods, 5(2), 241–301. doi: 10.1037/1082-989X.5.2.241
   PubMed Web of Science ®Google Scholar
• Phillips, N. D. (2015, October). YaRrr Chapter 1 – Installing R, RStudio, and the Yarrr package. https://www.youtube.com/watch?v=Vkv7-nw3wwU&list=PL9tt3I41HFS9gmeZFEuNrnu_7V_NFngfJ&index=1
   Google Scholar
• Phillips, N. D. (2017). YaRrr The Pirate’s Guide to R.
   Google Scholar
• Ravenzwaaij, D. van, Cassey, P., & Brown, S. D. (2016). A simple introduction to Markov Chain Monte sampling. Psychonomic Bulletin & Review, 1–12. doi: 10.3758/s13423-016-1015-8
   PubMed Web of Science ®Google Scholar
• R Core Team. (2017). R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing.
   Google Scholar
• Robert, C. P. (2016). The expected demise of the Bayes factor. Journal of Mathematical Psychology, 72, 33–37. doi: 10.1016/j.jmp.2015.08.002
   Web of Science ®Google Scholar
• Rothman, A. J. (2004). “Is there nothing more practical than a good theory?”: Why innovations and advances in health behavior change will arise if interventions are used to test and refine theory. International Journal of Behavioral Nutrition and Physical Activity, 1, 11. doi: 10.1186/1479-5868-1-11
   PubMedGoogle Scholar
• Rouder, J. N., Morey, R. D., Verhagen, J., Province, J. M., & Wagenmakers, E.-J. (2016). Is there a free lunch in inference? Topics in Cognitive Science, 8(3), 520–547. doi: 10.1111/tops.12214
   PubMed Web of Science ®Google Scholar
• RStudio Team. (2016). RStudio: Integrated development environment for R. Boston, MA: RStudio.
   Google Scholar
• Ryan, R. M., & Deci, E. L. (2000). Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American Psychologist, 55(1), 68. doi: 10.1037/0003-066X.55.1.68
   PubMed Web of Science ®Google Scholar
• Ryan, R. M., & Deci, E. L. (2017). Self-determination theory: Basic psychological needs in motivation, development, and wellness. New York: Guilford.
   Google Scholar
• Saarela, O. (2017, June). Monoreg: Bayesian monotonic regression using a marked point process construction.
   Google Scholar
• Saarela, O., & Arjas, E. (2015). Non-parametric Bayesian hazard regression for chronic disease risk assessment. Scandinavian Journal of Statistics, 42(2), 609–626. doi: 10.1111/sjos.12125
   Web of Science ®Google Scholar
• Schönbrodt, F. D., & Wagenmakers, E.-J. (2017). Bayes factor design analysis: Planning for compelling evidence. Psychonomic Bulletin & Review, 1–15. doi: 10.3758/s13423-017-1230-y
   PubMed Web of Science ®Google Scholar
• Stan Development Team. (2016a). RStan: The R interface to Stan.
   Google Scholar
• Stan Development Team. (2016b). Stan: A C++ library for probability and sampling, Version 2.15.0.
   Google Scholar
• van de Schoot, R., Broere, J. J., Perryck, K. H., Zondervan-Zwijnenburg, M., & Van Loey, N. E. (2015). Analyzing small data sets using Bayesian estimation: The case of posttraumatic stress symptoms following mechanical ventilation in burn survivors. European Journal of Psychotraumatology, 6. [online].
   Web of Science ®Google Scholar
• van de Schoot, R., Winter, S. D., Ryan, O., Zondervan-Zwijnenburg, M., & Depaoli, S. (2017). A systematic review of Bayesian articles in psychology: The last 25 years. Psychological Methods, 22(2), 217. doi: 10.1037/met0000100
   PubMed Web of Science ®Google Scholar
• Vuorre, M. (2016). Introduction to data analysis using R. JEPS Bulletin. Retrieved from http://blog.efpsa.org/2016/12/05/introduction-to-data-analysis-using-r/
   Google Scholar
• Vuorre, M., & Bolger, N. (2017). Within-subject mediation analysis for experimental data in cognitive psychology and neuroscience. Behavior Research Methods, 1–19. doi: 10.3758/s13428-017-0980-9
   PubMed Web of Science ®Google Scholar
• Vuorre, M., & Curley, J. P. (2017). Curating research assets in behavioral sciences: A tutorial on the GIT version control system. PsyArXiv Preprints. doi: 10.17605/OSF.IO/TXGN8
   Google Scholar
• Wasserstein, R. L., & Lazar, N. A. (2016). The ASA’s statement on p-values: Context, process, and purpose. The American Statistician. doi: 10.1080/00031305.2016.1154108
   Web of Science ®Google Scholar
• Wickham, H. (2016). Tidyverse: Easily install and load ‘Tidyverse’ packages. Retrieved from https://CRAN.R-project.org
   Google Scholar
• Wickham, H., & Francois, R. (2016). Dplyr: A grammar of data manipulation. Retrieved from http://CRAN.R-project.org
   Google Scholar
• Williams, D. R., & Martin, S. R. (2017). Rethinking robust statistics with modern Bayesian methods. PsyArXiv. doi: 10.17605/OSF.IO/VAW38
   Google Scholar
• Yarkoni, T., & Westfall, J. (2016). Choosing prediction over explanation in psychology: Lessons from machine learning. FigShare. doi: 10.6084/M9.figshare.2441878.v1
   Google Scholar