776
Views
8
CrossRef citations to date
0
Altmetric
Original Articles

There is Nothing Magical about Bayesian Statistics: An Introduction to Epistemic Probabilities in Data Analysis for Psychology Starters

References

  • Ajzen, I., & Fishbein, M. (1975). A Bayesian analysis of attribution processes. Psychological Bulletin, 82(2), 261–277. https://doi.org/10.1037/h0076477
  • American Psychological Association. (2010). Publication manual of the American Psychological Association (6th ed.). American Psychological Association.
  • Badenes-Ribera, L., Frias-Navarro, D., Iotti, B., Bonilla-Campos, A., & Longobardi, C. (2016). Misconceptions of the p-value among Chilean and Italian Academic Psychologists. Frontiers in Psychology, 7, 1247. https://doi.org/10.3389/fpsyg.2016.01247
  • Bandyopadhyay, P. S., & Brittan, G. (2010). Two dogmas of strong objective Bayesianism. International Studies in the Philosophy of Science, 24(1), 45–65. https://doi.org/10.1080/02698590903467119
  • Bayarri, M. J., & Berger, J. O. (2004). The interplay of Bayesian and frequentist analysis. Statistical Science, 19(1), 58–80. https://doi.org/10.1214/088342304000000116
  • Bayes, T., & Price, M. (1763). An essay towards solving a problem in the doctrine of chances. By the late Rev. Mr. Bayes, FRS communicated by Mr. Price, in a letter to John Canton, AMFRS, Philosophical Transactions (1683–1775) (pp. 370–418). Royal Society Publishing.
  • Benjamin, D. J., Berger, J. O., Johannesson, M., Nosek, B. A., Wagenmakers, E.-J., Berk, R., Bollen, K. A., Brembs, B., Brown, L., Camerer, C., Cesarini, D., Chambers, C. D., Clyde, M., Cook, T. D., De Boeck, P., Dienes, Z., Dreber, A., Easwaran, K., Efferson, C., … Johnson, V. E. (2018). Redefine statistical significance. Nature Human Behaviour, 2(1), 6–10. https://doi.org/10.1038/s41562-017-0189-z
  • Berger, J. O. (2000). Bayesian analysis: A look at today and thoughts of tomorrow. Journal of the American Statistical Association, 95(452), 1269–1276. https://doi.org/10.1080/01621459.2000.10474328
  • Berger, J. O. (2006). The case for objective Bayesian analysis. Bayesian Analysis, 1(3), 385–402. https://doi.org/10.1214/06-BA115
  • Berger, J. O., & Berry, D. A. (1988). Statistical analysis and the illusion of objectivity. American Scientist, 76(2), 159–165. https://www.jstor.org/stable/27855070
  • Chalmers, A. F. (1982). What is this thing called science?: An assessment of the nature and status of science and its methods (2nd ed.) University of Queensland Press.
  • Chatard, A., Bocage-Barthélémy, Y., Selimbegović, L., & Guimond, S. (2017). The woman who wasn’t there: Converging evidence that subliminal social comparison affects self-evaluation. Journal of Experimental Social Psychology, 73, 1–13. https://doi.org/10.1016/j.jesp.2017.05.005
  • Cohen, J. (1994). The earth is round (p < .05). American Psychologist, 49(12), 997–1003. https://doi.org/10.1037/0003-066X.49.12.997
  • De Groot, A. D. (2014). The meaning of “significance” for different types of research [translated and annotated by Eric-Jan Wagenmakers, Denny Borsboom, Josine Verhagen, Rogier Kievit, Marjan Bakker, Angelique Cramer, Dora Matzke, Don Mellenbergh, and Han LJ van der Maas]. Acta Psychologica, 148, 188–194. https://doi.org/10.1016/j.actpsy.2014.02.001
  • Dienes, Z. (2008). Understanding psychology as a science: An introduction to scientific and statistical inference. Palgrave Macmillan.
  • Dienes, Z. (2011). Bayesian versus orthodox statistics: Which side are you on? Perspectives on Psychological Science: A Journal of the Association for Psychological Science, 6(3), 274–290. https://doi.org/10.1177/1745691611406920
  • Dienes, Z. (2014). Using Bayes to get the most out of non-significant results. Frontiers in Psychology, 5, 781. https://doi.org/10.3389/fpsyg.2014.00781
  • Dienes, Z. (2016). How Bayes Factors change scientific practice. Journal of Mathematical Psychology, 78, 78–89. https://doi.org/10.1016/j.jmp.2015.10.003
  • Dienes, Z. (2017, March 23–25). Conventions for using Bayes Factors [Paper presentation]. International Convention of Psychological Science.
  • Dienes, Z. (2019). How do I know what my theory predicts?. Advances in Methods and Practices in Psychological Science, 2(4), 364–377. https://doi.org/10.1177/2515245919876960
  • Dienes, Z., & Mclatchie, N. (2018). Four reasons to prefer Bayesian analyses over significance testing. Psychomonic Bulletin & Review, 25, 207–218. https://doi.org/10.3758/s13423-017-1266-z
  • Earp, B. D., & Trafimow, D. (2015). Replication, falsification, and the crisis of confidence in social psychology. Frontiers in Psychology, 6, 621. https://doi.org/10.3389/fpsyg.2015.00621
  • Edwards, W., Lindman, H., & Savage, L. J. (1963). Bayesian statistical inference for psychological research. Psychological Review, 70(3), 193–242. https://doi.org/10.1037/h0044139
  • Etz, A., & Vandekerckhove, J. (2016). A Bayesian perspective on the reproducibility project: Psychology. Plos One, 11(2), e0149794. https://doi.org/10.1371/journal.pone.0149794
  • Etz, A., & Vandekerckhove, J. (2018). Introduction to Bayesian inference for Psychology. Psychonomic Bulletin & Review, 25(1), 5–34. https://doi.org/10.3758/s13423-017-1262-3
  • Fisher, R. A. (1956). Statistical methods and scientific inference. Oliver & Boyd.
  • Fiske, S. T. (2004). Mind the gap: In praise of informal sources of formal theory. Personality and Social Psychology Review, 8(2), 132–137. https://doi.org/10.1207/s15327957pspr0802_6 
  • Gallistel, C. R. (2009). The importance of proving the null. Psychological Review, 116(2), 439–453. https://doi.org/10.1037/a0015251
  • Gamerman, D., & Lopes, H. F. (2006). Markov chain Monte Carlo: stochastic simulation for Bayesian inference. CRC Press.
  • Gelman, A. (2008). Objections to Bayesian statistics. Bayesian Analysis, 3(3), 445–449. https://doi.org/10.1214/08-BA318
  • Gelman, A. (2011). Induction and deduction in Bayesian data analysis. Rationality, Markets and Morals, 2, 67–78.
  • Gelman, A., & Hennig, C. (2017). Beyond subjective and objective in statistics. Journal of the Royal Statistical Society: Series A (Statistics in Society)), 180(4), 967–1033. https://doi.org/10.1111/rssa.12276
  • Gelman, A., & Shalizi, C. R. (2013). Philosophy and the practice of Bayesian statistics. The British Journal of Mathematical and Statistical Psychology, 66(1), 8–38. https://doi.org/10.1111/j.2044-8317.2011.02037.x
  • Gigerenzer, G. (1993). The superego, the ego, and the id in statistical reasoning. In G. Keren & C. Lewis (Eds.), A handbook for data analysis in the behavioral sciences: Methodological issues (pp. 311–339). Erlbaum.
  • Gigerenzer, G. (2004). Mindless statistics. The Journal of Socio-Economics, 33(5), 587–606. https://doi.org/10.1016/j.socec.2004.09.033
  • Gigerenzer, G., & Marewski, J. N. (2015). Surrogate science: The idol of a universal method for scientific inference. Journal of Management, 41(2), 421–440. https://doi.org/10.1177/0149206314547522
  • Gigerenzer, G., Krauss, S. & Vitouch,  (2004). The Null Ritual: What you always wanted to know about significance testing but were afraid to ask. In D. Kaplan (Ed.), The Sage handbook of quantitative methodology for the social sciences (pp. 391–408)Sage.
  • Goldstein, M. (2006). Subjective Bayesian analysis: Principles and practice. Bayesian Analysis, 1(3), 403–420. https://doi.org/10.1214/06-BA116
  • Gronau, Q. F., Ly, A., & Wagenmakers, E. J. (2020). Informed Bayesian t-tests. The American Statistician, 74(2), 137–143. https://doi.org/10.1080/00031305.2018.1562983
  • Hoijtink, H., & Chow, S.-M. (2017). Bayesian hypothesis testing: Editorial to the Special Issue on Bayesian data analysis. Psychological Methods, 22(2), 211–216. https://doi.org/10.1037/met0000143
  • Howard, G. S., Maxwell, S. E., & Fleming, K. J. (2000). The proof of the pudding: An illustration of the relative strengths of null hypothesis, meta-analysis, and Bayesian analysis. Psychological Methods, 5(3), 315–332. https://doi.org/10.1037/1082-989x.5.3.315
  • JASP Team. (2017). JASP (Version 0.8.2) [Computer software]. https://jasp-stats.org/
  • Jefferys, W. H., & Berger, J. O. (1992). Ockham’s razor and Bayesian analysis. American Scientist, 80(1), 64–72. http://www.jstor.org/stable/29774559
  • Jeffreys, H. (1961). Theory of probability (3rd ed.). Oxford University Press.
  • Johnson, V. E. (2013). Revised standards for statistical evidence. Proceedings of the National Academy of Sciences, 110(48), 19313–19317. https://doi.org/10.1073/pnas.1313476110
  • Kass, R. E., & Raftery, A. E. (1995). Bayes Factors. Journal of the American Statistical Association, 90(430), 773–795. https://doi.org/10.1080/01621459.1995.10476572
  • Krefeld-Schwalb, A., Witte, E. H., & Zenker, F. (2018). Hypothesis-testing demands trustworthy data-A simulation approach to inferential statistics advocating the research program strategy. Frontiers in Psychology, 9, 460. https://doi.org/10.3389/fpsyg.2018.00460
  • Kruschke, J. K. (2011). Bayesian assessment of null values via parameter estimation and model comparison. Perspectives on Psychological Science, 6(3), 299–312. https://doi.org/10.1177/1745691611406925
  • Kruschke, J. K. (2014). Doing Bayesian data analysis: a tutorial with R, JAGS, and Stan (2nd ed.). Academic Press.
  • Kruschke, J. K., & Liddell, T. M. (2018a). Bayesian data analysis for newcomers. Psychonomic Bulletin & Review, 25(1), 155–177. https://doi.org/10.3758/s13423-017-1272-1
  • Kruschke, J. K., & Liddell, T. M. (2018b). The Bayesian new statistics: Hypothesis testing, estimation, meta-analysis, and power analysis from a Bayesian perspective. Psychonomic Bulletin & Review, 25(1), 178–206. https://doi.org/10.3758/s13423-016-1221-4
  • Lakens, D. (2017). Equivalence tests: A practical primer for t tests, correlations, and meta-analyses. Social Psychological and Personality Science, 8(4), 355–362. https://doi.org/10.1177/1948550617697177
  • Lakens, D., Adolfi, F. G., Albers, C. J., Anvari, F., Apps, M. A. J., Argamon, S. E., Baguley, T., Becker, R. B., Benning, S. D., Bradford, D. E., Buchanan, E. M., Caldwell, A. R., Van Calster, B., Carlsson, R., Chen, S.-C., Chung, B., Colling, L. J., Collins, G. S., Crook, Z., … Zwaan, R. A. (2018). Justify your alpha. Nature Human Behaviour, 2(3), 168–171. https://doi.org/10.1038/s41562-018-0311-x
  • Laplace, P. S. (1814). Essai Philosophique sur les Probabilities [A philosophical essay on probabilities]. Courcier.
  • Lee, M. D., & Wagenmakers, E.-J. (2014). Bayesian cognitive modeling: A practical course. Cambridge University Press.
  • Liang, F., Paulo, R., Molina, G., Clyde, M. A., & Berger, J. O. (2008). Mixtures of g-priors for Bayesian variable selection. Journal of the American Statistical Association, 103(481), 410–423. https://doi.org/10.1198/016214507000001337
  • Lindley, D. V. (2000). The philosophy of statistics. Journal of the Royal Statistical Society: Series D (the Statistician), 49(3), 293–337. https://doi.org/10.1111/1467-9884.00238
  • Lindsay, D. S. (2015). Replication in psychological science. Psychological Science, 26(12), 1827–1832. https://doi.org/10.1177/0956797615616374
  • Liu, C. C., & Aitkin, M. (2008). Bayes Factors: Prior sensitivity and model generalizability. Journal of Mathematical Psychology, 52(6), 362–375. https://doi.org/10.1016/j.jmp.2008.03.002
  • Lodewyckx, T., Kim, W., Lee, M. D., Tuerlinckx, F., Kuppens, P., & Wagenmakers, E. J. (2011). A tutorial on Bayes Factor estimation with the product space method. Journal of Mathematical Psychology, 55(5), 331–347. https://doi.org/10.1016/j.jmp.2011.06.001
  • Lunn, D. J., Jackson, C., Best, N., Thomas, A., & Spiegelhalter, D. (2012). The BUGS book: A practical introduction to Bayesian analysis. CRC press.
  • Meehl, P. E. (1967). Theory-testing in psychology and physics: A methodological paradox. Philosophy of Science, 34(2), 103–115. https://doi.org/10.1086/288135
  • Meehl, P. E. (1978). Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology. Journal of Consulting and Clinical Psychology, 46(4), 806–834. https://doi.org/10.1037/0022-006X.46.4.806
  • Morey, R. D. (2015, January 30). On verbal categories for the interpretation of Bayes Factor. An R package on Bayesian data analysis. http://bayesfactor.blogspot.com/2015/01/on-verbal-categories-for-interpretation.html
  • Morey, R. D. (2017, March 23–25). Bayes Factors, BayesFactor and 'default' priors [Paper presentation]. International Convention of Psychological Science.
  • Morey, R. D., & Rouder, J. N. (2011). Bayes Factor approaches for testing interval null hypotheses. Psychological Methods, 16(4), 406–419. https://doi.org/10.1037/a0024377
  • Morey, R. D., & Rouder, J. N. (2015). BayesFactor R package (Version 0.9.12-2) [Computer Software].
  • Morey, R. D., Homer, S., & Proulx, T. (2018). Beyond statistics: Accepting the null hypothesis in mature sciences. Advances in Methods and Practices in Psychological Science, 1(2), 245–258. https://doi.org/10.1177/2515245918776023
  • Morey, R. D., Romeijn, J.-W., & Rouder, J. N. (2016). The philosophy of Bayes Factors and the quantification of statistical evidence. Journal of Mathematical Psychology, 72, 6–18. https://doi.org/10.1016/j.jmp.2015.11.001
  • Morey, R. D., Rouder, J. N., Pratte, M. S., & Speckman, P. L. (2011). Using MCMC chain outputs to efficiently estimate Bayes Factors. Journal of Mathematical Psychology, 55(5), 368–378. https://doi.org/10.1016/j.jmp.2011.06.004
  • Mulder, J., & Wagenmakers, E.-J. (2016). Editors’ introduction to the special issue “Bayes Factors for testing hypotheses in psychological research: Practical relevance and new developments”. Journal of Mathematical Psychology, 78, 1–5. https://doi.org/10.1016/j.jmp.2016.01.002
  • Myung, I. J., & Pitt, M. A. (1997). Applying Occam’s razor in modeling cognition: A Bayesian approach. Psychonomic Bulletin & Review, 4(1), 79–95. https://doi.org/10.3758/BF03210778
  • Neyman, J., & Pearson, E. S. (1933). On the problem of the most efficient tests of statistical hypotheses. Philosophical Transactions of the Royal Society of London, Series A, 231, 289–337. https://doi.org/10.1098/rsta.1933.0009
  • R Core Team. (2015). R: A language and environment for statistical computing. http://www.R-project.org/.
  • Richard, F. D., Bond, C. F., Jr., & Stokes-Zoota, J. J. (2003). One hundred years of social psychology quantitatively described. Review of General Psychology, 7(4), 331–363. https://doi.org/10.1037/1089-2680.7.4.331
  • Rouder, J. N. (2014). Optional stopping: No problem for Bayesians. Psychonomic Bulletin & Review, 21(2), 301–308. https://doi.org/10.3758/s13423-014-0595-4
  • Rouder, J. N., & Lu, J. (2005). An introduction to Bayesian hierarchical models with an application in the theory of signal detection. Psychonomic Bulletin & Review, 12(4), 573–604. https://doi.org/10.3758/bf03196750
  • Rouder, J. N., & Morey, R. D. (2012). Default Bayes Factors for model selection in regression. Multivariate Behavioral Research, 47(6), 877–903. https://doi.org/10.1080/00273171.2012.734737
  • Rouder, J. N., Morey, R. D., Speckman, P. L., & Province, J. M. (2012). Default Bayes Factors for ANOVA designs. Journal of Mathematical Psychology, 56(5), 356–374. https://doi.org/10.1016/j.jmp.2012.08.001
  • Rouder, J. N., Morey, R. D., Verhagen, J., Province, J. M., & Wagenmakers, E. (2016). Is there a free lunch in inference? Topics in Cognitive Science, 8(3), 520–547. https://doi.org/10.1111/tops.12214
  • Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D., & Iverson, G. (2009). Bayesian t tests for accepting and rejecting the null hypothesis. Psychonomic Bulletin & Review, 16(2), 225–237. https://doi.org/10.3758/PBR.16.2.225
  • Röver, C. (2020). Bayesian random-effects meta-analysis using the bayesmeta R package. Journal of Statistical Software, 93(6), 1–51. https://doi.org/10.18637/jss.v093.i06
  • Schönbrodt, F. D., & Wagenmakers, E.-J. (2017). Bayes Factor Design analysis: Planning for compelling evidence. Psychonomic Bulletin & Review, 25, 128–142. https://doi.org/10.3758/s13423-017-1230-y
  • Schönbrodt, F. D., Wagenmakers, E.-J., Zehetleitner, M., & Perugini, M. (2017). Sequential hypothesis testing with Bayes Factors: Efficiently testing mean differences. Psychological Methods, 22(2), 322–339. https://doi.org/10.1037/met0000061
  • Silberzahn, R., Uhlmann, E. L., Martin, D. P., Anselmi, P., Aust, F., Awtrey, E., Bahník, Š., Bai, F., Bannard, C., Bonnier, E., Carlsson, R., Cheung, F., Christensen, G., Clay, R., Craig, M. A., Dalla Rosa, A., Dam, L., Evans, M. H., Flores Cervantes, I., … Nosek, B. A. (2018). Many analysts, one data set: Making transparent how variations in analytic choices affect results. Advances in Methods and Practices in Psychological Science, 1(3), 337–356. https://doi.org/10.1177/2515245917747646
  • Sprenger, J. (2018). The objectivity of subjective Bayesianism. European Journal for Philosophy of Science, 8(3), 539–558. https://doi.org/10.1007/s13194-018-0200-1
  • Steegen, S., Tuerlinckx, F., Gelman, A., & Vanpaemel, W. (2016). Increasing transparency through a multiverse analysis. Perspectives on Psychological Science: A Journal of the Association for Psychological Science, 11(5), 702–712. https://doi.org/10.1177/1745691616658637
  • Stefan, A., Schönbrodt, F. D. (2017, January 17). Two meanings of priors, part II: Quantifying uncertainty about model parameters. http://www.nicebread.de/two-meanings-of-priors-2/
  • Świątkowski, W., & Dompnier, B. (2017). Replicability crisis in social psychology: Looking at the past to find new pathways for the future. International Review of Social Psychology, 30(1), 111–124. https://doi.org/10.5334/irsp.66
  • van de Schoot, R., Kaplan, D., Denissen, J., Asendorpf, J. B., Neyer, F. J., & Aken, M. A. (2014). A gentle introduction to Bayesian analysis: Applications to developmental research. Child Development, 85(3), 842–860. https://doi.org/10.1111/cdev.12169
  • van de Schoot, R., Winter, S. D., Ryan, O., Zondervan-Zwijnenburg, M., & Depaoli, S. (2017). A systematic review of Bayesian articles in psychology: The last 25 years. Psychological Methods, 22(2), 217–239. https://doi.org/10.1037/met0000100
  • von Mises, R. V. (1957). Probability, statistics, and truth. Dover Publications, Inc.
  • Wagenmakers, E. J., Wetzels, R., Borsboom, D., & van der Maas, H. (2011). Why psychologists must change the way they analyze their data: The case of psi: Comment on Bem (2011). Journal of Personality and Social Psychology, 100(3), 426–432. https://doi.org/10.1037/a0022790
  • Wagenmakers, E. J. (2007). A practical solution to the pervasive problems of p values. Psychonomic Bulletin & Review, 14(5), 779–804. https://doi.org/10.3758/bf03194105
  • Wagenmakers, E. J., Lee, M., Lodewyckx, T., & Iverson, G. J. (2008). Bayesian versus frequentist inference. In H. Hoijtink, I. Klugkist, & P. A. Boelen (Eds.), Bayesian evaluation of informative hypotheses (pp. 181–207). Springer.
  • Wagenmakers, E.-J., Love, J., Marsman, M., Jamil, T., Ly, A., Verhagen, J., Selker, R., Gronau, Q. F., Dropmann, D., Boutin, B., Meerhoff, F., Knight, P., Raj, A., van Kesteren, E.-J., van Doorn, J., Šmíra, M., Epskamp, S., Etz, A., Matzke, D., … Morey, R. D. (2018). Bayesian inference for psychology. Part II: Example applications with JASP. Psychonomic Bulletin & Review, 25(1), 58–76. https://doi.org/10.3758/s13423-017-1323-7
  • Wagenmakers, E.-J., Marsman, M., Jamil, T., Ly, A., Verhagen, J., Love, J., Selker, R., Gronau, Q. F., Šmíra, M., Epskamp, S., Matzke, D., Rouder, J. N., & Morey, R. D. (2018). Bayesian inference for psychology. Part I: Theoretical advantages and practical ramifications. Psychonomic Bulletin & Review, 25(1), 35–57. https://doi.org/10.3758/s13423-017-1343-3
  • Wasserstein, R. L., & Lazar, N. A. (2016). The ASA’s statement on p-values: Context, process, and purpose. The American Statistician, 70(2), 129–133. https://doi.org/10.1080/00031305.2016.1154108
  • Wetzels, R., & Wagenmakers, E. J. (2012). A default Bayesian hypothesis test for correlations and partial correlations. Psychonomic Bulletin & Review, 19(6), 1057–1064. https://doi.org/10.3758/s13423-012-0295-x
  • Wetzels, R., Grasman, R. P., & Wagenmakers, E. J. (2012). A default Bayesian hypothesis test for ANOVA designs. The American Statistician, 66(2), 104–111. https://doi.org/10.1080/00031305.2012.695956
  • Wetzels, R., Matzke, D., Lee, M. D., Rouder, J. N., Iverson, G. J., & Wagenmakers, E. J. (2011). Statistical evidence in experimental psychology: An empirical comparison using 855 t tests. Perspectives on Psychological Science: A Journal of the Association for Psychological Science, 6(3), 291–298. https://doi.org/10.1177/1745691611406923
  • Wetzels, R., Raaijmakers, J. G., Jakab, E., & Wagenmakers, E. J. (2009). How to quantify support for and against the null hypothesis: a flexible WinBUGS implementation of a default Bayesian t test. Psychonomic Bulletin & Review, 16(4), 752–760. https://doi.org/10.3758/PBR.16.4.752
  • Williams, M., Bååth, R. A., & Philipp, M. C. (2017). Using Bayes Factors to test hypotheses in developmental research. Research in Human Development, 14(4), 321–317. https://doi.org/10.1080/15427609.2017.1370964
  • Williamson, J. (2010). In defence of objective Bayesianism. Oxford University Press.
  • Witte, E. H., & Zenker, F. (2017). From discovery to justification: Outline of an ideal Research Program in Empirical Psychology. Frontiers in Psychology, 8, 1847. https://doi.org/10.3389/fpsyg.2017.01847

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.