Statistical Guidance to Authors at Top-Ranked Journals across Scientific Disciplines

References

• Aiken, L. S., West, S. G., and Millsap, R. E. (2008), “Doctoral Training in Statistics, Measurement, and Methodology in Psychology: Replication and Extension of Aiken, West, Sechrest, and Reno’s (1990) survey of PhD programs in North America,” The American Psychologist, 63, 32–50. DOI: 10.1037/0003-066X.63.1.32.
   PubMed Web of Science ®Google Scholar
• Altman, D. G. (1982), “Statistics in Medical Journals,” Statistics in Medicine, 1, 59–71. DOI: 10.1002/sim.4780010109.
   PubMedGoogle Scholar
• Altman, D. G. (1994), “The Scandal of Poor Medical Research,” British Medical Journal (Clinical Research ed.), 308, 283–284. DOI: 10.1136/bmj.308.6924.283..
   PubMed Web of Science ®Google Scholar
• Altman, D. G., Gore, S. M., Gardner, M. J., and Pocock, S. J. (1983), “Statistical Guidelines for Contributors to Medical Journals,” British Medical Journal (Clinical Research ed.), 286, 1489–1493. DOI: 10.1136/bmj.286.6376.1489.
   PubMed Web of Science ®Google Scholar
• Aust, F., and Barth, M. (2020), “Papaja: Create APA Manuscripts with rmarkdown,” available at https://github.com/crsh/papaja
   Google Scholar
• Bailar, J. C., and Mosteller, F. (1988), “Guidelines for Statistical Reporting in Articles for Medical Journals,” Annals of Internal Medicine, 108, 266–273. DOI: 10.7326/0003-4819-108-2-266.
   PubMed Web of Science ®Google Scholar
• Benjamin, D. J., Berger, J. O., Johannesson, M., Nosek, B. A., Wagenmakers, E.-J., Berk, R., Bollen, K. A., Brembs, B., Brown, L., Camerer, C., Cesarini, D., Chambers, C. D., Clyde, M., Cook, T. D., De Boeck, P., Dienes, Z., Dreber, A., Easwaran, K., Efferson, C., Fehr, E., Fidler, F., Field, A. P., Forster, M., George, E. I., Gonzalez, R., Goodman, S., Green, E., Green, D. P., Greenwald, A. G., Hadfield, J. D., Hedges, L. V., Held, L., Hua Ho, T., Hoijtink, H., Hruschka, D. J., Imai, K., Imbens, G., Ioannidis, J. P. A., Jeon, M., Jones, J. H., Kirchler, M., Laibson, D., List, J., Little, R., Lupia, A., Machery, E., Maxwell, S. E., McCarthy, M., Moore, D. A., Morgan, S. L., Munafó, M., Nakagawa, S., Nyhan, B., Parker, T. H., Pericchi, L., Perugini, M., Rouder, J., Rousseau, J., Savalei, V., Schönbrodt, F. D., Sellke, T., Sinclair, B., Tingley, D., Van Zandt, T., Vazire, S., Watts, D. J., Winship, C., Wolpert, R. L., Xie, Y., Young, C., Zinman, J., and Johnson, V. E. (2018), “Redefine Statistical Significance,” Nature Human Behaviour, 2, 6–10. DOI: 10.1038/s41562-017-0189-z.
   PubMed Web of Science ®Google Scholar
• Cumming, G. (2014), “The New Statistics: Why and How,” Psychological Science, 25, 7–29. DOI: 10.1177/0956797613504966.
   PubMed Web of Science ®Google Scholar
• Fidler, F., Thomason, N., Cumming, G., Finch, S., and Leeman, J. (2004), “Editors can Lead Researchers to Confidence Intervals, but can’t make them think: Statistical Reform Lessons from Medicine,” Psychological Science, 15, 119–126. DOI: 10.1111/j.0963-7214.2004.01502008.x.
   PubMed Web of Science ®Google Scholar
• Finch, S., Cumming, G., Williams, J., Palmer, L., Griffith, E., Alders, C., Anderson, J., and Goodman, O. (2004), “Reform of Statistical Inference in Psychology: The Case of Memory & Cognition,” Behavior Research Methods, Instruments, & Computers, 36, 312–324. DOI: 10.3758/BF03195577.
   PubMedGoogle Scholar
• Fricker, R. D., Burke, K., Han, X., and Woodall, W. H. (2019), “Assessing the Statistical Analyses used in Basic and Applied Social Psychology after their p-value Ban,” The American Statistician, 73, 374–384. DOI: 10.1080/00031305.2018.1537892.
   Web of Science ®Google Scholar
• Gigerenzer, G. (2018), “Statistical Rituals: The Replication Delusion and How We Got There,” Advances in Methods and Practices in Psychological Science, 1, 198–218. DOI: 10.1177/2515245918771329.
   Google Scholar
• Giofrè, D., Cumming, G., Fresc, L., Boedker, I., and Tressoldi, P. (2017), “The Influence of Journal Submission Guidelines on Authors’ Reporting of Statistics and Use of Open Research Practices,” PloS One, 12, e0175583. DOI: 10/f93jf8.
   PubMed Web of Science ®Google Scholar
• Goodman, S. N. (1999), “Toward Evidence-based Medical Statistics. 2: The Bayes Factor,” Annals of Internal Medicine, 130, 1005–1013. DOI: 10.7326/0003-4819-130-12-199906150-00019.
   PubMed Web of Science ®Google Scholar
• Goodman, S. N. (2019), “Why is Getting Rid of p-values so Hard? Musings on Science and Statistics,” The American Statistician, 73, 26–30. DOI: 10.1080/00031305.2018.1558111..
   Web of Science ®Google Scholar
• Hardwicke, T. E., Frank, M. C., Vazire, S., and Goodman, S. N. (2019), “Should Psychology Journals Adopt Specialized Statistical Review?” Advances in Methods and Practices in Psychological Science, 2, 240–249. DOI: 10.1177/2515245919858428.
   Google Scholar
• Hardwicke, T. E., and Goodman, S. N. (2020), “How often do Leading Biomedical Journals Use Statistical Experts to Evaluate Statistical Methods? The Results of a Survey,” PloS One, 15, e0239598. DOI: 10.1371/journal.pone.0239598.
   PubMed Web of Science ®Google Scholar
• Hardwicke, T. E., Serghiou, S., Janiaud, P., Danchev, V., Crüwell, S., Goodman, S. N., and Ioannidis, J. P. A. (2020), “Calibrating the Scientific Ecosystem through Meta-Research,” Annual Review of Statistics and Its Application, 7, 11–37. DOI: 10.1146/annurev-statistics-031219-041104.
   Web of Science ®Google Scholar
• Iverson, G. J., Lee, M. D., Zhang, S., and Wagenmakers, E.-J. (2009), “prep: An Agony in Five Fits,” Journal of Mathematical Psychology, 53, 195–202. DOI: 10.1016/j.jmp.2008.09.004.
   Web of Science ®Google Scholar
• Killeen, P. R. (2005), “An Alternative to Null-Hypothesis Significance Tests,” Psychological Science, 16, 345–353. DOI: 10.1111/j.0956-7976.2005.01538.x.
   PubMed Web of Science ®Google Scholar
• Kruschke, J. K., and Liddell, T. M. (2018), “Bayesian Data Analysis for Newcomers,” Psychonomic Bulletin & Review, 25, 155–177. DOI: 10.3758/s13423-017-1272-1.
   PubMed Web of Science ®Google Scholar
• Lakens, D., Adolfi, F. G., Albers, C. J., Anvari, F., Apps, M. A. J., Argamon, S. E., Baguley, T., Becker, R. B., Benning, S. D., Bradford, D. E., Buchanan, E. M., Caldwell, A. R., Van Calster, B., Carlsson, R., Chen, S.-C., Chung, B., Colling, L. J., Collins, G. S., Crook, Z., Cross, E. S., Daniels, S., Danielsson, H., DeBruine, L., Dunleavy, D. J., Earp, B. D., Feist, M. I., Ferrell, J. D., Field, J. G., Fox, N. W., Friesen, A., Gomes, C., Gonzalez-Marquez, M., Grange, J. A., Grieve, A. P., Guggenberger, R., Grist, J., van Harmelen, A.-L., Hasselman, F., Hochard, K. D., Hoffarth, M. R., Holmes, N. P., Ingre, M., Isager, P. M., Isotalus, H. K., Johansson, C., Juszczyk, K., Kenny, D. A., Khalil, A. A., Konat, B., Lao, J., Larsen, E. G., Lodder, G. M. A., Lukavský, J., Madan, C. R., Manheim, D., Martin, S. R., Martin, A. E., Mayo, D. G., McCarthy, R. J., McConway, K., McFarland, C., Nio, A. Q. X., Nilsonne, G., de Oliveira, C. L., de Xivry, J.-J. O., Parsons, S., Pfuhl, G., Quinn, K. A., Sakon, J. J., Saribay, S. A., Schneider, I. K., Selvaraju, M., Sjoerds, Z., Smith, S. G., Smits, T., Spies, J. R., Sreekumar, V., Steltenpohl, C. N., Stenhouse, N., Świątkowski, W., Vadillo, M. A., Van Assen, M. A. L. M., Williams, M. N., Williams, S. E., Williams, D. R., Yarkoni, T., Ziano, I., and Zwaan, R. A. (2018), “Justify your Alpha,” Nature Human Behaviour, 2, 168–171. DOI: 10.1038/s41562-018-0311-x.
   Web of Science ®Google Scholar
• Malički, M., Aalbersberg, I. J., Bouter, L., and ter Riet, G. (2019), “Journals’ Instructions to Authors: A Cross-sectional Study across Scientific Disciplines,” PloS One, 14, e0222157. DOI: 10.1371/journal.pone.0222157.
   PubMed Web of Science ®Google Scholar
• Malički, M., Jerončić, A., Aalbersberg, I. J., Bouter, L., and ter Riet, G. (2021), “Systematic Review and Meta-Analyses of Studies Analysing Instructions to Authors from 1987 to 2017,” Nature Communications, 12, 5840. DOI: 10.1038/s41467-021-26027-y.
   PubMed Web of Science ®Google Scholar
• Malički, M., Jerončić, A., ter Riet, G., Bouter, L. M., Ioannidis, J. P. A., Goodman, S. N., and Aalbersberg, I. J. (2020), “Preprint Servers’ Policies, Submission Requirements, and Transparency in Reporting and Research Integrity Recommendations,” JAMA, 324, 1901–1903. DOI: 10.1001/jama.2020.17195.
   PubMed Web of Science ®Google Scholar
• Mayo, D. G. (2018), Statistical Inference as Severe Testing: How to Get beyond the Statistics Wars (1st ed.), Cambridge: Cambridge University Press. https://www.cambridge.org/core/product/identifier/9781107286184/type/book
   Google Scholar
• Mayo, D. G. (2021), “The Statistics Wars and Intellectual Conflicts of Interest,” Conservation Biology, 36, e13861. DOI: 10.1111/cobi.13861..
   PubMed Web of Science ®Google Scholar
• McShane, B. B., Gal, D., Gelman, A., Robert, C., and Tackett, J. L. (2019), “Abandon Statistical Significance,” The American Statistician, 73, 235–245. DOI: 10.1080/00031305.2018.1527253.
   Web of Science ®Google Scholar
• Nieuwenhuis, S., Forstmann, B. U., and Wagenmakers, E.-J. (2011), “Erroneous Analyses of Interactions in Neuroscience: A Problem of Significance,” Nature Neuroscience, 14, 1105–1107. DOI: 10.1038/nn.2886.
   PubMed Web of Science ®Google Scholar
• R Core Team (2021), R: A Language and Environment for Statistical Computing, Vienna, Austria: R Foundation for Statistical Computing, Available at https://www.R-project.org/.
   Google Scholar
• Schriger, D. L., Arora, S., and Altman, D. G. (2006), “The Content of Medical Journal Instructions for Authors,” Annals of Emergency Medicine, 48, 743–749.e4. DOI: 10.1016/j.annemergmed.2006.03.028.
   PubMed Web of Science ®Google Scholar
• Sedlmeier, P., and Gigerenzer, G. (1989), “Do Studies of Statistical Power have an Effect on the Power of Studies?” Psychological Bulletin, 105, 309–316. DOI: 10.1037/0033-2909.105.2.309.
   Web of Science ®Google Scholar
• Smith, R. (2005), “Statistical Review for Medical Journals, Journal’s Perspective,” in Encyclopedia of Biostatistics, eds. P. Armitage and T. Colton, New Jersey: Wiley. DOI: 10.1002/0470011815.b2a17141..
   Google Scholar
• Strasak, A. M., Zaman, Q., Marinell, G., Pfeiffer, K. P., and Ulmer, H. (2007), “The Use of Statistics in Medical Eesearch: A Comparison of the New England Journal of Medicine and Nature Medicine,” The American Statistician, 61, 47–55. DOI: 10.1198/000313007X170242.
   Web of Science ®Google Scholar
• Trafimow, D., and Marks, M. (2015), “Editorial,” Basic and Applied Social Psychology, 37, 1–2. DOI: 10.1080/01973533.2015.1012991.
   Web of Science ®Google Scholar
• Turner, L., Shamseer, L., Altman, D. G., Weeks, L., Peters, J., Kober, T., Dias, S., Schulz, K. F., Plint, A. C., and Moher, D. (2012), “Consolidated Standards of Reporting Trials (CONSORT) and the Completeness of Reporting of Randomised Controlled Trials (RCTs) Published in Medical Journals,” The Cochrane Database of Systematic Reviews, 11, MR000030. DOI: 10.1002/14651858.MR000030.pub2.
   PubMed Web of Science ®Google Scholar
• Wagenmakers, E.-J. (2007), “A Practical Solution to the Pervasive Problems of p values,” Psychonomic Bulletin & Review, 14, 779–804. DOI: 10.3758/BF03194105.
   PubMed Web of Science ®Google Scholar
• Wasserstein, R. L., and Lazar, N. A. (2016), “The ASA’s Statement on p-values: Context, Process, and Purpose,” The American Statistician, 70, 129–133. DOI: 10.1080/00031305.2016.1154108.
   Web of Science ®Google Scholar
• Wasserstein, R. L., Schirm, A. L., and Lazar, N. A. (2019), “Moving to a World Beyond “p < 0.05”,” The American Statistician, 73, 1–19. DOI: 10.1080/00031305.2019.1583913..
   Web of Science ®Google Scholar
• Windish, D. M., Huot, S. J., and Green, M. L. (2007), “Medicine Residents’ understanding of the Biostatistics and Results in the Medical Literature,” JAMA, 298, 1010–1022. DOI: 10.1001/jama.298.9.1010.
   PubMed Web of Science ®Google Scholar
• Xie, Y. (2017), Dynamic Documents with R and Knitr, Boca Raton, FL: CRC Press.
   Google Scholar