Moving to a World Beyond “p < 0.05”

References

References to articles in this special issue

• Amrhein, V., Trafimow, D., and Greenland, S. (2019), “Inferential Statistics as Descriptive Statistics: There Is No Replication Crisis If We Don’t Expect Replication,” The American Statistician, 73.
   Web of Science ®Google Scholar
• Anderson, A. (2019), “Assessing Statistical Results: Magnitude, Precision and Model Uncertainty,” The American Statistician, 73.
   Web of Science ®Google Scholar
• Benjamin, D., and Berger, J. (2019), “Three Recommendations for Improving the Use of p-Values,” The American Statistician, 73.
   Web of Science ®Google Scholar
• Betensky, R. (2019), “The p-Value Requires Context, Not a Threshold,” The American Statistician, 73.
   Web of Science ®Google Scholar
• Billheimer, D. (2019), “Predictive Inference and Scientific Reproducibility,” The American Statistician, 73.
   Web of Science ®Google Scholar
• Blume, J., Greevy, R., Welty, V., Smith, J., and DuPont, W. (2019), “An Introduction to Second Generation p-Value,” The American Statistician, 73.
   Web of Science ®Google Scholar
• Brownstein, N., Louis, T., O’Hagan, A., and Pendergast, J. (2019), “The Role of Expert Judgment in Statistical Inference and Evidence-Based Decision-Making,” The American Statistician, 73.
   PubMed Web of Science ®Google Scholar
• Calin-Jageman, R., and Cumming, G. (2019), “The New Statistics for Better Science: Ask How Much, How Uncertain, and What Else Is Known,” The American Statistician, 73.
   PubMed Web of Science ®Google Scholar
• Campbell, H., and Gustafson, P. (2019), “The World of Research Has Gone Berserk: Modeling the Consequences of Requiring ‘Greater Statistical Stringency’ for Scientific Publication,” The American Statistician, 73.
   Web of Science ®Google Scholar
• Colquhoun, D. (2019), “The False Positive Risk: A Proposal Concerning What to Do About p-Value,” The American Statistician, 73.
   Web of Science ®Google Scholar
• Fraser, D. (2019), “The p-Value Function and Statistical Inference,” The American Statistician, 73.
   Web of Science ®Google Scholar
• Fricker, R., Burke, K., Han, X., and Woodall, W (2019), “Assessing the Statistical Analyses Used in Basic and Applied Social Psychology After Their p-Value Ban,” The American Statistician, 73.
   Web of Science ®Google Scholar
• Gannon, M., Pereira, C., and Polpo, A. (2019), “Blending Bayesian and Classical Tools to Define Optimal Sample-Size-Dependent Significance Levels,” The American Statistician, 73.
   Web of Science ®Google Scholar
• Goodman, S. (2019), “Why is Getting Rid of p-Values So Hard? Musings on Science and Statistics,” The American Statistician, 73.
   Web of Science ®Google Scholar
• Goodman, W., Spruill, S., and Komaroff, E. (2019), “A Proposed Hybrid Effect Size Plus p-Value Criterion: Empirical Evidence Supporting Its Use,” The American Statistician, 73.
   Web of Science ®Google Scholar
• Greenland, S. (2019), “Valid p-Values Behave Exactly as They Should: Some Misleading Criticisms of p-Values and Their Resolution With s-Values,” The American Statistician, 73.
   Web of Science ®Google Scholar
• Heck, P., and Krueger, J. (2019), “Putting the p-Value in Its Place,” The American Statistician, 73.
   Web of Science ®Google Scholar
• Hubbard, D., and Carriquiry, A. (2019), “Quality Control for Scientific Research: Addressing Reproducibility, Responsiveness and Relevance,” The American Statistician, 73.
   Web of Science ®Google Scholar
• Hubbard, R. (2019), “Will the ASA’s Efforts to Improve Statistical Practice Be Successful? Some Evidence to the Contrary,” The American Statistician, 73.
   Web of Science ®Google Scholar
• Hubbard, R., Haig, B. D., and Parsa, R. A. (2019), “The Limited Role of Formal Statistical Inference in Scientific Inference,” The American Statistician, 73.
   Web of Science ®Google Scholar
• Hurlbert, S., Levine, R., and Utts, J. (2019), “Coup de Grâce for a Tough Old Bull: ‘Statistically Significant’ Expires,” The American Statistician, 73.
   Web of Science ®Google Scholar
• Ioannidis, J. (2019), “What Have We (Not) Learnt From Millions of Scientific Papers With p-Values?,” The American Statistician, 73.
   Web of Science ®Google Scholar
• Johnson, V. (2019), “Evidence From Marginally Significant t Statistics,” The American Statistician, 73.
   PubMed Web of Science ®Google Scholar
• Kennedy-Shaffer, L. (2019), “Before p < 0.05 to Beyond p < 0.05: Using History to Contextualize p-Values and Significance Testing,” The American Statistician, 73.
   PubMed Web of Science ®Google Scholar
• Kmetz, J. (2019), “Correcting Corrupt Research: Recommendations for the Profession to Stop Misuse of p-Values,” The American Statistician, 73.
   Web of Science ®Google Scholar
• Lavine, M. (2019), “Frequentist, Bayes, or Other?,” The American Statistician, 73.
   Web of Science ®Google Scholar
• Locascio, J. (2019), “The Impact of Results Blind Science Publishing on Statistical Consultation and Collaboration,” The American Statistician, 73.
   Web of Science ®Google Scholar
• Manski, C. (2019), “Treatment Choice With Trial Data: Statistical Decision Theory Should Supplant Hypothesis Testing,” The American Statistician, 73.
   Web of Science ®Google Scholar
• Manski, C., and Tetenov, A. (2019), “Trial Size for Near Optimal Choice between Surveillance and Aggressive Treatment: Reconsidering MSLT-II,” The American Statistician, 73.
   Web of Science ®Google Scholar
• Matthews, R. (2019), “Moving Toward the Post p < 0.05 Era Via the Analysis of Credibility,” The American Statistician, 73.
   Web of Science ®Google Scholar
• Maurer, K., Hudiburgh, L., Werwinski, L., and Bailer, J. (2019), “Content Audit for P-Value Principles in Introductory Statistics,” The American Statistician, 73.
   Web of Science ®Google Scholar
• McShane, B., Gal, D., Gelman, A., Robert, C., and Tackett, J. (2019), “Abandon Statistical Significance,” The American Statistician, 73.
   Web of Science ®Google Scholar
• McShane, B., Tackett, J., Böckenholt, U., and Gelman, A. (2019), “Large Scale Replication Projects in Contemporary Psychological Research,” The American Statistician, 73.
   Web of Science ®Google Scholar
• O’Hagan, A. (2019), “Expert Knowledge Elicitation: Subjective But Scientific,” The American Statistician, 73.
   PubMed Web of Science ®Google Scholar
• Pogrow, S. (2019), “How Effect Size (Practical Significance) Misleads Clinical Practice: The Case for Switching to Practical Benefit to Assess Applied Research Findings,” The American Statistician, 73.
   Web of Science ®Google Scholar
• Rose, S., and McGuire, T. (2019), “Limitations of p-Values and R-Squared for Stepwise Regression Building: A Fairness Demonstration in Health Policy Risk Adjustment,” The American Statistician, 73.
   PubMed Web of Science ®Google Scholar
• Rougier, J. (2019), “p-Values, Bayes Factors, and Sufficiency,” The American Statistician, 73.
   Web of Science ®Google Scholar
• Ruberg, S., Harrell, F., Gamalo-Siebers, M., LaVange, L., Lee J., Price K., and Peck C. (2019), “Inference and Decision-Making for 21st Century Drug Development and Approval,” The American Statistician, 73.
   Web of Science ®Google Scholar
• Steel, A., Liermann, M., and Guttorp, P. (2019), “Beyond Calculations: A Course in Statistical Thinking,” The American Statistician, 73.
   Web of Science ®Google Scholar
• Trafimow, D. (2019), “Five Nonobvious Changes in Editorial Practice for Editors and Reviewers to Consider When Evaluating Submissions in a Post p <.05 Universe,” The American Statistician, 73.
   Web of Science ®Google Scholar
• Tong, C. (2019), “Statistical Inference Enables Bad Science; Statistical Thinking Enables Good Science,” The American Statistician, 73.
   Web of Science ®Google Scholar
• van Dongen, N., Wagenmakers, E. J., van Doorn, J., Gronau, Q., van Ravenzwaaij, D., Hoekstra, R., Haucke, M., Lakens, D., Hennig, C., Morey, R., Homer, S., Gelman, A., and Sprenger, J. (2019), “Multiple Perspectives on Inference for Two Simple Statistical Scenarios,” The American Statistician, 73.
   Web of Science ®Google Scholar
• Ziliak, S. (2019), “How Large Are Your G-Values? Try Gosset’s Guinnessometrics When a Little ‘P’ is Not Enough,” The American Statistician, 73.
   Web of Science ®Google Scholar

Other articles or books referenced

• Boring, E. G. (1919), “Mathematical vs. Scientific Significance,” Psychological Bulletin, 16, 335–338. DOI: 10.1037/h0074554.
   Google Scholar
• Cumming, G. (2014), “The New Statistics: Why and How,” Psychological Science, 25, 7–29. DOI: 10.1177/0956797613504966.
   PubMed Web of Science ®Google Scholar
• Davidian, M., and Louis, T. (2012), “Why Statistics?” Science, 336, 12. DOI: 10.1126/science.1218685.
   PubMed Web of Science ®Google Scholar
• Edgeworth, F. Y. (1885), “Methods of Statistics,” Journal of the Statistical Society of London, Jubilee Volume, 181–217.
   Google Scholar
• Fisher, R. A. (1925), Statistical Methods for Research Workers, Edinburgh: Oliver & Boyd.
   Google Scholar
• Gelman, A. (2015), “Statistics and Research Integrity,” European Science Editing, 41, 13–14.
   Google Scholar
• Gelman, A. (2016), “The Problems With p-Values Are Not Just With p-Values,” The American Statistician, supplemental materials to ASA Statement on p-Values and Statistical Significance, 70, 1–2.
   Google Scholar
• Gelman, A., and Hennig, C. (2017), “Beyond Subjective and Objective in Statistics,” Journal of the Royal Statistical Society, Series A, 180, 967–1033. DOI: 10.1111/rssa.12276.
   Web of Science ®Google Scholar
• Gelman, A., and Stern, H. (2006), “The Difference Between ‘Significant’ and ‘Not Significant’ Is Not Itself Statistically Significant,” The American Statistician, 60, 328–331. DOI: 10.1198/000313006X152649.
   Web of Science ®Google Scholar
• Ghose, T. (2013), “‘Just a Theory’: 7 Misused Science Words,” Scientific American (online), available at https://www.scientificamerican.com/article/just-a-theory-7-misused-science-words/.
   Google Scholar
• Goodman, S. (2018), “How Sure Are You of Your Result? Put a Number on It,” Nature, 564.
   Web of Science ®Google Scholar
• Hubbard, R. (2016), Corrupt Research: The Case for Reconceptualizing Empirical Management and Social Science, Thousand Oaks, CA: Sage.
   Google Scholar
• Junger, S. (1997), The Perfect Storm: A True Story of Men Against the Sea, New York: W.W. Norton.
   Google Scholar
• Locascio, J. (2017), “Results Blind Science Publishing,” Basic and Applied Social Psychology, 39, 239–246. DOI: 10.1080/01973533.2017.1336093.
   PubMed Web of Science ®Google Scholar
• Mayo, D. (2018), “Statistical Inference as Severe Testing: How to Get Beyond the Statistics Wars,” Cambridge, UK: University Printing House.
   Google Scholar
• McShane, B., and Gal, D. (2016), “Blinding Us to the Obvious? The Effect of Statistical Training on the Evaluation of Evidence,” Management Science, 62, 1707–1718. DOI: 10.1287/mnsc.2015.2212.
   Web of Science ®Google Scholar
• McShane, B., and Gal, D. (2017), “Statistical Significance and the Dichotomization of Evidence.” Journal of the American Statistical Association, 112, 885–895. DOI: 10.1080/01621459.2017.1289846.
   Web of Science ®Google Scholar
• Mogil, J. S., and Macleod, M. R. (2017), “No Publication Without Confirmation,” Nature, 542, 409–411, available at https://www.nature.com/news/no-publication-without-confirmation-1.21509.
   PubMed Web of Science ®Google Scholar
• Rosenthal, R. (1979), “File Drawer Problem and Tolerance for Null Results,” Psychological Bulletin 86, 638–641. DOI: 10.1037/0033-2909.86.3.638.
   Web of Science ®Google Scholar
• Wasserstein, R., and Lazar, N. (2016), “The ASA’s Statement on p-Values: Context, Process, and Purpose,” The American Statistician, 70, 129–133. DOI: 10.1080/00031305.2016.1154108.
   Web of Science ®Google Scholar
• Wellek, S. (2017), “A Critical Evaluation of the Current p-Value Controversy” (with discussion), Biometrical Journal, 59, 854–900. DOI: 10.1002/bimj.201700001.
   PubMed Web of Science ®Google Scholar
• Ziliak, S., and McCloskey, D. (2008), The Cult of Statistical Significance: How the Standard Error Costs Us Jobs, Justice, and Lives, Ann Arbor, MI: University of Michigan Press.
   Google Scholar