Advanced search
Publication Cover
The American Statistician Volume 73, 2019 - Issue sup1: Statistical Inference in the 21st Century: A World Beyond p < 0.05
Submit an article Journal homepage
26,204
Views
64
CrossRef citations to date
0
Altmetric
Getting to a Post “p<0.05” Era

Before p < 0.05 to Beyond p < 0.05: Using History to Contextualize p-Values and Significance Testing

Lee Kennedy-ShafferDepartment of Biostatistics, Harvard T.H. Chan School of Public Health, Cambridge, MACorrespondence[email protected]
View further author information
Pages 82-90 | Received 09 Mar 2018, Accepted 03 Oct 2018, Published online: 20 Mar 2019

Citations (64)

Keep up to date with the latest research on this topic with citation updates for this article.

Subscribe to citation updates

Read on this site (7)

Lee Kennedy-Shaffer. (2024) Teaching the Difficult Past of Statistics to Improve the Future. Journal of Statistics and Data Science Education 32:1, pages 108-119.
Read now
Billie Anderson, Nathan Mauck & Leigh Salzsieder. (2023) An experiment on information presentation and investor mutual fund selection. Cogent Economics & Finance 11:1.
Read now
Catherine O. Buck, Veronika Shabanova & Sarah N. Taylor. (2022) Growth patterns among late preterm infants of mothers with diabetes. The Journal of Maternal-Fetal & Neonatal Medicine 35:25, pages 10116-10123.
Read now
Rainer Schneider. (2022) Mobile phone induced EMF stress is reversed upon the use of protective devices: results from two experiments testing different boundary conditions. Electromagnetic Biology and Medicine 41:4, pages 429-438.
Read now
Joshua Habiger & Ye Liang. (2022) Publication Policies for Replicable Research and the Community-Wide False Discovery Rate. The American Statistician 76:2, pages 131-141.
Read now
Brian D. Segal. (2021) Toward Replicability With Confidence Intervals for the Exceedance Probability. The American Statistician 75:2, pages 128-138.
Read now
Ronald L. Wasserstein, Allen L. Schirm & Nicole A. Lazar. (2019) Moving to a World Beyond “p < 0.05”. The American Statistician 73:sup1, pages 1-19.
Read now

Articles from other publishers (57)

Farrokh Habibzadeh. (2024) Reinterpretation of the results of randomized clinical trials. PLOS ONE 19:6, pages e0305575.
Crossref
E. David Klonsky. (2024) Campbell’s Law Explains the Replication Crisis: Pre-Registration Badges Are History Repeating. Assessment.
Crossref
Timothy W Jones, Tanner Hendrick & Aaron M Chase. (2024) Heterogeneity, Bayesian thinking, and phenotyping in critical care: A primer. American Journal of Health-System Pharmacy.
Crossref
Madalen Goitia-Urdiain, Teresa Sauras-Yera, Gustavo A. Llorente & Eudald Pujol-Buxó. (2024) Software-dependent biases in the recognition of di- and tri-syllabic bird songs can create false interpretations of bird abundance and singing activity. Ecological Informatics 79, pages 102397.
Crossref
Gordana Popovic, Tanya Jane Mason, Szymon Marian Drobniak, Tiago André Marques, Joanne Potts, Rocío Joo, Res Altwegg, Carolyn Claire Isabelle Burns, Michael Andrew McCarthy, Alison Johnston, Shinichi Nakagawa, Louise McMillan, Kadambari Devarajan, Patrick Leo Taggart, Alison Wunderlich, Magdalena M. Mair, Juan Andrés Martínez‐Lanfranco, Malgorzata Lagisz & Patrice Pottier. (2024) Four principles for improved statistical ecology. Methods in Ecology and Evolution 15:2, pages 266-281.
Crossref
Rui Xu, Huan Zhang, Michael W Crowder & Jiangjiang Zhu. (2024) Multiple and Optimal Screening Subset: a method selecting global characteristic congeners for robust foodomics analysis. Briefings in Bioinformatics 25:2.
Crossref
Farrokh Habibzadeh. (2024) On the use of receiver operating characteristic curve analysis to determine the most appropriate p value significance threshold. Journal of Translational Medicine 22:1.
Crossref
Jiajun Yuan, Xijun Ke, Chenyang Zhang, Qingfeng Zhang, Chaozhe Jiang & Weiwei Cao. (2024) Recognition of Different Turning Behaviors of Pilots Based on Flight Simulator and fNIRS Data. IEEE Access 12, pages 32881-32893.
Crossref
Pan Hu & Lan Feng. (2023) The Risk of Water Quality Deterioration with Urban Flood Control—A Case in Wuxi. Sustainability 16:1, pages 185.
Crossref
Paraskevas Koukaras, Dimitrios Rousidis & Christos Tjortjis. (2023) Unraveling Microblog Sentiment Dynamics: A Twitter Public Attitudes Analysis towards COVID-19 Cases and Deaths. Informatics 10:4, pages 88.
Crossref
Catherine O. Buck, Veronika Shabanova, Reese H. Clark & Sarah N. Taylor. (2023) Diabetes in Pregnancy, Neonatal Morbidities, and Early Growth in Moderate or Late Preterm Infants. Pediatrics 152:6.
Crossref
Qin Li, Xiuguo Liu, Yulong Zhong, Mengmeng Wang, Hongbing Bai & Cuiyu Xiao. (2023) Assessing the interannual and subseasonal variabilities in water storage using multi-source soil moisture products and GRACE/GRACE-FO satellites and its applications. Journal of Hydrology 627, pages 130439.
Crossref
David Sidebotham, C. Jake Barlow, Janet Martin & Philip M. Jones. (2023) Interpreting frequentist hypothesis tests: insights from Bayesian inferenceInterprétation des tests d’hypothèses fréquentistes : des enseignements tirés de l’inférence bayésienne. Canadian Journal of Anesthesia/Journal canadien d'anesthésie 70:10, pages 1560-1575.
Crossref
Rini Kurnia Sari, Muhammad Alfarizi, Hartiwi Prabowo & Teguh Sriwidadi. (2023) Analysis Impact of the Production Technology Used by MSMEs on Consumer Satisfaction and Loyalty. Analysis Impact of the Production Technology Used by MSMEs on Consumer Satisfaction and Loyalty.
Matthew F. Dilisio. (2023) Editorial Commentary: Illuminating the Fragility of Nonsignificant Trials in Sports Medicine. Arthroscopy: The Journal of Arthroscopic & Related Surgery 39:9, pages 2084-2085.
Crossref
Carol Nash. (2023) Gender: A Postmodern Idea Developed in Association with the Modern Concept of Sex in Considering the Implications for Evolving Sexuality. Sexes 4:3, pages 411-428.
Crossref
Ivan A. Blokhin, Maria R. Kodenko, Yuliya F. Shumskaya, Anna P. Gonchar & Roman V. Reshetnikov. (2023) Hypothesis testing using R. Digital Diagnostics 4:2, pages 238-247.
Crossref
Duygu Uygun Tunç, Mehmet Necip Tunç & Daniël Lakens. (2023) The epistemic and pragmatic function of dichotomous claims based on statistical hypothesis tests. Theory & Psychology 33:3, pages 403-423.
Crossref
Suyash Shukla & Sandeep Kumar. (2022) Know-UCP: locally weighted linear regression based approach for UCP estimation. Applied Intelligence 53:11, pages 13488-13505.
Crossref
Zhonghua Ai, Churou Tang, Puxian Peng, Xuan Wen & Songyuan Tang. (2023) Prevalence and influencing factors of chronic pain in middle-aged and older adults in China: results of a nationally representative survey. Frontiers in Public Health 11.
Crossref
Adrienne K. Ho, Kristen E. Zamperoni, Anthony M. H. Ho & Glenio B. Mizubuti. (2022) Introducing the fragility index—A case study using the Term Breech Trial. Birth 50:1, pages 11-15.
Crossref
Elizaveta M. Kazakova, Elizaveta M. Solovyeva, Lev I. Levitsky, Julia A. Bubis, Daria D. Emekeeva, Anastasia A. Antonets, Alexey A. Nazarov, Mikhail V. Gorshkov & Irina A. Tarasova. (2022) Proteomics‐based scoring of cellular response to stimuli for improved characterization of signaling pathway activity. PROTEOMICS 23:5.
Crossref
Jesper N. Wulff, Gwendolin B. Sajons, Ganna Pogrebna, Sirio Lonati, Nicolas Bastardoz, George C. Banks & John Antonakis. (2023) Common methodological mistakes. The Leadership Quarterly 34:1, pages 101677.
Crossref
Philip M. Sedgwick. 2023. Teaching Biostatistics in Medicine and Allied Health Sciences. Teaching Biostatistics in Medicine and Allied Health Sciences 31 42 .
Kleber Neves, Pedro B. Tan & Olavo B. Amaral. (2022) Are most published research findings false in a continuous universe?. PLOS ONE 17:12, pages e0277935.
Crossref
Charles F. Hildebolt. (2022) The use and presentation of statistical assessments in oral and maxillofacial radiology research: Red flags and essentials. Part 1. Oral Surgery, Oral Medicine, Oral Pathology and Oral Radiology.
Crossref
Jae H. Kim. (2021) Moving to a world beyond p-value < 0.05: a guide for business researchers. Review of Managerial Science 16:8, pages 2467-2493.
Crossref
Philip M. Sedgwick, Anne Hammer, Ulrik Schiøler Kesmodel & Lars Henning Pedersen. (2022) Current controversies: Null hypothesis significance testing. Acta Obstetricia et Gynecologica Scandinavica 101:6, pages 624-627.
Crossref
Maximilian Maier & Daniël Lakens. (2022) Justify Your Alpha: A Primer on Two Practical Approaches. Advances in Methods and Practices in Psychological Science 5:2, pages 251524592210803.
Crossref
Saeed Mian Qaisar, Sibghatullah I. Khan, Dominique Dallet, Ryszard Tadeusiewicz & Paweł Pławiak. (2022) Signal-piloted processing metaheuristic optimization and wavelet decomposition based elucidation of arrhythmia for mobile healthcare. Biocybernetics and Biomedical Engineering 42:2, pages 681-694.
Crossref
Ruth C. Butler. (2021) Popularity leads to bad habits: Alternatives to “the statistics” routine of significance, “alphabet soup” and dynamite plots. Annals of Applied Biology 180:2, pages 182-195.
Crossref
Leonhard Held & Robert AJ Matthews. (2022) Carl Liebermeister and the emergence of modern medical statistics, Part 1: his remarkable work in historical context. Journal of the Royal Society of Medicine 115:2, pages 69-72.
Crossref
Zhengxiao Wei, Aijun Yang, Leno Rocha, Michelle F. Miranda & Farouk S. Nathoo. (2022) A Review of Bayesian Hypothesis Testing and Its Practical Implementations. Entropy 24:2, pages 161.
Crossref
Adrienne K. Ho. (2021) The Fragility Index for Assessing the Robustness of the Statistically Significant Results of Experimental Clinical Studies. Journal of General Internal Medicine 37:1, pages 206-211.
Crossref
Norbert Hirschauer, Sven Grüner & Oliver MußhoffNorbert Hirschauer, Sven Grüner & Oliver Mußhoff. 2022. Fundamentals of Statistical Inference. Fundamentals of Statistical Inference 63 96 .
Lee Thompson, Michael Hill, Fiona Lecky & Gary Shaw. (2021) Defining major trauma: a Delphi study. Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine 29:1.
Crossref
Felix M. Kluxen, Klaus Weber, Christian Strupp, Signe M. Jensen, Ludwig A. Hothorn, Jean-Christophe Garcin & Thomas Hofmann. (2021) Using historical control data in bioassays for regulatory toxicology. Regulatory Toxicology and Pharmacology 125, pages 105024.
Crossref
Austin Chia & Margaret L. Kern. (2020) Subjective Wellbeing and the Social Responsibilities of Business: an Exploratory Investigation of Australian Perspectives. Applied Research in Quality of Life 16:5, pages 1881-1908.
Crossref
Mikko Ketokivi & Saku Mantere. (2021) What warrants our claims? A methodological evaluation of argument structure. Journal of Operations Management 67:6, pages 755-776.
Crossref
Wyatt P. BenskenVanessa P. HoFredric M. Pieracci. (2021) Basic Introduction to Statistics in Medicine, Part 2: Comparing Data. Surgical Infections 22:6, pages 597-603.
Crossref
Wyatt P. BenskenFredric M. PieracciVanessa P. Ho. (2021) Basic Introduction to Statistics in Medicine, Part 1: Describing Data. Surgical Infections 22:6, pages 590-596.
Crossref
Ruoyi Xie, Yiyang Xu, Jinhui Yang & Shaozhi Zhang. (2021) Indoor air quality investigation of a badminton hall in humid season through objective and subjective approaches. Science of The Total Environment 771, pages 145390.
Crossref
Stephen J. Ruberg. (2020) Détente: A Practical Understanding of P values and Bayesian Posterior Probabilities . Clinical Pharmacology & Therapeutics 109:6, pages 1489-1498.
Crossref
Myriam Nonaka, Marcelo Kovalsky, Mónica Agüero & Alejandro Hnilo. (2021) Testing how different levels of entanglement affect predictability in practical setups. Quantum Information Processing 20:5.
Crossref
Mark P. Cote, James H. Lubowitz, Jefferson C. Brand & Michael J. Rossi. (2021) Misinterpretation of P Values and Statistical Power Creates a False Sense of Certainty: Statistical Significance, Lack of Significance, and the Uncertainty Challenge. Arthroscopy: The Journal of Arthroscopic & Related Surgery 37:4, pages 1057-1063.
Crossref
Leonid Hanin. (2021) Cavalier Use of Inferential Statistics Is a Major Source of False and Irreproducible Scientific Findings. Mathematics 9:6, pages 603.
Crossref
И.Т. Габдрахманов, М.В. Горшков & И.А. Тарасова. (2021) Клеточный ответ на стресс в панорамной протеомике: контроль ложноположительных результатов. Биохимия 86:3, pages 395-408.
Crossref
Ildar T. Gabdrakhmanov, Mikhail V. Gorshkov & Irina A. Tarasova. (2021) Proteomics of Cellular Response to Stress: Taking Control of False Positive Results. Biochemistry (Moscow) 86:3, pages 338-349.
Crossref
Stanley S Levinson. (2021) The Predicament of Large Numbers of Observations and How We Got There: Critical Review. The Journal of Applied Laboratory Medicine 6:2, pages 496-509.
Crossref
Raphael R. Perim, Mohamed El-Chami, Elisa J. Gonzalez-Rothi & Gordon S. Mitchell. (2021) Baseline Arterial CO2 Pressure Regulates Acute Intermittent Hypoxia-Induced Phrenic Long-Term Facilitation in Rats. Frontiers in Physiology 12.
Crossref
Khalid A. AlSaleh. (2021) Clinical Trials Before, During, and After COVID-19 Pandemic. American Journal of Clinical Oncology 44:2, pages 90-91.
Crossref
Nausicaa Berselli, Tommaso Filippini, Giorgia Adani & Marco Vinceti. 2021. Toxicological Risk Assessment and Multi-System Health Impacts from Exposure. Toxicological Risk Assessment and Multi-System Health Impacts from Exposure 309 321 .
Signe M. Jensen, Felix M. Kluxen, Jens C. Streibig, Nina Cedergreen & Christian Ritz. (2020) bmd : an R package for benchmark dose estimation . PeerJ 8, pages e10557.
Crossref
Arielle Marks‐Anglin & Yong Chen. (2020) A historical review of publication bias. Research Synthesis Methods 11:6, pages 725-742.
Crossref
Qian Zhou, Zuli Li, Linlan Song, Di Mu, Jin Wang, Li Tian & Yong Liao. (2020) Whole-exome mutational landscape of metastasis in patient-derived hepatocellular carcinoma cells. Genes & Diseases 7:3, pages 380-391.
Crossref
James B. Schreiber. (2020) New paradigms for considering statistical significance: A way forward for health services research journals, their authors, and their readership. Research in Social and Administrative Pharmacy 16:4, pages 591-594.
Crossref
Simon Hug. (2019) Just Say No to p < x (∀ x  ∊ (0, 1]), *s and Other Evil Things . Swiss Political Science Review 25:3, pages 312-321.
Crossref

Related research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.