References
- Abbott, Alison. 2016. “Culture of Silence and Nonchalance Protected Disgraced Trachea Surgeon (Updated).” Nature News, https://doi.org/10.1038/nature.2016.20533.
- Amrhein, Valentin, Fränzi Korner-Nievergelt, and Tobias Roth. 2017. “The Earth Is Flat (p > 0.05): Significance Thresholds and the Crisis of Unreplicable Research.” PeerJ 5: e3544: 1–40. https://doi.org/10.7717/peerj.3544.
- Baker, Monya. 2016. “1,500 Scientists Lift the Lid on Reproducibility.” Nature 533: 452–454. https://doi.org/10.1038/533452a.
- Barba, Lorena A. 2018. “Terminologies for Reproducible Research.” ArXiv:1802.03311 [Cs], February. http://arxiv.org/abs/1802.03311.
- Bartneck, Christoph, and Servaas Kokkelmans. 2011. “Detecting H-Index Manipulation Through Self-Citation Analysis.” Scientometrics 87: 85–98. https://doi.org/10.1007/s11192-010-0306-5.
- Benedictus, Rinze, Frank Miedema, and Mark W. J. Ferguson. 2016. “Fewer Numbers, Better Science.” Nature 538: 453–455. https://doi.org/10.1038/538453a.
- Benessia, Alice, Silvio Funtowicz, Mario Giampietro, Ângela Guimarães Pereira, Jerome R. Ravetz, A. Saltelli, Roger Strand, and Jeroen P. van der Sluijs. 2016. Science on the Verge. First Edition. The Rightful Place of Science. Tempe, AZ: Consortium for Science, Policy & Outcomes.
- Benjamin, Daniel J., James O. Berger, Magnus Johannesson, Brian A. Nosek, E.-J. Wagenmakers, Richard Berk, Kenneth A. Bollen, et al. 2018. “Redefine Statistical Significance.” Nature Human Behaviour 2: 6–10. https://doi.org/10.1038/s41562-017-0189-z.
- Biagioli, Mario. 2002. “From Book Censorship to Academic Peer Review.” Emergences: Journal for the Study of Media & Composite Cultures 12: 11–45. https://doi.org/10.1080/1045722022000003435.
- Bik, Elisabeth M., Arturo Casadevall, and Ferric C. Fang. 2016. “The Prevalence of Inappropriate Image Duplication in Biomedical Research Publications.” MBio 7: e00809–16.
- Carver, Ronald P. 1978. “The Case Against Statistical Significance Testing.” Harvard Educational Review 48: 378–399. https://doi.org/10.17763/haer.48.3.t490261645281841.
- Carver, Ronald P. 1993. “The Case Against Statistical Significance Testing, Revisited.” Journal of Experimental Education 61: 287–292. https://doi.org/10.1080/00220973.1993.10806591.
- Cohen, Jacob. 1962. “The Statistical Power of Abnormal-Social Psychological Research: A Review.” The Journal of Abnormal and Social Psychology 65: 145–153. https://doi.org/10.1037/h0045186.
- Cohen, Jacob. 1990. “Things I Have Learned (so Far).” American Psychologist 45: 1304–1312. https://doi.org/10.1037/0003-066X.45.12.1304.
- Cohen, Jacob. 1994. “The Earth Is Round (p < .05).” American Psychologist 49: 997–1003. https://doi.org/10.1037/0003-066X.49.12.997.
- Colquhoun, D. 2014. “An Investigation of the False Discovery Rate and the Misinterpretation of P-Values.” Royal Society Open Science 1: 140216–140216. https://doi.org/10.1098/rsos.140216.
- Cumming, Geoff. 2014. “The New Statistics: Why and How.” Psychological Science 25: 7–29.
- Daston, Lorraine, and Peter Galison. 2007. Objectivity. New York: Zone Books; Distributed by the MIT Press.
- Demidenko, Eugene. 2016. “The P-Value You Can’t Buy.” The American Statistician 70: 33–38. https://doi.org/10.1080/00031305.2015.1069760.
- Elias, Norbert, Hermínio Martins, and Richard Whitley. 1982. Scientific Establishments and Hierarchies. Dordrecht: D. Reidel Pub. Co.; Sold and distributed in the U.S.A. and Canada, Kluwer of Boston. http://public.ebookcentral.proquest.com/choice/publicfullrecord.aspx?p=3107600.
- Elliott, Kevin C., and David B. Resnik. 2015. “Scientific Reproducibility, Human Error, and Public Policy.” BioScience 65: 5–6. https://doi.org/10.1093/biosci/biu197.
- Enserink, Martin. 2012. “Final Report on Stapel Also Blames Field As a Whole.” Science 338: 1270–1271. https://doi.org/10.1126/science.338.6112.1270.
- Fanelli, Daniele. 2009. “How Many Scientists Fabricate and Falsify Research? A Systematic Review and Meta-Analysis of Survey Data.” PLOS ONE 4: e5738: 1–11. https://doi.org/10.1371/journal.pone.0005738.
- Fanelli, Daniele. 2012. “Negative Results Are Disappearing from Most Disciplines and Countries.” Scientometrics 90: 891–904. https://doi.org/10.1007/s11192-011-0494-7.
- Fang, F. C., and A. Casadevall, 2015. Competitive Science: Is Competition Ruining Science? Infection and Immunity, 83(4): 1229–1233.
- Fiske, S. T. 2016. “Mob Rule or Wisdom of Crowds.” APS Observer, 1–2.
- Freese, Jeremy, and David Peterson. 2018. “The Emergence of Statistical Objectivity: Changing Ideas of Epistemic Vice and Virtue in Science.” Sociological Theory 36: 289–313. https://doi.org/10.1177/0735275118794987.
- Gigerenzer, Gerd. 2004. “Mindless Statistics.” The Journal of Socio-Economics 33: 587–606. https://doi.org/10.1016/j.socec.2004.09.033.
- Gigerenzer, Gerd. 2018. “Statistical Rituals: The Replication Delusion and How We Got There.” Advances in Methods and Practices in Psychological Science 1: 198–218. https://doi.org/10.1177/2515245918771329.
- Gigerenzer, Gerd, Zeno G. Swijtink, Theodore M. Porter, Lorraine Daston, John Beatty, and Lorenz Krüger. 1989. The Empire of Chance: How Probability Changed Science and Everyday Life. The Empire of Chance: How Probability Changed Science and Everyday Life. New York, NY, US: Cambridge University Press.
- Glasziou, P., and I. Chalmers. 2018. “Research Waste is Still a Scandal—An Essay by Paul Glasziou and Iain Chalmers.” Bmj 363: 1–3.
- Gill, Jeff. 1999. “The Insignificance of Null Hypothesis Significance Testing.” Political Research Quarterly 52: 647–674. https://doi.org/10.2307/449153.
- Goodman, Steven N. 2018. “How Sure Are You of Your Result? Put a Number on It.” Nature 564: 7–7. https://doi.org/10.1038/d41586-018-07589-2.
- Groves, T., and E. Loder. 2014. “Prepublication Histories and Open Peer Review at The BMJ.” BMJ 349: g5394–g5394. https://doi.org/10.1136/bmj.g5394.
- Haack, Susan. 2003. Defending Science--Within Reason: Between Scientism and Cynicism. Amherst, N.Y: Prometheus Books.
- Hacking I. 2015. “Let’s Not Talk About Objectivity”. In Objectivity in Science. Boston Studies in the Philosophy and History of Science, edited by F. Padovani, A. Richardson, and J. Tsou, Vol. 310, 19–33. Cham: Springer. https://doi.org/10.1007/978-3-319-14349-1_2.
- Heesen, Remco. 2018. “Why the Reward Structure of Science Makes Reproducibility Problems Inevitable.” The Journal of Philosophy 115: 661–674. https://doi.org/10.5840/jphil20181151239.
- Hilgard, Joseph, and Kathleen Hall Jamieson. 2017. Science as “Broken” Versus Science as “Self-Correcting.” Edited by Kathleen Hall Jamieson, Dan M. Kahan, and Dietram A. Scheufele. Vol. 1. Oxford University Press. https://doi.org/10.1093/oxfordhb/9780190497620.013.9.
- Hirsch, J. E. 2005. “An Index to Quantify an Individual’s Scientific Research Output.” Proceedings of the National Academy of Sciences 102: 16569–16572. https://doi.org/10.1073/pnas.0507655102.
- Horton, Richard. 2015. “Offline: What Is Medicine’s 5 Sigma?” The Lancet 385: 1380. https://doi.org/10.1016/S0140-6736(15)60696-1.
- Ioannidis, John P. A. 2005. “Why Most Published Research Findings Are False.” PLOS Medicine 2: e124: 0696–0701. https://doi.org/10.1371/journal.pmed.0020124.
- Ioannidis, John P. A. 2018. “The Proposal to Lower P Value Thresholds to .005.” JAMA 319: 1429–1430. https://doi.org/10.1001/jama.2018.1536.
- Ioannidis, John P. A., Daniele Fanelli, Debbie Drake Dunne, and Steven N. Goodman. 2015. “Meta-Research: Evaluation and Improvement of Research Methods and Practices.” PLOS Biology 13: e1002264: 1–6. https://doi.org/10.1371/journal.pbio.1002264.
- Jamieson, Kathleen Hall. 2018. “Crisis or Self-Correction: Rethinking Media Narratives About the Well-Being of Science.” Proceedings of the National Academy of Sciences 115: 2620–2627. https://doi.org/10.1073/pnas.1708276114.
- Jeffreys, Harold. 1998. The Theory of Probability. Oxford: Clarendon Press.
- Kerr, N. L. 1998. “HARKing: Hypothesizing After the Results Are Known.” Personality and Social Psychology Review: An Official Journal of the Society for Personality and Social Psychology 2: 196–217. https://doi.org/10.1207/s15327957pspr0203_4.
- Kitcher, Philip. 1990. “The Division of Cognitive Labor.” The Journal of Philosophy 87: 5–22. https://doi.org/10.2307/2026796.
- Kitcher, Philip. 2001. Science, Truth, and Democracy. Oxford Studies in Philosophy of Science. Oxford, New York: Oxford University Press.
- Kitcher, Philip. 2011. Science in a Democratic Society. Amherst, N.Y: Prometheus Books.
- Knight, Jonathan. 2003. “Null and Void.” Nature 422: 554–555. https://doi.org/10.1038/422554a.
- Kovanis, Michail, Ludovic Trinquart, Philippe Ravaud, and Raphaël Porcher. 2017. “Evaluating Alternative Systems of Peer Review: A Large-Scale Agent-Based Modelling Approach to Scientific Publication.” Scientometrics 113: 651–671. https://doi.org/10.1007/s11192-017-2375-1.
- Kuffner, Todd A., and Stephen G. Walker. 2019. “Why Are p -Values Controversial?” The American Statistician 73 (1): 1–3. https://doi.org/10.1080/00031305.2016.1277161.
- Kurzrock, Razelle, Hagop Kantarjian, and David J Stewart. 2014. “A Cancer Trial Scandal and Its Regulatory Backlash.” Nature Biotechnology 32: 27–31. https://doi.org/10.1038/nbt.2792.
- Lakens, Daniel, Federico G. Adolfi, Casper J. Albers, Farid Anvari, Matthew A. J. Apps, Shlomo E. Argamon, Thom Baguley, et al. 2018. “Justify Your Alpha.” Nature Human Behaviour 2: 168–171. https://doi.org/10.1038/s41562-018-0311-x.
- Lee, Carole J., Cassidy R. Sugimoto, Guo Zhang, and Blaise Cronin. 2013. “Bias in Peer Review.” Journal of the American Society for Information Science and Technology 64: 2–17. https://doi.org/10.1002/asi.22784.
- Leonelli, Sabina. 2018. “Rethinking Reproducibility as a Criterion for Research Quality.” In Research in the History of Economic Thought and Methodology, edited by Luca Fiorito, Scott Scheall, and Carlos Eduardo Suprinyak, 36:129–146. Bingley, UK: Emerald Publishing Limited. https://doi.org/10.1108/S0743-41542018000036B009.
- Levine, Timothy R., René Weber, Hee Sun Park, and Craig R. Hullett. 2008. “A Communication Researchers’ Guide to Null Hypothesis Significance Testing and Alternatives.” Human Communication Research 34: 188–209. https://doi.org/10.1111/j.1468-2958.2008.00318.x.
- Macleod, Malcolm R., Susan Michie, Ian Roberts, Ulrich Dirnagl, Iain Chalmers, John P. A. Ioannidis, Rustam Al-Shahi Salman, An-Wen Chan, and Paul Glasziou. 2014. “Biomedical Research: Increasing Value, Reducing Waste.” The Lancet 383: 101–104. https://doi.org/10.1016/S0140-6736(13)62329-6.
- Maxwell, Scott E. 2004. “The Persistence of Underpowered Studies in Psychological Research: Causes, Consequences, and Remedies.” Psychological Methods 9: 147–163.
- Mayo, Deborah G. 2018. Statistical Inference as Severe Testing: How to Get Beyond the Statistics Wars. Cambridge: Cambridge University Press.
- Merton, Robert King. 1973. The Sociology of Science: Theoretical and Empirical Investigations. Chicago: University of Chicago Press.
- Meskus, Mianna, Luca Marelli, and Giuseppe D’Agostino. 2017. “Research Misconduct in the Age of Open Science: The Case of STAP Stem Cells.” Science as Culture 27 (1): 1–23. https://doi.org/10.1080/09505431.2017.1316975.
- Neyman, Jerzy. 1957. “‘ Inductive Behavior’ as a Basic Concept of Philosophy of Science.” Revue de L’Institut International de Statistique, 25: 7–22.
- Nosek, Brian A., Emorie D. Beck, Lorne Campbell, Jessica K. Flake, Tom E. Hardwicke, David T. Mellor, Anna E. van ‘t Veer, and Simine Vazire. 2019. “Preregistration Is Hard, And Worthwhile.” Trends in Cognitive Sciences 23: 815–818. https://doi.org/10.1016/j.tics.2019.07.009.
- Nosek, Brian A., and Timothy M. Errington. 2017. “Making Sense of Replications.” Elife 6: e23383: 1–4.
- Nosek, Brian A., Jeffrey R. Spies, and Matt Motyl. 2012. “Scientific Utopia: II. Restructuring Incentives and Practices to Promote Truth Over Publishability.” Perspectives on Psychological Science 7: 615–631.
- Nuzzo, Regina. 2014. “Scientific Method: Statistical Errors.” Nature News 506: 150–152.
- Open Science Collaboration. 2015. “Estimating the Reproducibility of Psychological Science.” Science 349: aac4716–aac4716. https://doi.org/10.1126/science.aac4716.
- Oransky, I., and A. Marcus. 2018. “To Catch Misconduct, Journals are Hiring Research Integrity Czars.” [online] STAT. Accessed 16 June 2021.
- Patil, Prasad, Roger D. Peng, and Jeffrey T. Leek. 2016. “What Should Researchers Expect When They Replicate Studies? A Statistical View of Replicability in Psychological Science.” Perspectives on Psychological Science 11: 539–544. https://doi.org/10.1177/1745691616646366.
- Perezgonzalez, Jose D. 2015. “Fisher, Neyman-Pearson or NHST? A Tutorial for Teaching Data Testing.” Frontiers in Psychology 6: 1293: 1–11. https://doi.org/10.3389/fpsyg.2015.00223.
- Ravetz, Jerome R. 1973. Scientific Knowledge and Its Social Problems. New Brunswick, NJ: Transaction Publishers Rutgers.
- Redish, A. David, Erich Kummerfeld, Rebecca Morris, and Alan Love. 2018. “Opinion: Reproducibility Failures Are Essential to Scientific Inquiry.” Proceedings of the National Academy of Sciences 115: 5042–5046.
- Resnik, David B., and Susan A. Elmore. 2016. “Ensuring the Quality, Fairness, and Integrity of Journal Peer Review: A Possible Role of Editors.” Science and Engineering Ethics 22: 169–188. https://doi.org/10.1007/s11948-015-9625-5.
- Resnik, David B., and Adil E. Shamoo. 2011. “The Singapore Statement on Research Integrity.” Accountability in Research 18: 71–75. https://doi.org/10.1080/08989621.2011.557296.
- Resnik, David B., and Adil E. Shamoo. 2017. “Reproducibility and Research Integrity.” Accountability in Research 24: 116–123. https://doi.org/10.1080/08989621.2016.1257387.
- Romero, Felipe. 2016. “Can the Behavioral Sciences Self-Correct? A Social Epistemic Study.” Studies in History and Philosophy of Science Part A 60: 55–69. https://doi.org/10.1016/j.shpsa.2016.10.002.
- Romero, Felipe. 2018. “Who Should Do Replication Labor?” Advances in Methods and Practices in Psychological Science 1: 516–537. https://doi.org/10.1177/2515245918803619.
- Rozeboom, William W. 1960. “The Fallacy of the Null-Hypothesis Significance Test.” Psychological Bulletin 57: 416–428.
- Saltelli, Andrea. 2018. “Why Science’s Crisis Should Not Become a Political Battling Ground.” Futures 104: 85–90. https://doi.org/10.1016/j.futures.2018.07.006.
- Savalei, Victoria, and Elizabeth Dunn. 2015. “Is the Call to Abandon P-Values the Red Herring of the Replicability Crisis?” Frontiers in Psychology 6: 245: 1–4 , https://doi.org/10.3389/fpsyg.2015.00245.
- Smaldino, Paul E., and Richard McElreath. 2016. “The Natural Selection of Bad Science.” Royal Society Open Science 3: 160384: 1–16. https://doi.org/10.1098/rsos.160384.
- Smith, R. 2006. “Peer Review: A Flawed Process at the Heart of Science and Journals.” Journal of the Royal Society of Medicine 99: 178–182. https://doi.org/10.1258/jrsm.99.4.178.
- Stephan, P. E. 2012. How economics shapes science. Cambridge, MA: Harvard University Press.
- Strathern, Marilyn. 1997. “‘Improving Ratings’: Audit in the British University System.” European Review 5: 305–321. https://doi.org/10.1002/(SICI)1234-981X(199707)5:3<305::AID-EURO184>3.0.CO;2-4.
- Strevens, Michael. 2003. “The Role of the Priority Rule in Science.” Journal of Philosophy 100: 55–79. https://doi.org/10.5840/jphil2003100224.
- Szollosi, Aba, David Kellen, Danielle Navarro, Rich Shiffrin, Iris van Rooij, Trisha Van Zandt, and Chris Donkin. 2019. “Is Preregistration Worthwhile?” Preprint. PsyArXiv. https://doi.org/10.31234/osf.io/x36pz.
- Szucs, Denes, and John P. A. Ioannidis. 2017. “Empirical Assessment of Published Effect Sizes and Power in the Recent Cognitive Neuroscience and Psychology Literature.” Edited by Eric-Jan Wagenmakers. PLOS Biology 15 (3): e2000797. https://doi.org/10.1371/journal.pbio.2000797.
- Timmermans, Stefan, and Steven Epstein. 2010. “A World of Standards but Not a Standard World: Toward a Sociology of Standards and Standardization.” Annual Review of Sociology 36: 69–89. https://doi.org/10.1146/annurev.soc.012809.102629.
- Vis, Barbara, and Kees van Kersbergen. 2007. “Why and How Do Political Actors Pursue Risky Reforms?” Journal of Theoretical Politics 19: 153–172. https://doi.org/10.1177/0951629807074268.
- Wagenmakers, Eric-Jan, Josine Verhagen, and Alexander Ly. 2016. “How to Quantify the Evidence for the Absence of a Correlation.” Behavior Research Methods 48: 413–426. https://doi.org/10.3758/s13428-015-0593-0.
- Wasserstein, Ronald L., and Nicole A. Lazar. 2016. “The ASA’s Statement on p-Values: Context, Process, and Purpose.” The American Statistician 70: 129–133.
- Wasserstein, Ronald L., Allen L. Schirm, and Nicole A. Lazar. 2019. “Moving to a World Beyond ‘p< 0.05.” The American Statistician 73 (sup1): 1–19. https://doi.org/10.1080/00031305.2019.1583913.
- Yarkoni, Tal. 2019. “The Generalizability Crisis.” Preprint. PsyArXiv. https://doi.org/10.31234/osf.io/jqw35.
- Young, Neal S., John P. A. Ioannidis, and Omar Al-Ubaydli. 2008. “Why Current Publication Practices May Distort Science.” PLOS Medicine 5: e201: 1418–1422. https://doi.org/10.1371/journal.pmed.0050201.
- Ziman, John. 2000. Real Science: What It Is and What It Means. 1st ed. Cambrdige: Cambridge University Press. https://doi.org/10.1017/CBO9780511541391.