References
- Allison, D. B., Shiffrin, R. M., and Stodden, V. (2018), “Reproducibility of Research: Issues and Proposed Remedies,” Proceedings of the National Academy of Sciences of the United States of America, 115, 2561–2562. DOI: https://doi.org/10.1073/pnas.1802324115.
- Baker, M. (2016), “Is There a Reproducibility Crisis? A Nature Survey Lifts the Lid on How Researchers View the ‘Crisis’ Rocking Science and What They Think Will Help,” Nature, 533, 452–455.
- Begley, C. G., and Ellis, L. M. (2012), “Raise Standards for Preclinical Cancer Research,” Nature, 483, 531–533. DOI: https://doi.org/10.1038/483531a.
- Begley, C. G., and Ioannidis, J. P. (2015), “Reproducibility in Science: Improving the Standard for Basic and Preclinical Research,” Circulation Research, 116, 116–126. DOI: https://doi.org/10.1161/CIRCRESAHA.114.303819.
- Bello, N. M., and Renter, D. G. (2018), “Invited Review: Reproducible Research From Noisy Data: Revisiting Key Statistical Principles for the Animal Sciences,” Journal of Dairy Science, 101, 5679–5701.
- Berliner, D. C. (2002), “Comment: Educational Research: The Hardest Science of All,” Educational Researcher, 31, 18–20.
- Boos, D. D., and Stefanski, L. A. (2011), “P-Value Precision and Reproducibility,” The American Statistician, 65, 213–221. DOI: https://doi.org/10.1198/tas.2011.10129.
- Borenstein, M., Hedges, L. V., Higgins, J. P., and Rothstein, H. R. (2011), Introduction to Meta-Analysis, Chichester: Wiley.
- Box, G. (1990), “Commentary on ‘Communications Between Statisticians and Engineers/Physical Scientists’ by Hoadley and Kettenring,” Technometrics, 32, 251–252.
- Chawla, D. S. (2017), “Big Names in Statistics Want to Shake Up Much-Maligned p Value,” Nature News, 548, 16.
- Cohen, J. (1988), Statistical Power Analysis for the Behavioral Sciences (2nd ed.), Hillsdale, NJ: Erlbaum Associates.
- Cronbach, L. J. (1972), “The Dependability of Behavioral Measurements,” in Theory of Generalizability for Scores and Profiles, New York: John Wiley & Sons, pp. 1–33.
- Cronbach, L. J., Rajaratnam, N., and Gleser, G. C. (1963), “Theory of Generalizability: A Liberalization of Reliability Theory,” British Journal of Statistical Psychology, 16, 137–163.
- Gibson, E. W. (2020), “The Role of p-Values in Judging the Strength of Evidence and Realistic Replication Expectations,” Statistics in Biopharmaceutical Research, 1–13, DOI: https://doi.org/10.1080/19466315.2020.1724560.
- Goodman, S. N. (1992), “A Comment on Replication, p-Values and Evidence,” Statistics in Medicine, 11, 875–879. DOI: https://doi.org/10.1002/sim.4780110705.
- Hankins, M. (2013), “Still Not Significant,” available at http://mchankins.wordpress.com/2013/04/21/still-not-significant-2.
- Higgins, J. P., and Thompson, S. G. (2002), “Quantifying Heterogeneity in a Meta-Analysis,” Statistics in Medicine, 21, 1539–1558. DOI: https://doi.org/10.1002/sim.1186.
- Ioannidis, J. P., Allison, D. B., Ball, C. A., Coulibaly, I., Cui, X., Culhane, A. C., Falchi, M., Furlanello, C., Game, L., Jurman, G., and Mangion, J. (2009), “Repeatability of Published Microarray Gene Expression Analyses,” Nature Genetics, 41, 149. DOI: https://doi.org/10.1038/ng.295.
- Kadel, R. P., and Kip, K. (2012), “A SAS Macro to Compute Effect Size (Cohen’s d) and Its Confidence Interval From Raw Survey Data,” in Proceedings of the Annual Southeast SAS Users Group Conference.
- Kafkafi, N., Agassi, J., Chesler, E. J., Crabbe, J. C., Crusio, W. E., Eilam, D., Gerlai, R., Golani, I., Gomez-Marin, A., Heller, R., and Iraqi, F. (2018), “Reproducibility and Replicability of Rodent Phenotyping in Preclinical Studies,” Neuroscience & Biobehavioral Reviews, 87, 218–232.
- Kafkafi, N., Benjamini, Y., Sakov, A., Elmer, G. I., and Golani, I. (2005), “Genotype–Environment Interactions in Mouse Behavior: A Way Out of the Problem,” Proceedings of the National Academy of Sciences of the United States of America, 102, 4619–4624. DOI: https://doi.org/10.1073/pnas.0409554102.
- Kafkafi, N., Golani, I., Jaljuli, I., Morgan, H., Sarig, T., Würbel, H., Yaacoby, S., and Benjamini, Y. (2017), “Addressing Reproducibility in Single-Laboratory Phenotyping Experiments,” Nature Methods, 14, 462. DOI: https://doi.org/10.1038/nmeth.4259.
- Koole, S. L., and Lakens, D. (2012), “Rewarding Replications: A Sure and Simple Way to Improve Psychological Science,” Perspectives on Psychological Science, 7, 608–614. DOI: https://doi.org/10.1177/1745691612462586.
- Lipsey, M. W., and Wilson, D. B. (2001), Practical Meta-Analysis, Thousand Oaks, CA: SAGE Publications, Inc.
- Littell, R. C., Milliken, G. A., Stroup, W. W., and Wolfinger, R. D. (1996), SAS System for Mixed Models, Cary, NC: SAS Institute.
- Lundwall, R. A. (2019), “Changing Institutional Incentives to Foster Sound Scientific Practices: One Department,” Infant Behavior and Development, 55, 69–76. DOI: https://doi.org/10.1016/j.infbeh.2019.03.006.
- Milliken, G. A., and Johnson, D. E. (2009), Analysis of Messy Data Volume 1: Designed Experiments (Vol. 1), Boca Raton, FL: CRC Press.
- National Academies of Sciences, Engineering, and Medicine. (2019), Reproducibility and Replicability in Science, Washington, DC: The National Academies Press, available at https://www.nap.edu/catalog/25303/reproducibility-and-replicability-in-science.
- Perrett, J. J. (2004), “Using Prior Information on the Intraclass Correlation Coefficient to Analyze Data From Unreplicated and Under-Replicated Experiments,” PhD thesis, Kansas State University.
- Perrett, J. J., and Higgins, J. J. (2006), “A Method for Analyzing Unreplicated Agricultural Experiments,” Crop Science, 46, 2482–2485.
- Rosenbaum, P. R. (2002), Observational Studies (2nd ed.), New York: Springer.
- Shavelson, R. J., Webb, N. M., and Rowley, G. L. (1989), “Generalizability Theory,” American Psychologist, 44, 922.
- Snape, J. W., Foulkes, M. J., Simmonds, J., Leverington, M., Fish, L. J., Wang, Y., and Ciavarrella, M. (2007), “Dissecting Gene × Environmental Effects on Wheat Yields via QTL and Physiological Analysis,” Euphytica, 154, 401–408.
- Snedecor, G. W., and Cochran, W. G. (1980), Statistical Methods (7th ed.), Ames, IA: Iowa State University Press.
- Trafimow, D. (2018), “An A Priori Solution to the Replication Crisis,” Philosophical Psychology, 31, 1188–1214.
- Wasserstein, R. L., Schirm, A. L., and Lazar, N. A. (2019), “Moving to a World Beyond p < 0.05,” The American Statistician, 73, 1–19, DOI: https://doi.org/10.1080/00031305.2019.1583913.
- Woolston, C. (2015), “Psychology Journal Bans p Values,” Nature News, 519, 9.