How Large Are Your G-Values? Try Gosset’s Guinnessometrics When a Little “p” Is Not Enough

References

• Banerjee, A., and Duflo, E. (2011), Poor Economics, New York: Public Affairs.
   Google Scholar
• Carlin, B., and Louis, T. (2008), Bayes and Empirical Bayes Methods for Empirical Analysis (3rd rev. ed.), London: Chapman and Hall/CRC Press.
   Google Scholar
• De Finetti, B. (1971 [1976]), Comments on Savage’s “On Rereading R. A. Fisher,” Annals of Statistics, 4, 486–487.
   Google Scholar
• Deming, W. E. (1938 [1943]), Statistical Adjustment of Data, New York: Dover.
   Google Scholar
• Deming, W. E. (1961), Sample Design in Business Research, New York: Wiley.
   Google Scholar
• Deming, W. E. (1982), Out of the Crisis, Cambridge, MA: MIT Center for Advanced Engineering Study.
   Google Scholar
• Eisenberger, M. A., et al. (1998), “Bilateral Orchiectomy with or Without Flutamide for Metastatic Protate Cancer,” New England Journal of Medicine, 339, 1036–1042. DOI: 10.1056/NEJM199810083391504.
   PubMed Web of Science ®Google Scholar
• Fisher, R. A. (1925 [1928]), Statistical Methods for Research Workers, Edinburgh, UK: Oliver and Boyd.
   Google Scholar
• Fisher, R. A. (1933), “The Contributions of Rothamsted to the Development of the Science of Statistics,” Annual Report of Rothamsted Experimental Station, 43–50.
   Google Scholar
• Fisher, R. A. (1935), The Design of Experiments, Edinburgh, UK: Oliver & Boyd.
   Google Scholar
• Frank, R. (2017), Microeconomics and Behavior (9th ed.), New York: McGraw-Hill.
   Google Scholar
• Glewwe, P., Park, A., and Zhao, M. (2012), “Visualizing Development: Eyeglasses and Academic Performance in Rural Primary Schools in China,” Working Paper WP12-2, Center for International Food and Agricultural Policy, University of Minnesota.
   Google Scholar
• Goodman, S. (2017), “Why is Eliminating P-Values So Hard? Reflections on Science and Statistics,” ASA Symposium on Statistical Inference, Oct. 11–13, 2007.
   Google Scholar
• Goodman, S. (2002), “A Comment on Replication, P Values, and Evidence,” Statistics in Medicine, 11, 875–879.
   Web of Science ®Google Scholar
• Gosset, W. S. (1904), “The Application of the ‘Law of Error’ to the Work of the Brewery,” Laboratory Report, 8, Arthur Guinness & Son, Ltd., Diageo, Guinness Archives, 3–16 and unnumbered appendix.
   Google Scholar
• Gosset, W. S. (1905), Letter from W.S. Gosset to K. Pearson, Guinness Archives, GDB/BRO/1102
   Google Scholar
• Gosset, W. S. (1936), “Co-Operation in Large-Scale Experiments,” Supplement to the Journal of the Royal Statistical Society, 3, 115–136.
   Google Scholar
• Gosset, W. S. (1962), Letters of William Sealy Gosset to R.A. Fisher. Vols. 1–5, Eckhart Library, University of Chicago. Private circulation.
   Google Scholar
• Greenland, S., et al. (2016), “Statistical Tests, P-values, Confidence Intervals, and Power: A Guide to Misinterpretations,” The American Statistician, 70, 1–12.
   Google Scholar
• Hotelling, H. (1930), “British Statistics and Statisticians Today,” Journal of the American Statistical Association, 25, 186–190. DOI: 10.1080/01621459.1930.10503118.
   Google Scholar
• Jeffreys, H. (1939 [1961]), Theory of Probability (3rd ed.), London: Oxford University Press.
   Google Scholar
• Johnson, V. (2013), “Revised Standards for Statistical Evidence,” PNAS, 110, 19313–19317. DOI: 10.1073/pnas.1313476110.
   PubMed Web of Science ®Google Scholar
• Kahneman, D. (2011), Thinking Fast and Slow, New York: Farrar, Straus and Giroux.
   Google Scholar
• Lavine, M., and Schervish, M. (1999), “Bayes Factors: What They Are and What They Are Not,” The American Statistician, 53, 119–122
   Web of Science ®Google Scholar
• Lew, M. (2012), “Bad Statistical Practice in Pharmacology (And Other Basic Biomedical Disciplines): You Probably Don’t Know P,” British Journal of Pharmacology, 166, 1559–1567. DOI: 10.1111/j.1476-5381.2012.01931.x.
   PubMed Web of Science ®Google Scholar
• Lindley, D. (1991), Making Decisions, New York: Wiley.
   Google Scholar
• Manski, C. (2018), “Treatment Choice with Trial Data: Statistical Decision Theory should Supplant Hypothesis Testing,” The American Statistician, this issue, DOI: 10.1080/00031305.2018.1513377.
   PubMed Web of Science ®Google Scholar
• McCloskey, D. N., and Ziliak, S. T. (1996), “The Standard Error of Regressions,” Journal of Economic Literature, 34, pp. 97–114.
   Web of Science ®Google Scholar
• McCloskey, D. N., and Ziliak, S. T. (2010), Brief of Amici Curiae Statistics Experts Professors Deirdre N. McCloskey and Stephen T. Ziliak in Support of Respondents, Matrixx Initiatives Inc. et al. v. Siracusano et al. (vol. No. 09–1156, pp. 22). Washington, DC: Supreme Court of the United States. (Ed.) Edward Labaton et al. Counsel of Record.
   Google Scholar
• McCloskey, D. N., and Ziliak, S. T. (2009),” Signifying Nothing: Reply to Hoover and Siegler,” Journal of Economic Methodology, 15, 39–55 DOI: 10.1080/13501780801913413.
   Google Scholar
• Meyers, J., Sacks, G., van Es, H., and Vanden Heuvel, J. (2011) “Improving Vineyard Sampling Efficiency via Dynamic Spatially Explicit Optimisation,” Australian Journal of Grape and Wine Research, 17, 306–315. DOI: 10.1111/j.1755-0238.2011.00152.x.
   Web of Science ®Google Scholar
• Neyman, J. (1934), “On the Two Different Aspects of the Representative Method: The Method of Stratified Sampling and the Method of Purposive Selection,” Journal of the Royal Statistical Society, 97, 558–625. DOI: 10.2307/2342192.
   Google Scholar
• Pearson, E. S. (1939), “’Student’ as Statistician,” Biometrika, 30, 210–250. DOI: 10.2307/2332648.
   Google Scholar
• Pearson, E. S. (1990), Student: A Statistical Biography of William Sealy Gosset, Eds. R. L. Plackett and G. A. Barnard. Oxford: Clarendon Press.
   Google Scholar
• Pierson, S., et al. (2017), “Recommendations to Funding Agencies for Supporting Reproducible Research,” American Statistical Association, available at https://www.amstat.org/ASA/News/ASA-Develops-Reproducible-Research-Recommendations.aspx
   Google Scholar
• Press, S. J. (2003), Subjective and Objective Bayesian Statistics, New York: Wiley.
   Google Scholar
• Press, S. J. (1972 [2005]), Applied Multivariate Analysis: Using Bayesian and Frequentist Methods of Inference (2nd ed.), Mineola, NY: Dover.
   Google Scholar
• Ramsey, F. P. (1926), “Truth and Probability,” reprinted in H. Kyburg and H. Smoker, eds., Studies in Subjective Probability (New York: R. E. Krieger, 1980), 25–52.
   Google Scholar
• Rothman, K. J., Johnson, E. S., and Sugano, D. S. (1999), “Is Flutamide Effective in Patients with Bilateral Orchiectomy?” Lancet, 353, 1184. DOI: 10.1016/S0140-6736(05)74403-2.
   PubMed Web of Science ®Google Scholar
• Savage, L. (1954), The Foundations of Statistics, New York: Dover.
   Google Scholar
• Savage, L. (1971 [1976]), “On Re-Reading R. A. Fisher,” Annals of Statistics, 4, 441–500.
   Web of Science ®Google Scholar
• Soyer, E., and Hogarth, R. (2011), “The Illusion of Predictability: How Regression Statistics Mislead Experts,” International Journal of Forecasting, 28, 695–711. DOI: 10.1016/j.ijforecast.2012.02.002.
   Web of Science ®Google Scholar
• Student (1907), “On the Error of Counting with a Haemacytometer,” Biometrika, 5, 351–360.
   Google Scholar
• Student (1908a), “The Probable Error of a Mean,” Biometrika, VI, 1–24.
   Google Scholar
• Student (1908b), “The Probable Error of a Correlation Coefficient,” Biometrika, 2/3, 300–310.
   Google Scholar
• Student (1923), “On Testing Varieties of Cereals,” Biometrika, 15, 271–293.
   Google Scholar
• Student (1925), “New Tables for Testing the Significance of Observations,” Metron, V, 105–108.
   Google Scholar
• Student (1938), “Comparison between Balanced and Random Arrangements of Field Plots,” Biometrika, 29, 363–378.
   Google Scholar
• Student (1942), Student’s Collected Papers, eds. Pearson, E. S. and Wishart, J., London: Biometrika Office.
   Google Scholar
• Supreme Court of the United States (2011), “Matrixx Initiatives, Inc., et al., No. 09–1156, Petitioner v. James Siracusano et al.,” On Writ of Certiorari to the United States Court of Appeals for the Ninth Circuit, March 22nd, 25 pp., syllabus.
   Google Scholar
• Taleb, N. N. (2018), Skin in the Game: Hidden Asymmetries in Daily Life, New York: Random House.
   Google Scholar
• The Guinness Archives (Diageo), Guinness Storehouse Museum, Dublin; Special Collections Library, University College London; Cork County (Ireland) Archives; Museum of English Rural Life, National Library of Ireland; University of Oxford, Bodleian Library and New College Library; Winchester College (UK) Archives; and University of Chicago, Crerar Library, Eckhart Library, and Regenstein Library.
   Google Scholar
• Wasserstein, R., and Lazar, N., eds. (2016), “ASA Statement on Statistical Significance and P-Values”, The American Statistician, 70, 129–132. DOI: 10.1080/00031305.2016.1154108.
   Web of Science ®Google Scholar
• Ziliak, S. (2008), “Guinnessometrics: The Economic Foundation of ‘Student’s’ t,” Journal of Economic Perspectives, 22, 199–216. DOI: 10.1257/jep.22.4.199.
   Web of Science ®Google Scholar
• Ziliak, S. (2010a), “The Validus Medicus and a New Gold Standard,” The Lancet, 376, 324–325.
   PubMed Web of Science ®Google Scholar
• Ziliak, S. (2010b), “Significant Errors—Reply to Stephen Senn,” The Lancet, 376, 1391.
   PubMed Web of Science ®Google Scholar
• Ziliak, S. (2014), “Balanced versus Randomized Field Experiments in Economics: Why W.S. Gosset Matters,” Review of Behavioral Economics, 1, 167–208.
   Google Scholar
• Ziliak, S. (2016), “The Significance of the ASA Statement on Statistical Significance and P-Values,” The American Statistician, 70, 1–2.
   Web of Science ®Google Scholar
• Ziliak, S., and McCloskey, D. (2008), The Cult of Statistical Significance: How the Standard Error Costs Us Jobs, Justice, and Lives, Ann Arbor, MI: University of Michigan Press.
   Google Scholar
• Ziliak, S., and Teather-Posadas, E. (2016), “The Unprincipled Randomization Principle in Economics and Medicine,” in Oxford Handbook of Professional Economic Ethics, eds. G. DeMartino and D. McCloskey, Oxford: Oxford University Press, 423–452.
   Google Scholar