Statistical Significance and the Dichotomization of Evidence

References

• Bakan, D. (1966), “The Test of Significance in Psychological Research,” Psychological Bulletin, 66, 423–437.
   PubMed Web of Science ®Google Scholar
• Bem, D. J. (2011), “Feeling the Future: Experimental Evidence for Anomalous Retroactive Influences on Cognition and Affect,” Journal of Personality and Social Psychology, 100, 407–425.
   PubMed Web of Science ®Google Scholar
• Berger, J. O., and Sellke, T. (1987), “Testing a Point Null Hypothesis: The Irreconciliability of P Values and Evidence,” Journal of the American Statistical Association, 82, 112–122.
   Web of Science ®Google Scholar
• Berkson, J. (1938), “Some Difficulties of Interpretation Encountered in the Application of the Chi-Square Test,” Journal of the American Statistical Association, 33, 526–536.
   Google Scholar
• Blackwell, L. S., Trzesniewski, K. H., and Dweck, C. S. (2007), “Implicit Theories of Intelligence Predict Achievement Across an Adolescent Transition: A Longitudinal Study and an Intervention,” Child Development, 78, 246–263.
   PubMed Web of Science ®Google Scholar
• Briggs, W. M. (2006), So, You Think You’re Psychic? New York: Lulu.
   Google Scholar
• Briggs, W. M. (2016), Uncertainty: The Soul of Modeling, Probability and Statistics, New York: Springer.
   Google Scholar
• Carney, D. R. (2016), “My Position on ‘Power Poses’,” Technical report, Haas School of Business, University of California at Berkeley.
   Google Scholar
• Carney, D. R., Cuddy, A. J., and Yap, A. J. (2010), “Power Posing Brief Nonverbal Displays Affect Neuroendocrine Levels and Risk Tolerance,” Psychological Science, 21, 1363–1368.
   PubMed Web of Science ®Google Scholar
• Cochran, W. G. (1976), “Early Development of Techniques in Comparative Experimentation,” in On the History of Statistics and Probability, ed. D. B. Owens, New York: Marcel Dekker Inc.
   Google Scholar
• Cohen, J. (1994), “The Earth is Round (p < .05),” American Psychologist, 49, 997–1003.
   Web of Science ®Google Scholar
• Cowles, M., and Davis, C. (1982), “On the Origins of the.05 Level of Significance,” American Psychologist, 44, 1276–1284.
   Google Scholar
• Cramer, H. (1955), The Elements of Probability Theory, New York: Wiley.
   Google Scholar
• Diaconis, P. (1978), “Statistical Problems in ESP Research,” Science, 201, 131–136.
   PubMed Web of Science ®Google Scholar
• Diaconis, P., and Graham, R. (1981), “The Analysis of Sequential Experiments with Feedback to Subjects,” The Annals of Statistics, 9, 3–23.
   Web of Science ®Google Scholar
• Diaconis, P., and Mosteller, F. (1989), “Methods for Studying Coincidences,” Journal of the American Statistical Association, 84, 853–861.
   Web of Science ®Google Scholar
• Edwards, W., Lindman, H., and Savage, L. J. (1963), “Bayesian Statistical Inference for Psychological Research,” Psychological Review, 70, 193.
   Web of Science ®Google Scholar
• Falk, R., and Greenbaum, C. W. (1995), “Significance Tests Die Hard The Amazing Persistence of a Probabilistic Misconception,” Theory & Psychology, 5, 75–98.
   Web of Science ®Google Scholar
• Fisher, R. A. (1926), “The Arrangement of Field Experiments,” Journal of the Ministry of Agriculture, 33, 503–513.
   Google Scholar
• Freeman, P. R. (1993), “The Role of p-values in Analysing Trial Results,” Statistics in Medicine, 12, 1443–1452.
   PubMed Web of Science ®Google Scholar
• Gelman, A., Carlin, J. B., Stern, H. S., and Rubin, D. B. (2003), Bayesian Data Analysis (2nd ed.), Boca Raton, FL: Chapman and Hall.
   Google Scholar
• Gelman, A., and Stern, H. (2006), “The Difference Between ‘Significant’ and ‘Not Significant’ is not Itself Statistically Significant,” The American Statistician, 60, 328–331.
   Web of Science ®Google Scholar
• Gigerenzer, G. (2004), “Mindless Statistics,” Journal of Socio-Economics, 33, 587–606.
   Google Scholar
• Gigerenzer, G., Krauss, S., and Vitouch, O. (2004), “The Null Ritual: What You Always Wanted to Know About Null Hypothesis Testing But Were Afraid to Ask,” in The SAGE Handbook of Quantitative Methodology for the Social Sciences, ed. D. Kaplan, Thousand Oaks, CA: SAGE, pp. 391–408.
   Google Scholar
• Haimovitz, K., and Dweck, C. S. (2016), “What Predicts Children’s Fixed and Growth Intelligence Mind-Sets? Not Their Parents’ Views of Intelligence but Their Parents’ Views of Failure,” Psychological Science, p. 0956797616639727.
   PubMed Web of Science ®Google Scholar
• Haller, H., and Krauss, S. (2002), “Misinterpretations of Significance: A Problem Students Share with their Teachers?” Methods of Psychological Research, 7, available at https://www.metheval.uni-jena.de/lehre/0405-ws/evaluationuebung/haller.pdf.
   Google Scholar
• Healy, D. (2006), “The Antidepressant Tale: Figures Signifying Nothing?,” Advances in Psychiatric Treatment, 12, 320–328.
   Google Scholar
• Holman, C. J., Arnold-Reed, D. E., de Klerk, N., McComb, C., and English, D. R. (2001), “A Psychometric Experiment in Causal Inference to Estimate Evidential Weights used by Epidemiologists,” Epidemiology, 12, 246–255.
   PubMed Web of Science ®Google Scholar
• Hommes, D. W., Bura, A., H. Buller, L. M., and ten Cate, J. W. (1992), “Subcutaneous Heparin Compared with Continuous Intravenous Heparin Administration in the Initial Treatment of Deep Vein Thrombosis,” Annals of Internal Medicine, 116, 279–284.
   PubMed Web of Science ®Google Scholar
• Hu, X., Antony, J. W., Creery, J. D., Vargas, I. M., Bodenhausen, G. V., and Paller, K. A. (2015), “Unlearning Implicit Social Biases During Sleep,” Science, 348, 1013–1015.
   PubMed Web of Science ®Google Scholar
• Hubbard, R., and Lindsay, R. M. (2008), “Why P Values Are Not a Useful Measure of Evidence in Statistical Significance Testing,” Theory and Psychology, 18, 69–88.
   Web of Science ®Google Scholar
• Johnson, V. E. (2013), “Uniformly Most Powerful Bayesian Tests,” Annals of Statistics, 41, 1716–1741.
   PubMed Web of Science ®Google Scholar
• Johnson, V. E., Payne, R. D., Wang, T., Asher, A., and Mandal, S. (2016), “On the Reproducibility of Psychological Science,” Journal of the American Statistical Association, 112, 1–10.
   PubMed Web of Science ®Google Scholar
• Kramer, W., and Gigerenzer, G. (2005), “How to Confuse with Statistics or: The Use and Misuse of Conditional Probabilities,” Statistical Science, 20, 223–230.
   Web of Science ®Google Scholar
• McShane, B. B., and Gal, D. (2016), “Blinding Us to the Obvious? The Effect of Statistical Training on the Evaluation of Evidence,” Management Science, 62, 1707–1718.
   Web of Science ®Google Scholar
• Messori, A., Scrocarro, G., and Martini, N. (1993), “Calculation Errors in Meta-Analysis,” Annals of Internal Medicine, 118, 77–78.
   PubMed Web of Science ®Google Scholar
• Nieuwenhuis, S., Forstmann, B. U., and Wagenmakers, E.-J. (2011), “Erroneous Analyses of Interactions in Neuroscience: A Problem of Significance,” Nature neuroscience, 14, 1105–1107.
   PubMed Web of Science ®Google Scholar
• Oakes, M. (1986), Statistical Inference: A Commentary for the Social and Behavioral Sciences, New York: Wiley.
   Google Scholar
• Open Science Collaboration (2015), “Estimating the Reproducibility of Psychological Science,” Science, 349, aac4716.
   PubMed Web of Science ®Google Scholar
• Pfattheicher, S., and Schindler, S. (2016), “Misperceiving Bullshit as Profound Is Associated with Favorable Views of Cruz, Rubio, Trump and Conservatism,” PloS one, 11, e0153419.
   PubMed Web of Science ®Google Scholar
• Preece, D. (1984), “Biometry in the Third World: Science Not Ritual,” Biometrics, 40, 519–523.
   Web of Science ®Google Scholar
• Ranehill, E., Dreber, A., Johannesson, M., Leiberg, S., Sul, S., and Weber, R. A. (2015), “Assessing the Robustness of Power Posing: No Effect on Hormones and Risk Tolerance in a Large Sample of Men and Women,” Psychological Science, 26, 653–656.
   PubMed Web of Science ®Google Scholar
• Rosnow, R. L., and Rosenthal, R. (1989), “Statistical Procedures and the Justification of Knowledge in Psychological Science,” American Psychologist, 44, 1276–1284.
   Web of Science ®Google Scholar
• Sawyer, A. G., and Peter, J. P. (1983), “The Significance of Statistical Significance Tests in Marketing Research,” Journal of Marketing Research, 20, 122–133.
   Web of Science ®Google Scholar
• Thorstenson, C. A., Pazda, A. D., and Elliot, A. J. (2015), “Sadness Impairs Color Perception,” Psychological Science, 26, 1822–1822.
   Google Scholar
• Tukey, J. W. (1991), “The Philosophy of Multiple Comparisons,” Statistical Science, 6, 100–116.
   Google Scholar
• Tversky, A., and Kahneman, D. (1974), “Judgment under Uncertainty: Heuristics and Biases,” Science, 185, 1124–1131.
   PubMed Web of Science ®Google Scholar
• Wasserstein, R. L., and Lazar, N. A. (2016), “The ASA’s Statement on p-Values: Context, Process, and Purpose,” The American Statistician, 70, 129–133.
   Web of Science ®Google Scholar
• Yule, G. U., and Kendall, M. G. (1950), An Introduction to the Theory of Statistics (14 ed.), London: Griffin.
   Google Scholar