The Use of Statistical Significance Tests in Research

References

• Atkinson, D. R., Furlong, M. J., & Wampold, B. E. (1982). Statistical significance, reviewer evaluations, and scientific process: Is there a (statistically) significant relationship? Journal of Counseling Psychology, 29, 189–194.
   Web of Science ®Google Scholar
• Bartko, J. J. (1991). Proving the null hypothesis. American Psychologist, 46, 1089.
   Web of Science ®Google Scholar
• Berger, J. O., & Berry, D. A. (1988). Statistical analysis and the illusion of objectivity. American Scientist, 76, 159–165.
   Web of Science ®Google Scholar
• Browne, M. W. (1975). Predictive validity of a linear regression equation. British Journal of Mathematical and Statistical Psychology, 28, 79–87.
   Web of Science ®Google Scholar
• Carter, D. S. (1979). Comparison of different shrinkage formulas in estimating population multiple correlation coefficients. Educational and Psychological Measurement, 39, 261–266.
   Web of Science ®Google Scholar
• Carver, R. P. (1978). The case against statistical significance testing. Harvard Educational Review, 48, 378–399.
   Web of Science ®Google Scholar
• Cattin, P. (1980). Note on the estimation of the squared cross-validated multiple correlation of a regression model. Psychological Bulletin, 87, 63–65.
   Web of Science ®Google Scholar
• Clark, H. H. (1973). The language-as-fixed-effect fallacy: A critique of language statistics in psychological research. Journal of Verbal Learning and Verbal Behavior, 12, 335–359.
   Google Scholar
• Clark, H. H. (1976). Reply to Wike and Church. Journal of Verbal Learning and Verbal Behavior, 15, 257–261.
   Google Scholar
• Cliff, N. (1987). Analyzing multivariate data. San Diego: Harcourt Brace Jovanovich.
   Google Scholar
• Cohen, J. (1988). Statistical power analysis (2nd ed.). Hillsdale, NJ: Erlbaum.
   Google Scholar
• Cohen, J. (1990). Things I have learned (so far). American Psychologist, 45(12), 1304–1312.
   Web of Science ®Google Scholar
• Craig, J. R., Eison, C. L., & Metze, L. P. (1976). Significance tests and their interpretation: An example utilizing published research and omega-squared. Bulletin of the Psychonomic Society, 7, 280–282.
   Web of Science ®Google Scholar
• Crask, M. R., & Perreault, W. D., Jr. (1977). Validation of discriminant analysis in marketing research. Journal of Marketing Research, 14, 60–68.
   Web of Science ®Google Scholar
• Daniel, L. G. (1989, January). Use of the jackknife statistic to establish the external validity of discriminant analysis results. Paper presented at the annual meeting of the Southwest Educational Research Association, Houston, TX. (ERIC Document Reproduction Service No. ED 305 382)
   Google Scholar
• Diaconis, P., & Efron, B. (1983). Computer-intensive methods in statistics. Scientific American, 248(5), 116–130.
   Web of Science ®Google Scholar
• Efron, B. (1979). Bootstrap methods: Another look at the jackknife. The Annals of Statistics, 7, 1–26.
   Web of Science ®Google Scholar
• Fisk, Y. H. (1991, April). Various approaches to effect size estimation. Paper presented at the annual meeting of the American Educational Research Association, Chicago.
   Google Scholar
• Glass, G. V (1979). Policy for the unpredictable (uncertainty research and policy). Educational Researcher, 8(9), 12–14.
   Google Scholar
• Glass, G. V., & Hakstian, A. R. (1969). Measures of association in comparative experiments: Their development and interpretation. American Educational Research Journal, 6, 403–414.
   Web of Science ®Google Scholar
• Glass, G. V., & Hopkins, K. D. (1984). Statistical methods in education and psychology (2nd ed.). Englewood Cliffs, NJ: Prentice-Hall.
   Google Scholar
• Good, I. J. (1981). Some logic and history of hypothesis testing. In J. Pitt (Ed.), Philosophy in economics (pp. 149–174). Dordrecht, Holland: Reidel.
   Google Scholar
• Greenwald, A. G. (1975). Consequences of prejudice against the null hypothesis. Psychological Bulletin, 82, 1–20.
   Web of Science ®Google Scholar
• Hays, W. L. (1981). Statistics (3rd ed.). New York: Holt, Rinehart and Winston.
   Google Scholar
• Herzberg, P. A. (1969). The parameters of cross validation. Psychometrika, Monograph supplement, No. 16.
   Google Scholar
• Huberty, C. J (1987). On statistical testing. Educational Researcher, 16(8), 4–9.
   Google Scholar
• Huberty, C. J., & Morris, J. D. (1988). A single contrast test procedure. Educational and Psychological Measurement, 48, 567–578.
   Web of Science ®Google Scholar
• Huck, S. W., Cormier, W. H., & Bounds, Jr., W. G. (1974). Reading statistics and research. New York: Harper & Row.
   Google Scholar
• Kaiser, H. F. (1976). [Review of factor analysis as a statistical method]. Educational and Psychological Measurement, 36, 586–589.
   Google Scholar
• Keppel, G., & Zedeck, S. (1989). Data analysis for research designs: Analysis of variance and multiple regression/correlation approaches. New York: W. H. Freeman.
   Google Scholar
• Kerlinger, F. N. (1986). Foundations of behavioral research (3rd ed.). New York: Holt, Rinehart and Winston.
   Google Scholar
• Knapp, T. R. (1978). Canonical correlation analysis: A general parametric significance testing system. Psychological Bulletin, 85, 410–416.
   Web of Science ®Google Scholar
• Kupfersmid, J. (1988). Improving what is published: A model in search of an editor. American Psychologist, 43, 635–642.
   Web of Science ®Google Scholar
• LaGaccia, S. S. (1991). Methodology choices in a cohort of education dissertations. In B. Thompson (Ed.), Advances in educational research: Substantive findings, methodological developments (Vol. 1, pp. 149–158). Greenwich, CT: JAI Press.
   Google Scholar
• Loftin, L. B., & Madison, S. Q. (1991). The extreme dangers of covariance corrections. In B. Thompson (Ed.), Advances in educational research: Substantive findings, methodological developments (Vol. 1, pp. 133–147). Greenwich, CT: JAI Press.
   Google Scholar
• Lord, F. (1950). Efficiency of prediction when a regression equation from one sample is used in a new sample (Research Bulletin 50-110). Princeton, NJ: Educational Testing Service.
   Google Scholar
• Lunneborg, C. E. (1987). Bootstrap applications for the behavioral sciences. Seattle: University of Washington.
   Google Scholar
• Lunneborg, C. E. (1990). [Review of Computer intensive methods for testing hypotheses]. Educational and Psychological Measurement, 50, 441–445.
   Web of Science ®Google Scholar
• Maxwell, S. E., Camp, C. J., & Arvey, R. D. (1981). Measures of strength of association: A comparative examination. Journal of Applied Psychology, 66, 525–534.
   Web of Science ®Google Scholar
• McGraw, K. O. (1991). Problems with the BESD: A comment on Rosenthal’s “How are we doing in soft psychology?” American Psychologist, 46, 1084–1086.
   Web of Science ®Google Scholar
• Meehl, P. E. (1978). Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology. Journal of Consulting and Clinical Psychology, 46, 806–834.
   Web of Science ®Google Scholar
• Mitchell, T. W., & Klimoski, R. J. (1986). Estimating the validity of cross-validity estimation. Journal of Applied Psychology, 71, 311–317.
   Web of Science ®Google Scholar
• Morrison, D. E., & Henkel, R. E. (Eds.). (1970). The significance test controversy. Chicago: Aldine.
   Google Scholar
• Neale, J. M., & Liebert, R. M. (1986). Science and behavior: An introduction to methods of research (3rd ed.). Englewood Cliffs, NJ: Prentice-Hall.
   Google Scholar
• Olejnik, S. F. (1984). Planning educational research: Determining the necessary sample size. Journal of Experimental Education, 53, 40–48.
   Web of Science ®Google Scholar
• Olkin, I., & Pratt, J. W. (1958). Unbiased estimation of certain correlation coefficients. Annals of Mathematical Statistics, 29, 201–211.
   Google Scholar
• Pedhazur, E. J. (1982). Multiple regression in behavioral research (2nd ed.). New York: Holt, Rinehart and Winston.
   Google Scholar
• Piel, G. (1978). Research for action. Educational Researcher, 7(2), 8–12.
   Google Scholar
• Rogan, J. C., & Keselman, H. J. (1977). Is the ANOVA F test robust to variance heterogeneity when sample sizes are equal?: An investigation via a coefficient of variation. American Educational Research Journal, 14, 493–498.
   Web of Science ®Google Scholar
• Rosenthal, R. (1979). The “file drawer problem” and tolerance for null results. Psychological Bulletin, 86, 638–641.
   Web of Science ®Google Scholar
• Rosenthal, R. (1991). Effect sizes: Pearson’s correlation, its display via the BESD, and alternative indices. American Psychologist, 46, 1086–1087.
   Web of Science ®Google Scholar
• Rosnow, R. L., & Rosenthal, R. (1988). Focused tests of significance and effect size estimation in counseling psychology. Journal of Counseling Psychology, 35, 203–208.
   Web of Science ®Google Scholar
• Rosnow, R. L., & Rosenthal, R. (1989). Statistical procedures and the justification of knowledge in psychological science. American Psychologist, 44, 1276–1284.
   Web of Science ®Google Scholar
• Salzman, K. L. (1989). A significantly significant approach to significant research findings: The Salzman all-significant F test. In G. C. Ellenbogen (Ed.), The primal whimper (pp. 158–162). New York: Guilford Press.
   Google Scholar
• Schmitt, N. W. (1982, August). Formula estimation of cross-validated multiple correlation. Paper presented at the annual meeting of the American Psychological Association, Washington, DC. (ERIC Document Reproduction Service No. ED 227 137)
   Google Scholar
• Schneider, A. L., & Darcy, R. E. (1984). Policy implications of using significance tests in evaluation research. Evaluation Review, 8, 573–582.
   Web of Science ®Google Scholar
• Serlin, R. C., & Lapsley, D. (1985). Rationality in psychological research: The good-enough principle. American Psychologist, 40, 73–83.
   Web of Science ®Google Scholar
• Shaver, J. (1985). Chance and nonsense. Phi Delta Kappan, 67(1), 57–60.
   Web of Science ®Google Scholar
• Smith, J. K. (1983). Quantitative versus qualitative research: An attempt to clarify the issue. Educational Researcher, 12(3), 6–13.
   Google Scholar
• Snyder, P., & Lawson, S. (1993). Evaluating results using corrected and uncorrected effect size estimates. Journal of Experimental Education, 61, 334–349.
   Web of Science ®Google Scholar
• Stevens, J. (1992). Applied multivariate statistics for the social sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
   Google Scholar
• Tatsuoka, M. M. (1973). An examination of the statistical properties of a multivariate measure of strength of relationships. Urbana: University of Illinois. (ERIC Document Reproduction Service No. ED 099 406)
   Google Scholar
• Thompson, B. (1987a). [Review of Foundations of behavioral research (3rd ed.)]. Educational Research and Measurement, 47, 1175–1181.
   Web of Science ®Google Scholar
• Thompson, B. (1987b, April). The use (and misuse) of statistical significance testing: Some recommendations for improved editorial policy and practice. Paper presented at the annual meeting of the American Education Research Association, Washington, DC. (ERIC Document Reproduction Service No. ED 287 868)
   Google Scholar
• Thompson, B. (1988a, April). Canonical correlation analysis: An explanation with comments on correct practice. Paper presented at the annual meeting of the American Educational Research Association, New Orleans. (ERIC Document Reproduction Service No. ED 295 957)
   Google Scholar
• Thompson, B. (1988b, November). Common methodology mistakes in dissertations: Improving dissertation quality. Paper presented at the annual meeting of the Mid-South Educational Research Association, Louisville, KY. (ERIC Document Reproduction Service No. ED 301 595)
   Google Scholar
• Thompson, B. (1988c). Program FACSTRAP: A program that computes bootstrap estimates of factor structure. Educational and Psychological Measurement, 48, 681–686.
   Web of Science ®Google Scholar
• Thompson, B. (1988d). [Review of Analyzing multivariate data]. Educational and Psychological Measurement, 48, 1129–1135.
   Web of Science ®Google Scholar
• Thompson, B. (1989a). Asking “what if” questions about significance tests. Measurement and Evaluation in Counseling and Development, 22, 66–68.
   Web of Science ®Google Scholar
• Thompson, B. (1989b). The place of qualitative methods in contemporary social science: The importance of post-paradigmatic thought. In B. Thompson (Ed.), Advances in social science methodology (Vol. 1, pp. 1–42). Greenwich, CT: JAI Press.
   Google Scholar
• Thompson, B. (1989c). Statistical significance, result importance, and result generalizability: Three noteworthy but somewhat different issues. Measurement and Evaluation in Counseling and Development, 22, 2–6.
   Web of Science ®Google Scholar
• Thompson, B. (1990). Finding a correction for the sampling error in multivariate measures of relationship: A Monte Carlo study. Educational and Psychological Measurement, 50, 15–31.
   Web of Science ®Google Scholar
• Thompson, B. (1991a). A primer on the logic and use of canonical correlation analysis. Measurement and Evaluation in Counseling and Development, 24(2), 80–95.
   Web of Science ®Google Scholar
• Thompson, B. (1991b). [Review of Data analysis for research designs]. Educational and Psychological Measurement, 51, 500–510.
   Web of Science ®Google Scholar
• Thompson, B. (1992a). DISCSTRA: A computer program that computes bootstrap resampling estimates of descriptive discriminant analysis function and structure coefficients and group centroids. Educational and Psychological Measurement, 52, 905–911.
   Web of Science ®Google Scholar
• Thompson, B. (1992b, April). Exploring the replicability of a study’s results: Bootstrap statistics for the multivariate case. Paper presented at the annual meeting of the American Educational Research Association, San Francisco. (ERIC Document Reproduction No. ED 344 895)
   Google Scholar
• Thompson, B. (1992c). Misuse of ANCOVA and related “statistical control” procedures. Reading Psychology, 13, iii-xviii.
   Google Scholar
• Thompson, B. (1992d). Two and one-half decades of leadership in measurement and evaluation. Journal of Counseling and Development, 70, 434–438.
   Web of Science ®Google Scholar
• Thompson, B. (in press). The pivotal role of replication in psychological research: Empirically evaluating the replicability of sample results. Journal of Personality.
   Google Scholar
• Tomarkin, A. J., & Serlin, R. C. (1986). Comparison of ANOVA alternatives under variance heterogeneity and specific noncentrality structures. Psychological Bulletin, 88, 90–99.
   Web of Science ®Google Scholar
• Wherry, R. J. (1931). A new formula for predicting the shrinkage of the coefficient of multiple correlation. Annals of Mathematical Statistics, 2, 440–451.
   Google Scholar
• Wike, E. L., & Church, J. D. (1976). Comments on Clark’s “The language-as-fixed-effect fallacy.” Journal of Verbal Learning and Verbal Behavior, 15, 249–255.
   Google Scholar
• Wilcox, R. R., Charlin, V. L., & Thompson, K. L. (1986). New Monte Carlo results on the robustness of the ANOVA F, W, and F' statistics. Communications and Statistics, 15, 933–943.
   Web of Science ®Google Scholar