The Insignificance of “Significance” Tests: Three Recommendations for Health Education Researchers

References

• Merrill , RM , Stoddard , J and Shields , EC . 2004 . The use of statistics in the American Journal of Health Education from 1994 through 2003: A content analysis . Amer J Health Educ , 35 : 290 – 297 .
   Google Scholar
• Basch , CE and Gold , RS . 1986 . The dubious effects of type V errors in hypothesis testing on health education practice and theory . Health Educ Res , 1 : 299 – 305 .
   Google Scholar
• Buhi , ER . Reliability reporting practices in rape myth research J Sch Health. In press
   Google Scholar
• Wang , MQ . 2001 . Research notes: Analysis of data from complex survey designs . Am J Health Behav , 25 : 72 – 74 .
   PubMedGoogle Scholar
• Peng , CJ , Manz , BD and Keck , J. 2001 . Modeling categorical variables by logistic regression . Am J Health Behav , 25 : 278 – 284 .
   PubMed Web of Science ®Google Scholar
• Drane , JW and Valois , RF . 2002 . Risk behavior data analysis: Ordinal or dichotomous the choice is yours . Am J Health Behav , 26 : 465 – 472 .
   PubMedGoogle Scholar
• Anderson , DR , Burnham , KP and Thompson , WL . 2000 . Null hypothesis testing: Problems, prevalence, and an alternative . J Wildl Manage , 64 : 912 – 923 .
   Web of Science ®Google Scholar
• Fidler , F , Cumming , G , Burgman , M and Thomason , N. 2004 . Statistical reform in medicine, psychology, and ecology . Journal of Socio-Economics , 33 : 615 – 630 .
   Google Scholar
• Nickerson , RS . 2000 . Null hypothesis significance testing: A review of an old and continuing controversy . Psychol Methods , 5 : 241 – 301 .
   PubMed Web of Science ®Google Scholar
• Harlow , LL , Mulaik , SA and Steiger , JH , eds. 1997 . What If There Were No Significance Tests? , Mahwah , NJ : Lawrence Erlbaum .
   Google Scholar
• Kline , RB . 2004 . Beyond Significance Testing: Reforming Data Analysis Methods in Behavioral Research , Washington , DC : American Psychological Association .
   Google Scholar
• Morrison , DE and Henkel , RE , eds. 1970 . The Significance Test Controversy: A Reader , Chicago : Aldine Publishing .
   Google Scholar
• Vacha-Haase , T. 2001 . Statistical significance should not be considered one of life's guarantees: Effect sizes are needed . Educ Psychol Meas , 61 : 219 – 224 .
   Web of Science ®Google Scholar
• Carver , RP . 1978 . The case against statistical significance testing . Harv Educ Rev , 48 : 378 – 399 .
   Web of Science ®Google Scholar
• Carver , RP . 1993 . The case against statistical significance testing, revisited . Journal of Experimental Education , 61 : 287 – 292 .
   Web of Science ®Google Scholar
• Cohen , J. 1994 . The Earth is round (p<.05) . Am Psychol , 49 : 997 – 1003 .
   Web of Science ®Google Scholar
• Thompson , B. Five methodology errors in educational research: The pantheon of statistical significance and other faux pas . Invited address at the annual meeting of the American Educational Research Association. April 15, San Diego, Ca. ERIC# ED 419 023.
   Google Scholar
• Thompson , B. 1999 . If statistical significance tests are broken/misused, what practices should supplement or replace them? . Theory Psychol , 9 : 165 – 181 .
   Web of Science ®Google Scholar
• Thompson , B. 2004 . The “significance” crisis in psychology and education . Journal of Socio-Economics , 33 : 607 – 613 .
   Google Scholar
• Kirk , RE . 1996 . Practical significance: A concept whose time has come . Educ Psychol Meas , 56 : 746 – 759 .
   Web of Science ®Google Scholar
• Cortina , JM and Dunlap , WP . 1997 . On the logic and purpose of significance testing . Psychol Methods , 2 : 161 – 172 .
   Web of Science ®Google Scholar
• Hagen , RL . 1998 . In praise of the null hypothesis statistical test . Am Psychol , 52 : 15 – 24 .
   Web of Science ®Google Scholar
• Thompson , B. 1998 . In praise of brilliance: Where that praise really belongs . Am Psychol , 53 : 799 – 800 .
   Web of Science ®Google Scholar
• Tukey , JW . 1991 . The philosophy of multiple comparisons . Stat Sci , 25 : 26 – 30 .
   Google Scholar
• Rosnow , RL and Rosenthal , R. 1989 . Statistical procedures and the justification of knowledge in psychological science . Am Psychol , 44 : 1276 – 1284 .
   Web of Science ®Google Scholar
• Shaver , JP . 1985 . Chance and nonsense . Phi Delta Kappan , 67 : 57 – 60 .
   Web of Science ®Google Scholar
• Snyder , P and Lawson , S. 1993 . Evaluating results using corrected and uncorrected effect size estimates . Journal of Experimental Education , 61 : 334 – 349 .
   Web of Science ®Google Scholar
• Thompson , B. 2002 . What future quantitative social science research could look like: Confidence intervals for effect sizes . Educational Researcher , 31 : 24 – 31 .
   Google Scholar
• Thompson , B. “ Research synthesis: Effect sizes ” . In Complementary Methods for Research in Education , Edited by: Green , J , Camilli , G and Elmore , PB . Washington , DC : American Educational Research Association . In press
   Google Scholar
• Thompson , B. 1993 . The use of statistical significance tests in research: Bootstrap and other alternatives . Journal of Experimental Education , 61 : 361 – 377 .
   Web of Science ®Google Scholar