Comparisons of Improvement-Over-Chance Effect Sizes for Two Groups Under Variance Heterogeneity and Prior Probabilities

REFERENCES

• American Educational Research Association . 2006 . Standards for reporting on empirical social science research in AERA publications . Educational Researcher , 35 : 33 – 40 .
   Google Scholar
• American Psychological Association . 2010 . Publication manual of the American Psychological Association (6th ed.) , Washington , DC : Author .
   Google Scholar
• Bishop , C. M. 2006 . Pattern recognition and machine learning , New York , NY : Springer .
   Google Scholar
• Carroll , R. M. and Nordholm , L. A. 1975 . A sampling characteristic of Kelley's ϵ 2 and Hays’ ω 2 . Educational and Psychological Measurement , 35 : 541 – 554 .
   Google Scholar
• Cohen , J. 1988 . Statistical power analysis for the behavioral sciences (2nd ed.) , Hillsdale , NJ : Erlbaum .
   Google Scholar
• Dattalo , P. 1994 . A comparison of discriminant analysis and logistic regression . Journal of Social Service Research , 19 : 121 – 144 .
   Web of Science ®Google Scholar
• Fan , X. and Wang , L. 1999 . Comparing linear discriminant function with logistic regression for the two-group classification problem . Journal of Experimental Education , 67 : 265 – 286 .
   Web of Science ®Google Scholar
• Ferrer , A. J. and Wang , L. 1999 . Comparing the classification accuracy among nonparametric, parametric discriminant analysis and logistic regression methods. Paper presented at the annual meeting of the American Educational Research Association, Montreal, Quebec, Canada. (ERIC Document Reproduction Service No. ED 432 591) .
   Google Scholar
• Finch , W. H. and Schneider , M. K. 2005 . Misclassification rates for four methods of group classification: Impact of predictor distribution, covariance inequality, effect size, sample size and group size ratio . Educational and Psychological Measurement , 66 : 240 – 257 .
   Web of Science ®Google Scholar
• Glass , G. V. 1976 . Primary, secondary, and meta-analysis of research . Educational Researcher , 5 : 3 – 8 .
   Google Scholar
• Henson , R. K. 2006 . Effect size measures and meta-analytic thinking in counseling psychology research . The Counseling Psychologist , 34 : 601 – 629 .
   Web of Science ®Google Scholar
• Hess , B. , Olejnik , S. and Huberty , C. J. 2001 . The efficacy of two improvement-over-chance effect sizes for two-group univariate comparisons under variance heterogeneity and nonnormality . Educational and Psychological Measurement , 61 : 909 – 936 .
   Web of Science ®Google Scholar
• Hoekstra , R. , Kiers , H. A. L. and Johnson , A. 2012 . Are assumptions of well-known statistical techniques checked, and why (not)? . Frontiers in Psychology: Quantitative Psychology and Measurement , 3 Retrieved from http://www.frontiersin.org/quantitative_psychology_and_measurement/10.3389/fpsycg.2012.00137/full
   Google Scholar
• Hubbard , R. and Ryan , P. A. 2000 . The historical growth of statistical significance testing in psychology-and its future prospects . Educational and Psychological Measurement , 60 : 661 – 681 .
   Web of Science ®Google Scholar
• Huberty , C. J. 1994 . Applied discriminant analysis. , New York , NY : Wiley .
   Google Scholar
• Huberty , C. J. 2002 . A history of effect size indices . Educational and Psychological Measurement , 62 : 227 – 240 .
   Web of Science ®Google Scholar
• Huberty , C. J. and Barton , R. M. 1989 . An introduction to discriminant analysis . Measurement and Evaluation in Counseling and Development , 22 : 158 – 168 .
   Web of Science ®Google Scholar
• Huberty , C. J. and Holmes , S. E. 1983 . Two-group comparisons and univariate classification . Educational and Psychological Measurement , 43 : 15 – 26 .
   Google Scholar
• Huberty , C. J. and Lowman , L. L. 2000 . Group overlap as a basis for effect size . Educational and Psychological Measurement , 60 : 543 – 563 .
   Web of Science ®Google Scholar
• Huberty , C. J. and Olejnik , S. 2006 . Applied MANOVA and discriminant analysis (2nd ed.) , Hoboken , NJ : Wiley .
   Google Scholar
• Huberty , C. J. and Pike , C. J. 1999 . “ On some history regarding statistical testing ” . In Advances in social science methodology , Edited by: Thompson , B. Vol. 5 , 1 – 22 . Stamford , CT : JAI Press .
   Google Scholar
• Hwang , D. 2001 . Issues in predictive discriminant analysis: Using and interpreting the leave-one-out jackknife method and the improvement-over-chance I index effect size. Paper presented at the Annual Meeting of the Southwest Educational Research Association, New Orleans, LA. (ERIC Document Reproduction Service No. ED 451 211) .
   Google Scholar
• Keselman , H. J. , Huberty , C. J. , Lix , L. M. , Olejnik , S. , Cribbie , R. A. , Donahue , B. and Levin , J. R. 1998 . Statistical practices of educational researchers: An analysis of their ANOVA, MANOVA, and ANCOVA analyses . Review of Educational Research , 68 : 350 – 386 .
   Web of Science ®Google Scholar
• Kieffer , K. M. , Reese , R. J. and Thompson , B. 2001 . Statistical techniques employed in AERJ and JCP articles from 1988 to 1997: A methodological review . Journal of Experimental Education , 69 : 280 – 309 .
   Web of Science ®Google Scholar
• Kirk , R. E. 2005 . “ Effect size measures ” . In Encyclopedia of statistics in behavioral science , Edited by: Everitt , B. S. and Howell , D. S. Vol. 2 , Chichester, West Sussex , , England : Wiley .
   Google Scholar
• Klecka , W. R. 1980 . Discriminant analysis (Sage University Paper series on Quantitative Applications in the Social Sciences, No. 07-019) , Newbury Park , CA : Sage .
   Google Scholar
• Lopez-Lopez , A. , Montorio , I. , Izal , M. and Velasco , L. 2008 . The role of psychological variables in explaining depression in older people with chronic pain . Aging & Mental Health , 12 : 735 – 745 .
   PubMed Web of Science ®Google Scholar
• Meshbane , A. and Morris , J. D. 1995 . Assuming equal and unequal prior probabilities of group membership in discriminant analysis: Effect on predictive accuracy. Paper presented at the annual meeting of the American Educational Research Association, San Francisco, CA. (ERIC Document Reproduction Service No. ED 392 843) .
   Google Scholar
• Natesan , P. and Thompson , B. 2007 . Extending improvement-over-chance I-index effect size simulation studies to cover some small-sample cases . Educational and Psychological Measurement , 67 : 59 – 72 .
   Google Scholar
• Onwuegbuzie , A. J. and Daniel , L. G. 2005 . Editorial: Evidence-based guidelines for publishing articles in Research in the Schools and beyond . Research in the Schools , 12 : 1 – 11 .
   Google Scholar
• Pedhazur , E. J. and Schmelkin , L. P. 1991 . Measurement, design, and analysis: An integrated approach , Hillsdale , NJ : Erlbaum .
   Google Scholar
• Press , S. J. and Wilson , S. 1978 . Choosing between logistic regression and discriminant analysis . Journal of the American Statistical Association , 73 : 699 – 705 .
   Web of Science ®Google Scholar
• Rosenthal , R. 1994 . “ Parametric measures of effect size ” . In The handbook of research synthesis , Edited by: Cooper , H. and Hedges , L. V. 231 – 244 . New York , NY : Russell Sage Foundation .
   Google Scholar
• Snyder , P. and Lawson , S. 1993 . Evaluating results using corrected and uncorrected effect size estimates . Journal of Experimental Education , 61 : 334 – 349 .
   Web of Science ®Google Scholar
• Tatsuoka , M. M. 1988 . Multivariate analysis , New York , NY : Macmillan .
   Google Scholar
• Thompson , B. 1993 . The use of statistical significance tests in research: Bootstrap and other alternatives . Journal of Experimental Education , 61 : 361 – 377 .
   Web of Science ®Google Scholar
• Thompson , B. 2001 . Significance, effect sizes, stepwise methods, and other issues: Strong arguments move the field . Journal of Experimental Education , 70 : 80 – 93 .
   Web of Science ®Google Scholar
• Thompson , B. 2002 . What future quantitative social science research should look like: Confidence intervals for effect sizes . Educational Researcher , 31 : 25 – 32 .
   Google Scholar
• Walters , G. D. , White , T. W. and Greene , R. L. 1988 . Use of the MMPI to identify malingering and exaggeration of psychiatric symptomatology in male prison inmates . Journal of Consulting and Clinical Psychology , 56 : 111 – 117 .
   PubMed Web of Science ®Google Scholar
• Wilcox , R. R. 1987 . New designs in analysis of variance . Annual Review of Psychology , 38 : 29 – 60 .
   Web of Science ®Google Scholar