Multiple comparison methods: Establishing guidelines for their valid application in neuropsychological research

References

• Algina , J. and Tang , K. L. 1988 . Type I error rates for Yao's and James' tests of equality of mean vectors under variance-covariance heteroscedasticity . Journal of Educational Statistics , 13 : 281 – 290 .
   Google Scholar
• Bevan , M. F. , Denton , J. Q. and Myers , J. L. 1974 . The robustness of the F test to violations of continuity and form of treatment population . British Journal of Mathematical and Statistical Psychology , 27 : 199 – 204 .
   Web of Science ®Google Scholar
• Bishop , T. A. and Dudewicz , E. J. March 1976 . Heteroscedastic ANOVA , March , Columbus : Ohio State University, Department of Statistics . Tech. Rep. No. 143
   Google Scholar
• Bishop , T. A. and Dudewicz , E. J. March 1977 . Analysis of variance with unequal variances test procedures and tables , March , Columbus : Ohio State University, Department of Statistics . Tech. Rep. No. 144
   Google Scholar
• Blair , R. C. and Higgins , J. J. 1985 . Comparison of the power of the paired samples t test to that of Wilcoxon's Signed-Ranks Test under various population shapes . Psychological Bulletin , 97 : 119 – 128 .
   Web of Science ®Google Scholar
• Bohrer , R. , Chow , W. , Faith , R. , Joshi , V. M. and Wu , C. F. 1981 . Multiple three-decision rules for factorial simple effects: Bonferroni wins again! . Journal of the American Statistical Association , 76 : 119 – 124 .
   Web of Science ®Google Scholar
• Boneau , C. A. 1960 . The effects of violations of assumptions underlying the t test . Psychological Bulletin , 57 : 49 – 64 .
   PubMed Web of Science ®Google Scholar
• Box , G. E.P. 1953 . Non-normality and tests on variances . Biometrika , 40 : 318 – 335 .
   Web of Science ®Google Scholar
• Bradley , J. V. 1966 . Studies in research methodology VII: The Central Limit effect for two dozen populations and its correlation with population moments , Ohio : Wright-Patterson Air Force Base, Aerospace Medical Research Laboratories . Tech. Rep. (AMRL-TR) No. 66–242
   Google Scholar
• Bradu , D. and Gabriel , K. R. 1974 . Simultaneous statistical inference on interactions in two-way analysis of variance . Journal of the American Statistical Association , 69 : 428 – 436 .
   Web of Science ®Google Scholar
• Breen , L. and Gaito , J. 1970 . Comments on Friedman's Rm procedure . Psychological Bulletin , 73 : 309 – 310 .
   Web of Science ®Google Scholar
• Cicchetti , D. V. 1972 . Extension of multiple range tests to interaction tables in the analysis of variance: A rapid approximate solution . Psychological Bulletin , 77 : 405 – 408 .
   Web of Science ®Google Scholar
• Cicchetti , D. V. 1974 . Reply to Keselman concerning Cicchetti's interpretation of the findings of Petrinovich and Hardyck . Psychological Bulletin , 81 : 896 – 897 .
   Web of Science ®Google Scholar
• Cochran , W. G. 1980 . “ Fisher and the analysis of variance ” . In Lecture notes in statistics I: R.A. Fisher: An appreciation , Edited by: Fienberg , S. E. and Hinkley , D. V. 17 – 34 . New York : Springer-Verlag .
   Google Scholar
• Cohen , J. 1988 . Statistical power analysis for the behavioral sciences , 2nd ed. , Hillsdale, NJ : Lawrence Erlbaum .
   Google Scholar
• Dawkins , H. C. 1983 . Multiple comparisons misused: Why so frequently in response-curve studies? . Biometrics , 39 : 789 – 790 .
   Web of Science ®Google Scholar
• Duncan , D. B. 1955 . Multiple range and multiple F tests . Biometrics , II : 1 – 42 .
   Web of Science ®Google Scholar
• Duncan , D. B. and Bryant , L. J. 1983 . Adaptive t tests for multiple comparisons . Biometrics , 39 : 790 – 794 .
   Web of Science ®Google Scholar
• Dunn , O. J. 1961 . Multiple comparisons among means . Journal of the American Statistical Association , 56 : 52 – 64 .
   Web of Science ®Google Scholar
• Dunnett , C. W. 1955 . A multiple comparison procedure for comparing several treatments with a control . American Statistical Association Journal , 50 : 1096 – 1121 .
   Web of Science ®Google Scholar
• Dunnett , C. W. 1964 . New tables for multiple comparisons with a control . Biometrics , 20 : 482 – 491 .
   Web of Science ®Google Scholar
• Dunnett , C. W. 1980 . Pairwise multiple comparisons in the homogeneous variance, unequal sample size case . Journal of the American Statistical Association , 75 : 789 – 795 .
   Web of Science ®Google Scholar
• Dunnett , C. W. 1980 . Pairwise multiple comparisons in the unequal variance case . Journal of the American Statistical Association , 75 : 796 – 800 .
   Web of Science ®Google Scholar
• Eisenhart , C. 1947 . The assumptions underlying the analysis of variance . Biometrics , 3 : 1 – 21 .
   PubMed Web of Science ®Google Scholar
• Fisher , R. A. and Mackenzie , W. A. 1923 . Studies in crop variation. II. The manurial response of different potato varieties . Journal of Agricultural Science , 13 : 311 – 320 .
   Web of Science ®Google Scholar
• Fleiss , J. L. 1986 . The design and analysis of clinical experiments , New York : John Wiley & Sons .
   Google Scholar
• Friedman , M. 1937 . The use of ranks to avoid the assumption of normality implicit in the analysis of variance . Journal of the American Statistical Association , 32 : 675 – 701 .
   Web of Science ®Google Scholar
• Gabriel , K. R. 1963 . A computer program for testing the homogeneity of all sets of means in analysis of variance , Unpublished manuscript
   Google Scholar
• Gabriel , K. R. 1964 . A procedure for testing the homogeneity of all sets of means in the analysis of variance . Biometrics , 20 : 459 – 477 .
   Web of Science ®Google Scholar
• Gabriel , K. R. 1978 . A simple method of multiple comparisons of means . Journal of the American Statistical Association , 73 : 724 – 729 .
   Web of Science ®Google Scholar
• Gaito , J. 1974 . A review of F.N. Kerlinger's Foundations of behavioral research , 2nd ed. , New York : Holt, Rinehart & Winston . 1973. Psychometrika, 39, 273–274
   Google Scholar
• Grove , W. M. and Andreasen , N. C. 1982 . Simultaneous tests of many hypotheses in exploratory research . Journal of Nervous and Mental Disease , 170 : 3 – 8 .
   PubMed Web of Science ®Google Scholar
• Harris , R. J. 1975 . A primer of multivariate statistics , New York : Academic Press .
   Google Scholar
• Harter , H. L. 1960 . Tables of range and studentized range . Annals of Mathematical Statistics , 31 : 1122 – 1147 .
   Google Scholar
• Harter , H. L. 1970 . Multiple comparison procedures for interaction . The American Statistician , 24 : 30 – 32 .
   Web of Science ®Google Scholar
• Higazi , S. M.F. and Dayton , C. M. 1988 . Tables for a multivariate extension of the Dunnett test when the control group and balanced experimental groups have different sample sizes . Communications in Statistics: Simulations , 17 : 85 – 101 .
   Web of Science ®Google Scholar
• Hollingsworth , H. H. 1980 . Estimating strength of levels of main, simple main and interaction effects in ANOVA . Paper presented at the joint meeting of the American Statistical Association . March 1980 .
   Google Scholar
• Horsnell , G. 1953 . The effect of unequal group variances on the F test for the homogeneity of group means . Biometrika , 40 : 128 – 136 .
   Web of Science ®Google Scholar
• Jaccard , J. , Becker , M. A. and Wood , G. 1984 . Pairwise multiple comparison procedures: A review . Psychological Bulletin , 96 : 589 – 596 .
   Web of Science ®Google Scholar
• Johnson , D. E. 1976 . Some new multiple comparison procedures for the two-way ANOVA Model with interaction . Biometrics , 32 : 929 – 934 .
   Web of Science ®Google Scholar
• Kerlinger , F. N. 1973 . Foundations of behavioral research , 2nd ed. , New York : Holt, Rinehart & Winston .
   Google Scholar
• Keselman , H. J. 1974 . Cicchetti's reversal of Petrinovich and Hardyck's major conclusions . Psychological Bulletin , 81 : 896 – 897 .
   Google Scholar
• Keselman , H. J. 1976 . A power investigation of the Tukey multiple comparison statistic . Educational and Psychological Measurement , 36 : 97 – 104 .
   Web of Science ®Google Scholar
• Keselman , H. J. , Games , P. A. and Clinch , J. J. 1979 . Tests for homogeneity of variance . Communications in Statistics: Simulations and Computations , 138 : 113 – 129 .
   Web of Science ®Google Scholar
• Keselman , H. J. , Games , P. A. and Rogan , J. C. 1980 . Type I and Type II errors in simultaneous and two-stage multiple comparison procedures . Psychological Bulletin , 88 : 356 – 358 .
   Web of Science ®Google Scholar
• Keselman , H. J. and Keselman , J. C. 1988 . Repeated measures multiple comparison procedures: Effects of violating multisample sphericity in unbalanced designs . Journal of Educational Statistics , 13 : 215 – 226 .
   Google Scholar
• Keselman , H. J. , Murray , R. and Rogan , J. 1976 . Effect of very unequal group sizes on Tukey's multiple comparison test . Educational and Psychological Measurement , 36 : 263 – 270 .
   Web of Science ®Google Scholar
• Keselman , H. J. and Rogan , J. C. 1977 . The Tukey multiple comparison test: 1953–1976 . Psychological Bulletin , 84 : 1050 – 1056 .
   Web of Science ®Google Scholar
• Keselman , H. J. and Toothaker , L. E. 1973 . Error rates for multiple comparison methods: Some evidence concerning the misleading conclusions of Petrinovich and Hardyck . Psychological Bulletin , 80 : 31 – 32 .
   Web of Science ®Google Scholar
• Keselman , H. J. and Toothaker , L. E. 1974 . Comparison of Tukey's T-method and Sheffé's S-method for various numbers of all possible differences of averages contrasts under violation of assumptions . Educational and Psychological Measurement , 34 : 511 – 519 .
   Web of Science ®Google Scholar
• Keuls , M. 1952 . The use of the “studentized range” in connection with an analysis of variance . Euphytica , 1 : 112 – 122 .
   Google Scholar
• Kramer , C. Y. 1956 . Extension of multiple range tests to group means with unequal numbers of replications . Biometrics , 12 : 307 – 310 .
   Web of Science ®Google Scholar
• Leach , C. 1979 . Introduction to statistics: A nonparametric approach for the social sciences , New York : John Wiley & Sons .
   Google Scholar
• Lehmann , E. L. and Shaffer , J. P. 1977 . On a fundamental theorem in multiple comparisons . Journal of the American Statistical Association , 72 : 576 – 578 .
   Web of Science ®Google Scholar
• Marascuilo , L. A. 1966 . Large-sample multiple comparisons . Psychological Bulletin , 65 : 280 – 290 .
   PubMed Web of Science ®Google Scholar
• Maxwell , S. E. 1980 . Pairwise multiple comparisons in repeated measures designs . Journal of Educational Statistics , 5 : 269 – 287 .
   Google Scholar
• Miller , R. G. 1976 . Advances in multiple comparisons in the last decade , California : Stanford University . Tech. Rep. No. 26
   Google Scholar
• Miller , R. P. 1977 . Developments in multiple comparisons: 1966–1976 . Journal of the American Statistical Association , 72 : 779 – 788 .
   Web of Science ®Google Scholar
• Milligan , G. W. 1980 . Factors that affect Type I and Type II error rates in the analysis of multidimensional contingency tables . Psychological Bulletin , 87 : 238 – 244 .
   Web of Science ®Google Scholar
• Newman , D. 1939 . The distribution of range in samples from a normal population, expressed in terms of independent estimate of a standard deviation . Biometrika , 31 : 20 – 30 .
   Google Scholar
• O'Brien , P. C. 1983 . The appropriateness of analysis of variance and multiple comparison procedures . Biometrics , 39 : 787 – 794 .
   PubMed Web of Science ®Google Scholar
• O'Grady , K. E. 1982 . Measures of explained variance: Cautions and limitations . Psychological Bulletin , 92 : 766 – 777 .
   Web of Science ®Google Scholar
• Permutter , J. and Myers , J. L. 1973 . A comparison of two procedures for testing multiple contrasts . Psychological Bulletin , 79 : 181 – 184 .
   Web of Science ®Google Scholar
• Petrinovich , L. F. and Hardyck , C. D. 1969 . Error rates for multiple comparison methods: Some evidence concerning the frequency of erroneous conclusions . Psychological Bulletin , 71 : 43 – 54 .
   Web of Science ®Google Scholar
• Rodger , R. S. 1974 . Multiple contrasts, factors, error rate and power . British Journal of Mathematical and Statistical Psychology , 27 : 179 – 198 .
   Web of Science ®Google Scholar
• Rosenthal , R. and Rubin , D. B. 1983 . Ensemble-adjusted p values . Psychological Bulletin , 94 : 540 – 541 .
   Web of Science ®Google Scholar
• Ryan , T. A. 1959 . Multiple comparisons in psychological research . Psychological Bulletin , 56 : 26 – 47 .
   PubMed Web of Science ®Google Scholar
• Ryan , T. A. 1960 . Significance tests for multiple comparison of proportions, variances, and other statistics . Psychological Bulletin , 57 : 318 – 328 .
   PubMed Web of Science ®Google Scholar
• Ryan , T. A. 1980 . Comment on “protecting the overall rate of Type I errors for pairwise comparisons with an omnibus statistic.” . Psychological Bulletin , 88 : 354 – 355 .
   Web of Science ®Google Scholar
• Ryan , T. A. 1985 . “Ensemble adjusted p values”: How are they to be weighted? . Psychological Bulletin , 97 : 521 – 526 .
   Web of Science ®Google Scholar
• Schafer , W. D. and Macready , G. B. 1975 . A modification of the Bonferroni procedure on contrasts which are grouped into internally independent sets . Biometrics , 31 : 227 – 228 .
   Web of Science ®Google Scholar
• Scheffé , H. 1953 . A method for judging all contrasts in the analysis of variance . Biometrica , 40 : 87 – 104 .
   Web of Science ®Google Scholar
• Shaffer , J. P. 1977 . Multiple comparisons emphasizing selected contrasts: An extension and generalization of Dunnett's procedure . Biometrics , 33 : 293 – 303 .
   PubMed Web of Science ®Google Scholar
• Sirotnik , B. W.Q. and Beaver , R. J. 1984 . Paired comparison experiments involving all possible pairs . British Journal of Mathematical and Statistical Psychology , 37 : 22 – 33 .
   Web of Science ®Google Scholar
• Smith , R. A. 1971 . The effect of unequal group size on Tukey's HSD procedure . Psychometrika , 36 : 31 – 34 .
   Web of Science ®Google Scholar
• Stoline , M. R. and Ury , H. K. 1979 . Tables of the studentized maximum modulus distribution and an application to multiple comparisons among means . Technometrics , 21 : 87 – 93 .
   Web of Science ®Google Scholar
• Toothaker , L. E. 1991 . Multiple comparisons for researchers , Newbury Park, CA : Sage .
   Google Scholar
• Ury , H. K. and Wiggins , A. D. 1974 . Use of the Bonferroni inequality for multiple comparisons among means with post hoc contrasts . British Journal of Mathematical and Statistical Psychology , 27 : 176 – 178 .
   Web of Science ®Google Scholar