A Meta-View of Multivariate Statistical Inference Methods in European Psychology Journals

REFERENCES

• Abelson , R. P. 1997 . The surprising longevity of flogged horses: Why there is a case for the significance test? . Psychological Science , 8 : 12 – 15 . doi: 10.1111/j.1467-9280.1997.tb00536.x
   Web of Science ®Google Scholar
• Aberson , C. 2010 . Applied power analysis for the behavioral sciences. , New York , NY : Routledge .
   Google Scholar
• Akaike , H. 1987 . Factor analysis and AIC. . Psychometrika , 52 : 317 – 332 . doi: 10.1007/BF02294359
   Web of Science ®Google Scholar
• Alhija , F. N.-A. and Levy , A. 2009 . Effect size reporting practices in published articles. . Educational and Psychological Measurement , 69 : 245 – 265 . doi: 10.1177/0013164408315266
   Web of Science ®Google Scholar
• American Psychological Association. 2010 . Publication manual of the American Psychological Association() , 6th ed. , Washington , DC : Author .
   Google Scholar
• Balluerka , N. , Gómez , J. and Hidalgo , D. 2005 . The controversy over null hypothesis significance testing revisited. . Methodology: European Journal of Research Methods for the Behavioral and Social Sciences , 1 : 55 – 70 . doi: 10.1027/1614-1881.1.2.55
   Google Scholar
• Baron , R. M. and Kenny , D. A. 1986 . The moderator-mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. . Journal of Personality and Social Psychology , 51 : 1173 – 1182 . doi: 10.1037/0022-3514.51.6.1173
   PubMed Web of Science ®Google Scholar
• Becker , B. J. 2000 . “ Multivariate meta-analysis. ” . In Handbook of applied multivariate statistics and mathematical modeling , Edited by: Tinsley , H. E. A. and Brown , S. D. 499 – 525 . San Diego , CA : Academic Press . doi: 10.1016/B978-012691360-6/50018-5
   Google Scholar
• Bentler , P. M. 1990 . Comparative fit indexes in structural models. . Psychological Bulletin , 107 : 238 – 246 . doi: 10.1037/0033-2909.107.2.238
   PubMed Web of Science ®Google Scholar
• Bentler , P. M. and Bonett , D. G. 1980 . Significance tests and goodness of fit in the analysis of covariance structures. . Psychological Bulletin , 88 : 588 – 606 . doi: 10.1037/0033-2909.88.3.588
   Web of Science ®Google Scholar
• Bodnar , O. , Bodnar , T. and Gupta , A. K. 2010 . Estimation and inference for dependence in multivariate data. . Journal of Multivariate Analysis , 101 : 869 – 881 . doi: 10.1016/j.jmva.2009.11.005
   Web of Science ®Google Scholar
• Borenstein , M. , Hedges , L. V. , Higgins , J. P. T. and Rothstein , H. R. 2009 . Introduction to meta-analysis. , New York , NY : Wiley .
   Google Scholar
• Burnham , K. P. and Anderson , D. R. 2002 . Model selection and multimodel inference: A practical information-theoretic approach () , 2nd ed. , New York , NY : Springer .
   Google Scholar
• Cafri , G. , Kromrey , J. D. and Brannick , M. T. 2010 . A meta-meta-analysis: Empirical review of statistical power, type I error rates, effect sizes, and model selection of meta-analyses published in psychology. . Multivariate Behavioral Research , 45 : 239 – 270 . doi: 10.1080/00273171003680187
   PubMed Web of Science ®Google Scholar
• Chan , M. E. and Arvey , R. D. 2012 . Meta-analysis and the development of knowledge. . Perspectives on Psychological Science , 7 : 79 – 92 . doi: 10.1177/1745691611429355
   Web of Science ®Google Scholar
• Chow , S. L. 1996 . Statistical significance: Rationale, validity and utility. , Beverly Hills , CA : Sage .
   Google Scholar
• Cleveland , W. S. 1984 . Graphical methods for data presentation: Full scale breaks, dot charts, and multibased logging. . The American Statistician , 38 : 270 – 280 . doi: 10.1080/00031305.1984.10483224
   Web of Science ®Google Scholar
• Cleveland , W. S. 1993 . Visualizing data. , Murray Hill , NJ : AT&T Bell Laboratories .
   Google Scholar
• Cohen , J. 1962 . The statistical power of abnormal-social psychological research. . Journal of Abnormal and Social Psychology , 65 : 143 – 153 .
   Web of Science ®Google Scholar
• Cohen , J. 1988 . Statistical power analysis for the behavioral sciences () , 2nd ed. , San Diego , CA : Academic Press .
   Google Scholar
• Cohen , J. 1992 . A power primer. . Psychological Bulletin , 112 : 155 – 159 . doi: 10.1037/0033-2909.112.1.155
   PubMed Web of Science ®Google Scholar
• Cohen , J. 1994 . The earth is round (p < .05). . American Psychologist , 49 : 997 – 1003 . doi: 10.1037/0003-066X.49.12.997
   Web of Science ®Google Scholar
• Cohen , J. , Cohen , P. , West , S. G. and Aiken , L. S. 2003 . Applied multiple regression/correlation analysis for the behavioral sciences. , Mahwah , NJ : Erlbaum .
   Google Scholar
• Cumming , G. 2008 . Replication and p intervals: p values predict the future only vaguely, but confidence intervals do much better. . Perspectives on Psychological Science , 3 : 286 – 300 . doi: 10.1111/j.1745-6924.2008.00079.x
   Web of Science ®Google Scholar
• Cumming , G. 2012 . Understanding the new statistics: Effect sizes, confidence intervals, and meta-analysis. , New York , NY : Routledge .
   Google Scholar
• Denis , D. 2003 . Alternatives to null hypothesis significance testing. . Theory & Science , 4 : 1 – 21 . Retrieved from http://theoryandscience.icaap.org/content/vol4.1/02_denis.html
   Google Scholar
• Fidler , F. and Cumming , G. 2013 . “ Effect size estimation and confidence intervals. ” . In Handbook of psychology: Vol. 2. Research methods in psychology ( , 2nd ed. , Edited by: Schinka , J. A. , Velicer , W. F. and Weiner , I. B. 142 – 163 . Hoboken , NJ : Wiley .
   Google Scholar
• Fidler , F. , Thomason , N. , Cumming , G. , Finch , S. and Leeman , J. 2004 . Editors can lead researchers to confidence intervals, but can't make them think: Statistical reform lessons from medicine. . Psychological Science , 15 : 119 – 126 . doi: 10.1111/j.0963-7214.2004.01502008.x
   PubMed Web of Science ®Google Scholar
• Friendly , M. 2000 . Visualizing categorical data. , Cary , NC : SAS Institute, Inc. . doi: 10.1002/jhbs.2007
   Google Scholar
• Glass , G. V. 1976 . Primary, secondary and meta-analysis research. . Educational Researcher , 5 : 3 – 8 . doi: 10.3102/0013189X005010003
   Google Scholar
• Greenacre , M. and Hastie , T. 1987 . The geometric interpretation of correspondence analysis. . Journal of the American Statistical Association , 82 : 437 – 447 .
   Web of Science ®Google Scholar
• Grimm , L. G. and Yarnold , P. R. , eds. 1995 . Reading and understanding multivariate statistics. , Washington , DC : American Psychological Association .
   Google Scholar
• Grimm , L. G. and Yarnold , P. R. , eds. 2000 . Reading and understanding more multivariate statistics. , Washington , DC : American Psychological Association .
   Google Scholar
• Grissom , R. J. and Kim , J. J. 2012 . Effect sizes for research: Univariate and multivariate applications () , 2nd ed. , New York , NY : Routledge .
   Google Scholar
• Harlow , L. L. 2005 . The essence of multivariate thinking: Basic themes and methods. , Mahwah , NJ : Erlbaum .
   Google Scholar
• Harlow , L. L. 2010 . On scientific research: Invited commentary on the role of statistical modeling and hypothesis testing. . Journal of Modern Applied Statistical Methods , 9 : 348 – 358 .
   Google Scholar
• Harlow , L. L. , Mulaik , S. A. and Steiger , J. H. , eds. 1997 . What if there were no significance tests? , Mahwah , NJ : Erlbaum .
   Google Scholar
• Hess , M. R. , Hogarty , K. Y. , Ferron , J. M. and Kromrey , J. D. 2007 . Interval estimates of multivariate effect sizes: Coverage and interval width estimates under variance heterogeneity and nonnormality. . Educational and Psychological Measurement , 67 : 21 – 40 . doi: 10.1177/0013164406288159
   Web of Science ®Google Scholar
• Huberty , C. J. 2002 . A history of effect size indices (statistical data included). . Educational and Psychological Measurement , 62 : 227 – 240 . doi: 10.1177/0013164402062002002
   Web of Science ®Google Scholar
• Hunter , J. E. and Schmidt , F. L. 2004 . Methods of meta-analysis: Correcting error and bias in research findings () , 2nd ed. , Thousand Oaks , CA : Sage .
   Google Scholar
• Kelley , K. and Preacher , K. J. 2012 . On defining effect size. . Psychological Methods , 17 : 137 – 152 . doi: 10.1037/a0028086
   PubMed Web of Science ®Google Scholar
• Kirk , R. 1996 . Practical significance: A concept whose time has come. . Educational and Psychological Measurement , 56 : 746 – 759 . doi: 10.1177/0013164496056005002
   Web of Science ®Google Scholar
• Kline , R. 2004 . Beyond significance testing: Reforming data analysis methods in behavioral research , Washington , DC : American Psychological Association . doi: 10.1037/10693-000
   Google Scholar
• La Greca , A. M. 2005 . Editorial. . Journal of Consulting and Clinical Psychology , 73 : 3 – 5 . doi: 10.1037/0022-006X.73.1.3
   Web of Science ®Google Scholar
• Lai , K. and Kelley , K. 2011 . Accuracy in parameter estimation for targeted effects in structural equation modeling: Sample size planning for narrow confidence intervals. . Psychological Methods , 16 : 127 – 148 . doi: 10.1037/a0021764
   PubMed Web of Science ®Google Scholar
• MacKinnon , D. P. 2008 . Introduction to statistical mediation analysis. , New York , NY : Erlbaum .
   Google Scholar
• Maxwell , A. E. 1961 . Canonical variate analysis when the variables are dichotomous. . Educational and Psychological Measurement , 21 : 259 – 271 .
   Web of Science ®Google Scholar
• Maxwell , S. E. and Delaney , H. D. 2004 . Designing experiments and analyzing data: A model comparison perspective () , 2nd ed. , Mahwah , NJ : Erlbaum .
   Google Scholar
• McGrath , R. E. 2011 . Quantitative models in psychology. , Washington , DC : American Psychological Association . doi: 10.1037/12316-00
   Google Scholar
• Mendoza , J. L. and Stafford , K. L. 2001 . Confidence intervals, power calculation, and sample size estimation for the squared multiple correlation coefficient under the fixed and random regression models: A computer program and useful standard tables. . Educational and Psychological Measurement , 61 : 650 – 667 . doi: 10.1177/00131640121971419
   Web of Science ®Google Scholar
• Mulaik , S. A. , Raju , N. S. and Harshman , R. A. 1997 . “ There is a time and place for significance testing. ” . In What if there were no significance testing? , Edited by: Harlow , L. L. , Mulaik , S. A. and Steiger , J. H. 65 – 115 . Mahwah , NJ : Erlbaum .
   Google Scholar
• Nam , I.-S. , Mengersen , K. and Garthwaite , P. 2003 . Multivariate meta-analysis. . Statistics in Medicine , 22 : 2309 – 2333 . doi: 10.1002/sim.1410
   PubMed Web of Science ®Google Scholar
• Pearson , K. 1885 . Contributions to the mathematical theory of evolution: II. Skew variation in homogeneous material. . Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences , 186 : 343 – 414 . Retrieved from http://rsta.royalsocietypublishing.org/content/186/343.full.pdf+html?sid=11e2cf1a-b1b5–4c6a-a5fb-71f514c3b3a9
   Google Scholar
• Peng , C.-Y. J. , Chen , L.-T. , Chiang , H.-M. and Chiang , Y.-C. 2013 . The impact of APA and AERA guidelines on effect size reporting. . Educational Psychology Review , 25 : 157 – 209 . doi: 10.1007/s10648-013-9218-2
   Web of Science ®Google Scholar
• Raudenbush , S. W. , Becker , B. J. and Kalaian , H. 1988 . Modeling multivariate effect size. . Psychological Bulletin , 103 : 111 – 120 . doi: 10.1037/0033-2909.103.1.111
   Web of Science ®Google Scholar
• Robinson , D. H. and Levin , J. R. 2010 . The not-so-quiet revolution: Cautionary comments on the rejection of hypothesis testing in favor of a ‘causal’ modeling alternative. . Journal of Modern Applied Statistical Methods , 9 : 332 – 339 .
   Google Scholar
• Rodgers , J. L. 2010 . The epistemology of mathematical and statistical modeling: A quiet methodological revolution. . American Psychologist , 65 : 1 – 12 . doi: 10.1037/a0018326
   PubMed Web of Science ®Google Scholar
• Rossi , J. S. 1990 . Statistical power of psychological research: What have we gained in 20 years? . Journal of Consulting and Clinical Psychology , 58 : 646 – 656 .
   PubMed Web of Science ®Google Scholar
• Schmidt , F. L. and Hunter , J. E. 1997 . “ Eight common but false objections to the discontinuation of significance testing in the analysis of research data. ” . In What if there were no significance tests? , Edited by: Harlow , L. L. , Mulaik , S. A. and Steiger , J. H. 37 – 64 . Mahwah , NJ : Erlbaum .
   Google Scholar
• Singer , J. D. and Willett , J. B. 2003 . Applied longitudinal data analysis: Modeling change and event occurrence. , New York , NY : Oxford University Press .
   Google Scholar
• Skrondal , A. and Rabe-Hesketh , S. 2004 . Generalized latent variable modeling: Multilevel, longitudinal, and structural equation models. , Boca Raton , FL : Chapman & Hall .
   Google Scholar
• Steiger , J. H. and Fouladi , R. T. 1992 . R2: A computer program for interval estimation, power calculation, sample size estimation, and hypothesis testing in multiple regression. . Behavior Research Methods, Instruments, and Computers , 24 : 581 – 582 . doi: 10.3758/BF03203611
   Google Scholar
• Steiger , J. H. and Lind , J. C. Statistically based tests for the number of common factors. Paper presented at the Psychometric Society annual meeting . Iowa City , IA .
   Google Scholar
• Stevens , J. P. 2009 . Applied multivariate statistics for the social sciences () , 5th ed. , New York , NY : Routledge .
   Google Scholar
• Steyn , H. S. Jr. and Ellis , S. M. 2009 . Estimating an effect size in one-way multivariate analysis of variance (MANOVA). . Multivariate Behavioral Research , 44 : 106 – 129 . doi: 10.1080/00273170802620238
   PubMed Web of Science ®Google Scholar
• Sun , S. , Pan , W. and Wang , L. L. 2011 . Rethinking observed power: Concept, practice, and implications. . Methodology , 7 : 81 – 87 . doi: 10.1027/1614-2241/a000025
   Web of Science ®Google Scholar
• Tabachnick , B. G. and Fidell , L. S. 2013 . Using multivariate Pearsonstatistics () , 6th ed. Boston , MA
   Google Scholar
• Thompson , B. 1996 . AERA editorial policies regarding statistical significance testing: Three suggested reforms. . Educational Researcher , 25 : 26 – 30 . doi: 10.3102/0013189X025002026
   Google Scholar
• Thompson , B. 2007 . Effect sizes, confidence intervals, and confidence intervals for effect sizes. . Psychology in the Schools , 44 : 423 – 432 . doi: 10.1002/pits.20234
   Web of Science ®Google Scholar
• Tukey , J. W. 1977 . Exploratory data analysis. , Reading , MA : Addison-Wesley .
   Google Scholar
• Wilkinson , L. and The Task Force on Statistical Inference. 1999 . Statistical methods in psychology journals: Guidelines and explanations. . American Psychologist , 54 : 594 – 604 .
   Web of Science ®Google Scholar
• Van de Geer , J. P. 1987 . Algebra and geometry of OVERALS , Research Reports 87-13 1 – 47 . University of Leiden, Department of Data Theory . Retrieved from http://www.datatheory.nl/pdfs/87/87_13.pdf
   Google Scholar
• Yazici , A. C. , Öğüş , E. , Ankarali , H. and Gürbüz , F. 2010 . An application of nonlinear canonical correlation analysis on medical data. . Turkish Journal of Medical Science , 40 : 503 – 510 . doi: 10.3906/sag-0803-47
   Web of Science ®Google Scholar
• Zedeck , S. 2003 . Applied psychology: Editorial. . Journal of Applied Psychology , 88 : 3 – 5 . doi: 10.1037/0021-9010.88.1.3
   Web of Science ®Google Scholar