Understanding Meta-Analysis: A Review of the Methodological Literature

References

• Beal , D. J. , Corey , D. M. and Dunlap , W. P. 2002 . On the bias of Huffcutt and Arthur's (1995) procedure for identifying outliers in meta-analysis of correlations . Journal of Applied Psychology , 87 ( 3 ) : 583 – 589 .
   PubMed Web of Science ®Google Scholar
• Brown , S. A. , Upchurch , S. L. and Acton , G. J. 2003 . A framework for developing a coding scheme for meta-analysis . Western Journal of Nursing Research , 25 ( 2 ) : 205 – 222 .
   PubMed Web of Science ®Google Scholar
• Campbell , D. T. and Stanley , J. C. 1966 . Experimental and quasi-experimental designs for research , Chicago : Rand McNally .
   Google Scholar
• Chen , P. Y. and Popovich , P. M. 2002 . Correlation: Parametric and nonparametric measures , Thousand Oaks, CA : Sage .
   Google Scholar
• Cheung , S. F. and Chan , D. K. S. 2004 . Dependent effect sizes in meta-analysis: Incorporating the degree of interdependence . Journal of Applied Psychology , 89 ( 5 ) : 780 – 791 .
   PubMed Web of Science ®Google Scholar
• Cook , T. D. and Campbell , D. T. 1979 . Quasi-experimentation: Design & analysis issues for field settings , Boston, MA : Houghton Mifflin .
   Google Scholar
• Cooper , H. M. 1982 . Scientific guidelines for conducting integrative research reviews . Review of Educational Research , 52 ( 2 ) : 291 – 302 .
   Web of Science ®Google Scholar
• Cooper , H. M. 1984 . The integrative literature review: A systematic approach , Beverly Hills, CA : Sage .
   Google Scholar
• Cooper , H. and Hedges , L. V. , eds. 1994 . The handbook of research synthesis , New York, NY : Sage .
   Google Scholar
• Copas , J. and Shi , J. Q. 2000 . Meta-analysis, funnel plots and sensitivity analysis . Biostatistics , 1 ( 3 ) : 247 – 262 .
   PubMedGoogle Scholar
• Donnelly , M. P. , Vaske , J. J. , Whittaker , D. and Shelby , B. 2000 . Toward an understanding of norm prevalence: A comparative analysis of 20 years of research . Environmental Management , 25 ( 4 ) : 403 – 414 .
   PubMed Web of Science ®Google Scholar
• Duval , S. and Tweedie , R. 2000 . A nonparametric “trim and fill” method of accounting for publication bias in meta-analysis . Journal of the American Statistical Association , 95 ( 449 ) : 89 – 98 .
   Web of Science ®Google Scholar
• Givens , G. H. , Smith , D. D. and Tweedie , R. L. 1997 . Publication bias in meta-analysis: A Bayesian data-augmentation approach to account for issues exemplified in the passive smoking debate . Statistical Science , 12 ( 4 ) : 221 – 250 .
   Web of Science ®Google Scholar
• Glass , G. V. 1976 . Primary, secondary, and meta-analysis of research . Educational Researcher , 5 ( 10 ) : 3 – 8 .
   Google Scholar
• Glass , G. V. 1982 . Meta-analysis: An approach to the synthesis of research results . Journal of Research in Science Teaching , 19 ( 2 ) : 93 – 112 .
   Web of Science ®Google Scholar
• Glass , G. V. 2000 . http://glass.ed.asu.edu/gene/papers/meta25.html Meta-analysis at 25. Retrieved June 10, 2007, from
   Google Scholar
• Glass , G. V. , McGaw , B. and Smith , M. L. 1981 . Meta-analysis in social research , Beverly Hills, CA : Sage .
   Google Scholar
• Gleser , L. J. and Olkin , I. 1994 . “ Stochastically dependent effect sizes ” . In The handbook of research synthesis , Edited by: Cooper , H. and Hedges , L. V. 339 – 355 . New York : Sage .
   Google Scholar
• Gliner , J. A. , Morgan , G. A. and Harmon , R. J. 2003 . Meta-analysis: Formulation and interpretation . Journal of the American Academy of Child and Adolescent Psychiatry , 42 ( 11 ) : 1376 – 1379 .
   PubMed Web of Science ®Google Scholar
• Gliner , J. A. , Vaske , J. J. and Morgan , G. A. 2001 . Null hypothesis significance testing: Effect size matters . Human Dimensions of Wildlife , 6 ( 4 ) : 291 – 301 .
   Google Scholar
• Grissom , R. J. and Kim , J. J. 2005 . Effect sizes for research: A broad practical approach , Mahwah, NJ : Lawrence Erlbaum .
   Google Scholar
• Hall , J. A. and Rosenthal , R. 1995 . Interpreting and evaluating meta-analysis . Evaluation and the Health Professions , 18 ( 4 ) : 393 – 407 .
   PubMed Web of Science ®Google Scholar
• Hall , J. A. , Tickle-Degnen , L. , Rosenthal , R. and Mosteller , F. 1994 . “ Formulating a problem for a research synthesis ” . In The handbook of research synthesis , Edited by: Cooper , H. and Hedges , L. V. 17 – 28 . New York : Sage .
   Google Scholar
• Halvorsen , K. T. 1994 . “ The reporting format ” . In The handbook of research synthesis , Edited by: Cooper , H. and Hedges , L. V. 425 – 437 . New York : Sage .
   Google Scholar
• Hedges , L. V. 1982 . Issues in meta-analysis . Review of Research in Education , 13 : 353 – 398 .
   Google Scholar
• Hedges , L. V. 1992 . Modeling publication selection effects in meta-analysis . Statistical Science , 7 ( 2 ) : 246 – 256 .
   Google Scholar
• Hedges , L. V. 1994 . “ Statistical considerations ” . In The handbook of research synthesis , Edited by: Cooper , H. and Hedges , L. V. 29 – 38 . New York : Sage .
   Google Scholar
• Hedges , L. V. and Olkin , I. 1985 . Statistical methods for meta-analysis , Orlando, FL : Academic Press .
   Google Scholar
• Hedges , L. V. and Vevea , J. L. 1998 . Fixed- and random-effects models in meta-analysis . Psychological Methods , 3 ( 4 ) : 486 – 504 .
   Web of Science ®Google Scholar
• Huffcutt , A. I. and Arthur , W. 1995 . Development of a new outlier statistic for meta-analytic data . Journal of Applied Psychology , 80 ( 2 ) : 327 – 334 .
   Web of Science ®Google Scholar
• Hunter , J. E. and Schmidt , F. L. 1990 . Methods of meta-analysis: Correcting error and bias in research findings , Newbury Park, CA : Sage .
   Google Scholar
• Hunter , J. E. , Schmidt , F. L. and Jackson , G. B. 1982 . Meta-analysis: Cumulating research findings across studies , Beverly Hills, CA : Sage .
   Google Scholar
• Iyengar , S. and Greenhouse , J. B. 1988 . Selection models and the file drawer problem . Statistical Science , 3 ( 1 ) : 109 – 135 .
   Google Scholar
• Jackson , G. B. 1980 . Methods for integrative reviews . Review of Educational Research , 50 ( 3 ) : 438 – 460 .
   Web of Science ®Google Scholar
• Kalaian , H. A. and Raudenbush , S. W. 1996 . A multivariate mixed linear model for meta-analysis . Psychological Methods , 1 : 227 – 235 .
   Web of Science ®Google Scholar
• Kraemer , H. C. , Gardner , C. , Brooks , J. O. III and Yesavage , J. A. 1998 . Advantages of excluding underpowered studies in meta-analysis: Inclusionist versus exclusionist viewpoints . Psychological Methods , 3 : 23 – 31 .
   Web of Science ®Google Scholar
• Laven , D. N. , Manning , R. E. and Krymkowski , D. H. 2005 . The relationship between visitor-based standards of quality and existing conditions in parks and outdoor recreation . Leisure Sciences , 27 : 157 – 173 .
   Web of Science ®Google Scholar
• Light , R. J. and Pillemer , D. B. 1984 . Summing up: The science of reviewing research , Cambridge, MA : Harvard University Press .
   Google Scholar
• Light , R. J. , Singer , J. D. and Willett , J. B. 1994 . “ The visual presentation and interpretation of meta-analyses ” . In The handbook of research synthesis , Edited by: Cooper , H. and Hedges , L. V. 439 – 453 . New York : Sage .
   Google Scholar
• Lipsey , M. W. and Wilson , D. B. 2001 . Practical meta-analysis , Thousand Oaks, CA : Sage .
   Google Scholar
• Little , R. J. A. and Rubin , D. B. 2002 . Statistical analysis with missing data, , 2nd ed. , Hoboken, NJ : Wiley .
   Google Scholar
• Manfredo , M. J. , Driver , B. L. and Tarrant , M. A. 1996 . Measuring leisure motivation: A meta-analysis of the recreation experience preference scales . Journal of Leisure Research , 28 ( 3 ) : 188 – 213 .
   Web of Science ®Google Scholar
• Matt , G. E. and Cook , T. D. 1994 . “ Threats to the validity of research syntheses ” . In The handbook of research synthesis , Edited by: Cooper , H. and Hedges , L. V. 503 – 520 . New York : Sage .
   Google Scholar
• Murtaugh , P. A. 2002 . Journal quality, effect size, and publication bias in meta-analysis . Ecology , 84 ( 4 ) : 1162 – 1166 .
   Google Scholar
• Orwin , R. G. 1994 . “ Evaluating coding decisions ” . In The handbook of research synthesis , Edited by: Cooper , H. and Hedges , L. V. 140 – 155 . New York : Sage .
   Google Scholar
• Overton , R. C. 1998 . A comparison of fixed-effects and mixed (random-effects) models for meta-analysis tests of moderator variable effects . Psychological Methods , 3 : 354 – 379 .
   Web of Science ®Google Scholar
• Pearson , K. 1904 . Report on certain enteric fever inoculation statistics . The British Medical Journal , 3 : 1243 – 1246 .
   Google Scholar
• Pham , B. , Platt , R. , McAuley , L. , Klassen , T. P. and Moher , D. 2001 . Is there a “best” way to detect and minimize publication bias? . Evaluation and the Health Professions , 24 ( 2 ) : 109 – 125 .
   PubMed Web of Science ®Google Scholar
• Raudenbush , S. W. 1994 . “ Random effects models ” . In The handbook of research synthesis , Edited by: Cooper , H. and Hedges , L. V. 301 – 321 . New York : Sage .
   Google Scholar
• Robinson , D. H. and Levin , J. R. 1997 . Reflections on statistical and substantive significance, with a slice of replication . Educational Researcher , 26 : 21 – 26 .
   Google Scholar
• Rosenthal , R. 1979 . The “file drawer problem” and tolerance for null results . Psychological Bulletin , 86 : 638 – 641 .
   Web of Science ®Google Scholar
• Rosenthal , R. 1984 . Meta-analytic procedures for social research , Beverly Hills, CA : Sage .
   Google Scholar
• Rosenthal , R. 1995 . Writing meta-analytic reviews . Psychological Bulletin , 118 ( 2 ) : 183 – 192 .
   Web of Science ®Google Scholar
• Rosenthal , R. and DiMatteo , M. R. 2001 . Meta-analysis: Recent developments in quantitative methods for literature review . Annual Review of Psychology , 52 : 59 – 82 .
   PubMed Web of Science ®Google Scholar
• Rosenthal , R. , Rosnow , R. L. and Rubin , D. B. 2000 . Contrasts and effect sizes in behavioral research , Cambridge, UK : Cambridge University Press .
   Google Scholar
• Schafer , W. D. 1999 . Methods, plainly speaking: An overview of meta-analysis . Measurement and Evaluation in Counseling and Development , 32 : 43 – 61 .
   Web of Science ®Google Scholar
• Schmidt , F. L. and Hunter , J. E. 1977 . Development of a general solution to the problem of validity generalization . Journal of Applied Psychology , 62 : 529 – 540 .
   Web of Science ®Google Scholar
• Schmitt , N. 1996 . Statistical significance testing and cumulative knowledge in psychology: Implications for training of researchers . Psychological Methods , 1 : 114 – 129 .
   Web of Science ®Google Scholar
• Shadish , W. R. and Haddock , C. K. 1994 . “ Combining estimates of effect size ” . In The handbook of research synthesis , Edited by: Cooper , H. and Hedges , L. V. 261 – 282 . New York : Sage .
   Google Scholar
• Shelby , B. , Heberlein , T. A. , Vaske , J. J. and Alfano , G. 1983 . Expectations, preferences, and feeling crowded in recreational activities . Leisure Sciences , 6 ( 1 ) : 1 – 14 .
   Google Scholar
• Shelby , B. , Vaske , J. J. and Heberlein , T. A. 1989 . Comparative analysis of crowding in multiple locations: Results from fifteen years of research . Leisure Sciences , 11 : 269 – 291 .
   Google Scholar
• Shelby , L. B. and Vaske , J. J. 2007 . Perceived crowding among hunters and anglers: A meta-analysis . Human Dimensions of Wildlife , 12 ( 4 ) : 241 – 261 .
   Google Scholar
• Snedecor , G. W. 1946 . Statistical methods, , 4th ed. , Ames, IA : Iowa State College Press .
   Google Scholar
• Stock , W. A. , Benito , J. G. and Lasa , N. B. 1996 . Research synthesis: Coding and conjectures . Evaluation and the Health Professions , 19 : 104 – 117 .
   PubMed Web of Science ®Google Scholar
• Sutton , A. J. , Song , F. , Gilbody , S. M. and Abrams , K. R. 2000 . Modeling publication bias in meta-analysis: A review . Statistical Methods in Medical Research , 9 : 421 – 455 .
   PubMed Web of Science ®Google Scholar
• Tippett , L. H. C. 1931 . The methods of statistics , London : Williams & Norgate .
   Google Scholar
• Vaske , J. J. and Donnelly , M. P. 2002 . Generalizing the encounter-norm-crowding relationship . Leisure Sciences , 24 : 255 – 269 .
   Web of Science ®Google Scholar
• Vaske , J. J. , Donnelly , M. P. , Heberlein , T. A. and Shelby , B. 1982 . Differences in reported satisfaction ratings by consumptive and nonconsujmptive recreationists . Journal of Leisure Research , 14 : 195 – 206 .
   Web of Science ®Google Scholar
• Vaske , J. J. , Gliner , J. A. and Morgan , G. A. 2002 . Communicating judgments about practical significance: Effect size, confidence intervals and odds ratios . Human Dimensions of Wildlife , 7 ( 4 ) : 287 – 300 .
   Google Scholar
• Vaske , J. J. , Shelby , L. B. and Manfredo , M. 2006 . Bibliometric reflections on the first decade of Human Dimensions of Wildlife . Human Dimensions of Wildlife , 11 ( 2 ) : 79 – 87 .
   Google Scholar
• Yeaton , W. H. and Wortman , P. M. 1993 . On the reliability of meta-analytic reviews: The role of intercoder agreement . Evaluation Review , 17 ( 3 ) : 292 – 309 .
   Web of Science ®Google Scholar