972
Views
36
CrossRef citations to date
0
Altmetric
Original Articles

Meta‐Analysis in Criminal Justice and Criminology: What It is, When It's Useful, and What to Watch Out for

Pages 152-168 | Published online: 06 Apr 2010
 

Abstract

Meta‐analyses are becoming more common in the criminal justice and criminological literature. While much of the published work related to the technique is focused on the more technical aspects of the statistical methods that have been developed for meta‐analysis, less common are broader—and perhaps more critical—discussions concerning various issues associated with the method. Accordingly, this article presents an overview of meta‐analysis in the context of what have become three of the more important issues within the meta‐analysis literature in recent years: (1) the conditions under which meta‐analyses are, and are not, most useful, (2) the dilemma of whether or not to include unpublished work in the sample of studies to be analyzed, and (3) the choice of bivariate versus multivariate effect size estimates to be synthesized. The objective is to take these issues out of what has arguably been debates about technical orthodoxy and instead to place them into a broader research context within criminal justice and criminology.

Notes

1. The mean treatment effect size estimates for the Whitehead and Lab (Citation1989) and Andrews et al. (Citation1990) studies were similar—both revealed a treatment effect of approximately .20. Their disagreement centered primarily around the substantive interpretation of a treatment effect of that size (i.e., whether a 20% reduction in recidivism is “good enough”).

2. Others in this tradition have used similar bivariate effect size estimates such as the Cohen's d, which is the difference between two group means divided by the pooled within‐group standard deviation (Cohen Citation1977; see also Loeber and Stouthamer‐Loeber Citation1986). Still other researchers have used the RIOC statistic (relative improvement over chance), which scales down certain descriptive statistics into a 2 × 2 table of whether or not a predictor variable is present and whether or not an individual engaged in delinquency (Loeber and Dishion Citation1983). Both of these statistics, however, assume, at minimum, a quasi‐experimental research design, and are therefore not applicable to synthesizing correlational research based on statistical control.

3. Hedges and Olkin's critique of using multivariate effect sizes in meta‐analysis was certainly valid when it was raised over two decades ago. Since then, however, advances in both quantitative methods and computer software (in particular, Hierarchical Linear Modeling methods and software) have resulted in new approaches for handling this potential problem in methodologically defensible ways, including the approach taken here.

4. The Level 1 effect size variances are computed using the formula for estimating the standard error of the Fisher r‐to‐z transformation (see, e.g., Hox Citation1995; Lipsey and Wilson Citation2001):

The full model is estimated with the equation:

Log in via your institution

Log in to Taylor & Francis Online

PDF download + Online access

  • 48 hours access to article PDF & online version
  • Article PDF can be downloaded
  • Article PDF can be printed
USD 53.00 Add to cart

Issue Purchase

  • 30 days online access to complete issue
  • Article PDFs can be downloaded
  • Article PDFs can be printed
USD 348.00 Add to cart

* Local tax will be added as applicable

Related Research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.