Advanced search
Publication Cover
Multivariate Behavioral Research Volume 46, 2011 - Issue 1
Submit an article Journal homepage
6,453
Views
326
CrossRef citations to date
0
Altmetric
Original Articles

A Systematic Review of Propensity Score Methods in the Social Sciences

Felix J. Thoemmes University of Tübingen
&
Eun Sook Kim Texas A&M University
Pages 90-118 | Published online: 18 Feb 2011

REFERENCES

  • Abadie , A. and Imbens , G. W. 2008 . On the failure of the bootstrap for matching estimators . Econometrica , 76 : 1537 – 1557 . doi:10.3982/ecta6474
  • Austin , P. 2007 . Propensity-score matching in the cardiovascular surgery literature from 2004 to 2006: A systematic review and suggestions for improvement . The Journal of Thoracic and Cardiovascular Surgery , 134 : 1128 – 1135 .
  • Austin , P. 2008a . A critical appraisal of propensity-score matching in the medical literature between 1996 and 2003 . Statistics in Medicine , 27 : 2037 – 2049 .
  • Austin , P. 2008b . Primer on statistical interpretation or methods report card on propensity-score matching in the cardiology literature from 2004 to 2006: A systematic review . Circulation-Cardiovascular Quality and Outcomes , 1 : 62 – 67 .
  • Austin , P. 2009a . Balance diagnostics for comparing the distribution of baseline covariates between treatment groups in propensity-score matched samples . Statistics in Medicine , 28 : 3083 – 3107 .
  • Austin , P. 2009b . Type I error rates, coverage of confidence intervals, and variance estimation in propensity-score matched analyses . The International Journal of Biostatistics , 5 : 13 – 38 .
  • Caliendo , M. and Kopeinig , S. 2008 . Some practical guidance for the implementation of propensity score matching . Journal of Economic Surveys , 22 : 31 – 72 .
  • Cochran , W. G. 1968 . The effectiveness of adjustment by subclassification in removing bias in observational studies . Biometrics , 24 : 295 – 313 .
  • Cohen , J. 1988 . Statistical power analysis for the behavioral sciences Hillsdale, NJ : Erlbaum. .
  • Cook , T. D. and Steiner , P. 2010 . Case matching and the reduction of selection bias in quasi-experiments: The relative importance of pretest measures of outcome, of unreliable measurement, and of mode of data analysis . Psychological Methods , 15 : 56 – 86 . doi:10.1037/a0018536
  • Cook , T. D. , Steiner , P. and Pohl , S. 2009 . How bias reduction is affected by covariate choice, unreliability, and mode of data analysis: results from two types of within-study comparisons . Multivariate Behavioral Research , 44 : 828 – 847 . doi:10.1080/00273170903333673
  • Diamond , A. and Sekhon , J. 2005 . Genetic matching for estimating causal effects: A new method of achieving balance in observational studies Retrieved from http://jsekhon.fas.harvard.edu/
  • Gu , X. and Rosenbaum , P. R. 1993 . Comparison of multivariate matching methods: Structures, distances, and algorithms . Journal of Computational and Graphical Statistics , 2 : 405 – 420 .
  • Hansen , B. B. 2004 . Full matching in an observational study of coaching for the SAT . Journal of the American Statistical Association , 99 : 609 – 619 .
  • Hansen , B. 2008 . The essential role of balance tests in propensity-matched observational studies: Comments on ‘A critical appraisal of propensity-score matching in the medical literature between 1996 and 2003’ by Peter Austin . Statistics in Medicine , 27 : 2050 – 2054 .
  • Haviland , A. , Nagin , D. and Rosenbaum , P. R. 2007 . Combining propensity score matching and group-based trajectory analysis in an observational study . Psychological Methods , 12 : 247 – 267 .
  • Hayes , A. F. and Krippendorff , K. 2007 . Answering the call for a standard reliability measure for coding data . Communication Methods and Measures , 1 : 77 – 89 .
  • Heckman , J. J. , Ichimura , H. and Todd , P. E. 1997 . Matching as an econometric evaluation estimator: Evidence from evaluating a job training programme . The Review of Economic Studies , 64 : 605 – 654 .
  • Heckman , J. , Ichimura , H. and Todd , P. 1998 . Matching as an econometric evaluation estimator . The Review of Economic Studies , 65 : 261 – 294 .
  • Helmreich , J. and Pruzek , R. M. 2009 . PSAgraphics: An R package to support propensity score analysis . Journal of Statistical Software , 29 Retrieved from http://www.jstatsoft.org/v29/i06/paper
  • Hill , J. 2008 . Discussion of research using propensity-score matching: Comments on ‘A critical appraisal of propensity-score matching in the medical literature between 1996 and 2003’ by Peter Austin . Statistics in Medicine , 27 : 2055 – 2061 .
  • Hirano , K. and Imbens , G. 2001 . Estimation of causal effects using propensity score weighting: An application to data on right heart catheterization . Health Services and Outcomes Research Methodology , 2 : 259 – 278 .
  • Hirano , K. , Imbens , G. W. and Ridder , G. 2003 . Efficient estimation of average treatment effects using the estimated propensity score . Econometrica , 71 : 1161 – 1189 .
  • Ho , D. E. , Imai , K. , King , G. and Stuart , E. A. 2007 . Matching as nonparametric preprocessing for reducing model dependence in parametric causal inference . Political Analysis , 15 : 199 – 236 . doi:10.1093/pan/mpl013
  • Hong , G. and Raudenbush , S. 2005 . Effects of kindergarten retention policy on children's cognitive growth in reading and mathematics . Educational Evaluation and Policy Analysis , 27 : 205 – 224 .
  • Hughes , J. , Chen , Q. , Thoemmes , F. and Kwok , O. 2010 . Effect of retention in first grade on performance on high stakes test in 3rd grade . Educational Evaluation and Policy Analysis , 32 : 166 – 182 .
  • Hullsiek , K. and Louis , T. 2002 . Propensity score modeling strategies for the causal analysis of observational data . Biostatistics , 3 : 179 – 193 .
  • Imai , K. , King , G. and Stuart , E. 2008 . Misunderstandings among experimentalists and observationalists about causal inference . Journal of the Royal Statistical Society, Series A , 171 : 481 – 502 .
  • Kang , J. and Schafer , J. 2007 . Demystifying double robustness: a comparison of alternative strategies for estimating a population mean from incomplete data . Statistical Science , 22 : 523 – 539 .
  • King , G. and Zeng , L. 2007 . When can history be our guide? The pitfalls of counterfactual inference . International Studies Quarterly , 51 : 183 – 210 .
  • Krippendorff , K. 2004 . Reliability in content analysis . Human Communication Research , 30 : 411 – 433 .
  • Lunceford , J. and Davidian , M. 2004 . Stratification and weighting via the propensity score in estimation of causal treatment effects: A comparative study . Statistics in Medicine , 23 : 2937 – 2960 .
  • McCaffrey , D. , Ridgeway , G. and Morral , A. 2004 . Propensity score estimation with boosted regression for evaluating causal effects in observational studies . Psychological Methods , 9 : 403 – 425 .
  • Ming , K. and Rosenbaum , P. R. 2000 . Substantial gains in bias reduction from matching with a variable number of controls . Biometrics , 56 : 118 – 124 .
  • Ming , K. and Rosenbaum , P. R. 2001 . A note on optimal matching with variable controls using the assignment algorithm . Journal of Computational & Graphical Statistics , 10 : 455 – 463 .
  • Myers , J. A. and Louis , T. A. 2007 . Optimal propensity score stratification Johns Hopkins University, Department of Biostatistics. . Working Papers (Working Paper No. 155). Retrieved from http://www.bepress.com/jhubiostat/paper155
  • Robins , J. , Rotnitzky , A. and Scharfstein , D. 1999 . “ Sensitivity analysis for selection bias and unmeasured confounding in missing data and causal inference models. ” . In Statistical models in epidemiology: The environment and clinical trials Edited by: Halloran , M. R. and Berry , D. 1 – 92 . New York, NY : Springer. .
  • Rosenbaum , P. R. 1989 . Optimal matching for observational studies . Journal of the American Statistical Association , 84 : 1024 – 1032 .
  • Rosenbaum , P. R. 1991a . Sensitivity analysis for matched case-control studies . Biometrics , 47 : 87 – 100 .
  • Rosenbaum , P. R. 1991b . Discussing hidden bias in observational studies . Annals of Internal Medicine , 115 : 901 – 905 .
  • Rosenbaum , P. R. 1991c . A characterization of optimal designs for observational studies . Journal of the Royal Statistical Society, Series B (Methodological) , 53 : 597 – 610 .
  • Rosenbaum , P. R. 2010 . Design of observational studies New York, NY : Springer. .
  • Rosenbaum , P. R. and Rubin , D. B. 1983 . The central role of the propensity score in observational studies for causal effects . Biometrika , 70 : 41 – 55 .
  • Rosenbaum , P. and Rubin , D. B. 1984 . Reducing bias in observational studies using subclassification on the propensity score . Journal of the American Statistical Association , 79 : 516 – 524 .
  • Rosenbaum , P. and Rubin , D. B. 1985 . Constructing a control group using multivariate matched sampling methods that incorporate the propensity score . American Statistician , 39 : 33 – 38 .
  • Rubin , D. 2005 . Causal inference using potential outcomes . Journal of the American Statistical Association , 100 : 322 – 331 .
  • Rubin , D. B. and Thomas , N. 1992 . Characterizing the effect of matching using linear propensity score methods with normal distributions . Biometrika , 79 : 797 – 809 .
  • Rubin , D. B. and Thomas , N. 1996 . Matching using estimated propensity scores: Relating theory to practice . Biometrics , 52 : 249 – 264 .
  • Rubin , D. B. and Waterman , R. P. 2006 . Estimating the casual effects of marketing interventions using propensity score methodology . Statistical Science , 21 : 206 – 222 .
  • Schafer , J. L. and Kang , J. 2008 . Average causal effects from nonrandomized studies: A practical guide and simulated example . Psychological Methods , 13 : 279 – 313 .
  • Shadish , W. , Luellen , J. and Clark , M. 2006 . “ Propensity scores and quasi-experiments: A testimony to the practical side of Lee Sechrest. ” . In Strengthening research methodology: Psychological measurement and evaluation Edited by: Bootzin , R. R. and McKnight , P. E. 143 – 157 . Washington, DC : American Psychological Association. .
  • Shadish , W. and Steiner , P. 2010 . A primer on propensity score analysis . Newborn and Infant Nursing Reviews , 10 : 19 – 26 .
  • Stuart , E. 2008 . Developing practical recommendations for the use of propensity scores: Discussion of ‘A critical appraisal of propensity score matching in the medical literature between 1996 and 2003’ by Peter Austin . Statistics in Medicine , 27 : 2062 – 2065 .
  • Stuart , E. 2010 . Matching methods for causal inference: A review and a look forward . Statistical Science , 25 : 1 – 21 .
  • Stuart , E. , Marcus , S. , Horvitz-Lennon , M. , Gibbons , R. , Normand , S. and Brown , H. 2009 . Using non-experimental data to estimate treatment effects . Psychiatric Annals , 39 : 719 – 728 .
  • Tukey , J. W. 1977 . Exploratory data analysis Reading, MA : Addison-Wesley. .
  • Weitzen , S. , Lapane , K. , Toledano , A. , Hume , A. and Mor , V. 2004 . Principles for modeling propensity scores in medical research: A systematic literature review . Pharmacoepidemiology and Drug Safety , 13 : 841 – 853 .
  • Wu , W. , West , S. and Hughes , J. 2008 . Short-term effects of grade retention on the growth rate of Woodcock-Johnson III broad math and reading scores . Journal of School Psychology , 46 : 85 – 105 .
  • Yoon , F. 2009 . Entire matching and its application in an observational study of treatments for melanoma Unpublished manuscript.

APPENDIX: References Used in the Systematic Literature Review

  • Amato , P. R. 2003 . Reconciling divergent perspectives: Judith Wallerstein, quantitative family research, and children of divorce . Family Relations , 52 : 332 – 339 .
  • Anand , P. , Mizala , A. and Repetto , A. 2009 . Using school scholarships to estimate the effect of private education on the academic achievement of low-income students in Chile . Economics of Education Review , 28 : 370 – 381 .
  • Aassve , A. , Davia , M. A. , Iacovou , M. and Mazzuco , S. 2007 . Does leaving home make you poor? Evidence from 13 European countries . European Journal of Population-Revue Europeenne De Demographie , 23 : 315 – 338 . doi:10.1007/s10680–007–9135–5
  • Attewell , P. and Domina , T. 2008 . Raising the bar: Curricular intensity and academic performance . Educational Evaluation and Policy Analysis , 30 : 51 – 71 . doi:10.3102/0162373707313409
  • Attewell , P. , Lavin , D. , Domina , T. and Levey , T. 2006 . New evidence on college remediation . Journal of Higher Education , 77 : 886 – 924 .
  • Barth , R. P. , Guo , S. and McCrae , J. S. 2008 . Propensity score matching strategies for evaluating the success of child and family service programs . Research on Social Work Practice , 18 : 212 – 222 . doi:10.1177/1049731507307791
  • Barth , R. P. , Lee , C. K. , Wildfire , J. and Guo , S. Y. 2006 . A comparison of the governmental costs of long-term foster care and adoption . Social Service Review , 80 : 127 – 158 .
  • Bellamy , J. L. 2008 . Behavioral problems following reunification of children in long-term foster care . Children and Youth Services Review , 30 : 216 – 228 . doi:10.1016/j.childyouth.2007.09.008
  • Bennett , P. R. and Lutz , A. 2009 . How African American is the net Black advantage? Differences in college attendance among immigrant Blacks, native Blacks, and Whites . Sociology of Education , 82 : 70 – 99 .
  • Berger , L. , Brooks-Gunn , J. , Paxson , C. and Waldfoge , J. 2008 . First-year maternal employment and child outcomes: Differences across racial and ethnic groups . Children and Youth Services Review , 30 : 365 – 387 . doi:10.1016/j.childyouth.2007.10.010
  • Brand , J. E. and Halaby , C. N. 2006 . Regression and matching estimates of the effects of elite college attendance on educational and career achievement . Social Science Research , 35 : 749 – 770 . doi:10.1016/j.ssresearch.2005.06.006
  • Caldwell , M. F. , Vitacco , M. and Van Rybroek , G. J. 2006 . Are violent delinquents worth treating? A cost-benefit analysis . Journal of Research in Crime and Delinquency , 43 : 148 – 168 . doi:10.1177/0022427805280053
  • Callahan , R. , Wilkinson , L. and Muller , C. 2008 . School context and the effect of ESL placement on Mexican-origin adolescents' achievement . Social Science Quarterly , 89 : 177 – 198 .
  • Callahan , R. , Wilkinson , L. , Muller , C. and Frisco , M. 2009 . ESL placement and schools: Effects on immigrant achievement . Educational Policy , 23 : 355 – 384 . doi:10.1177/0895904807310034
  • Camp , S. D. , Daggett , D. M. , Kwon , O. and Klein-Saffran , J. 2008 . The effect of faith program participation on prison misconduct: The Life Connections Program . Journal of Criminal Justice , 36 : 389 – 395 . doi:10.1016/j.jcrimjus.2008.07.004
  • Casanueva , C. , Martin , S. L. , Runyan , D. K. , Barth , R. P. and Bradley , R. H. 2008 . Parenting services for mothers involved with child protective services: Do they change maternal parenting and spanking behaviors with young children? . Children and Youth Services Review , 30 : 861 – 878 . doi:10.1016/j.childyouth.2007.12.013
  • Condron , D. J. 2008 . An early start: Skill grouping and unequal reading gains in the elementary years . Sociological Quarterly , 49 : 363 – 394 .
  • Correnti , R. 2007 . An empirical investigation of professional development effects on literacy instruction using daily logs . Educational Evaluation and Policy Analysis , 29 : 262 – 295 . doi:10.3102/0162373707309074
  • Crosnoe , R. 2005 . Double disadvantage or signs of resilience? The elementary school contexts of children from Mexican immigrant families . American Educational Research Journal , 42 : 269 – 303 .
  • Crosnoe , R. 2009 . Family-school connections and the transitions of low-income youths and English language learners from middle school to high school . Developmental Psychology , 45 : 1061 – 1076 . doi:10.1037/a0016131
  • Dahl , E. and Lorentzen , T. 2005 . What works for whom? An analysis of active labour market programmes in Norway . International Journal of Social Welfare , 14 : 86 – 98 .
  • Delander , L. , Hammarstedt , M. , Mansson , J. and Nyberg , E. 2005 . Integration of immigrants: The role of language proficiency and experience . Evaluation Review , 29 : 24 – 41 .
  • Delisi , M. , Barnes , J. C. , Beaver , K. M. and Gibson , C. L. 2009 . Delinquent gangs and adolescent victimization revisited: A propensity score matching approach . Criminal Justice and Behavior , 36 : 808 – 823 . doi:10.1177/0093854809337703
  • DeSena , A. D. , Murphy , R. A. , Douglas-Palumberi , H. , Blau , G. , Kelly , B. , Horwitz , S. M. and Kaufman , J. 2005 . Safe homes: Is it worth the cost? . Child Abuse and Neglect: The International Journal , 29 : 627 – 643 .
  • Diaz , J. J. and Handa , S. 2006 . An assessment of propensity score matching as a nonexperimental impact estimator: Evidence from Mexico's PROGRESA program . Journal of Human Resources , 41 : 319 – 345 .
  • Dill , J. S. 2009 . Preparing for public life: School sector and the educational context of lasting citizen formation . Social Forces , 87 : 1265 – 1290 .
  • Domina , T. 2009 . What works in college outreach: Assessing targeted and schoolwide interventions for disadvantaged students . Educational Evaluation and Policy Analysis , 31 : 127 – 152 . doi:10.3102/0162373709333887
  • Doyle , W. R. 2009 . The effect of community college enrollment on bachelor's degree completion . Economics of Education Review , 28 : 199 – 206 . doi:10.1016/j.econedurev.2008.01.006
  • Foster , E. M. , Stephens , R. , Krivelyova , A. and Gamfi , P. 2007 . Can system integration improve mental health outcomes for children and youth? . Children and Youth Services Review , 29 : 1301 – 1319 . doi:10.1016/j.childyouth.2007.05.004
  • Frank , K. A. , Sykes , G. , Anagnostopoulos , D. , Cannata , M. , Chard , L. , Krause , A. and McCrory , R. 2008 . Does NBPTS certification affect the number of colleagues a teacher helps with instructional matters? . Educational Evaluation and Policy Analysis , 30 : 3 – 30 . doi:10.3102/0162373707313781
  • Frisco , M. L. , Muller , C. and Frank , K. 2007 . Parents' union dissolution and adolescents' school performance: Comparing methodological approaches . Journal of Marriage and the Family , 69 : 721 – 741 .
  • Furstenberg , F. F. Jr. and Neumark , D. 2007 . Encouraging education in an urban school district: Evidence from the Philadelphia educational longitudinal study . Education Economics , 15 ( 2 ) : 135 – 157 .
  • Gangl , M. 2006 . Scar effects of unemployment: An assessment of institutional complementarities . American Sociological Review , 71 : 986 – 1013 .
  • Gibson-Davis , C. M. and Foster , E. M. 2006 . A cautionary tale: Using propensity scores to estimate the effect of food stamps on food insecurity . Social Service Review , 80 : 93 – 126 .
  • Green , K. M. and Ensminger , M. E. 2006 . Adult social behavioral effects of heavy adolescent marijuana use among African Americans . Developmental Psychology , 42 : 1168 – 1178 .
  • Grunwald , H. E. and Mayhew , M. J. 2008 . Using propensity scores for estimating causal effects: A study in the development of moral reasoning . Research in Higher Education , 49 : 758 – 775 .
  • Hahs-Vaughn , D. L. and Onwuegbuzie , A. J. 2006 . Estimating and using propensity score analysis with complex samples . Journal of Experimental Education , 75 : 31 – 65 .
  • Harding , D. J. 2003 . Counterfactual models of neighborhood effects: The effect of neighborhood poverty on dropping out and teenage pregnancy . American Journal of Sociology , 109 : 676 – 719 .
  • Henry , G. T. , Gordon , C. S. and Rickman , D. K. 2006 . Early education policy alternatives: Comparing quality and outcomes of head start and state prekindergarten . Educational Evaluation and Policy Analysis , 28 : 77 – 99 .
  • Hickes-Lundquist , J. and Smith , H. L. 2005 . Family formation among women in the U.S. military: Evidence from the NLSY . Journal of Marriage and Family , 67 : 1 – 13 .
  • Hill , J. L. , Waldfogel , J. , Brooks-Gunn , J. and Han , W.-J. 2005 . Maternal employment and child development: A fresh look using newer methods . Developmental Psychology , 41 : 833 – 850 .
  • Hong , G. L. and Hong , Y. H. 2009 . Reading instruction time and homogeneous grouping in kindergarten: An application of marginal mean weighting through stratification . Educational Evaluation and Policy Analysis , 31 : 54 – 81 . doi:10.31020162373708328259
  • Hong , G. L. and Raudenbush , S. W. 2005 . Effects of kindergarten retention policy on children's cognitive growth in reading and mathematics . Educational Evaluation and Policy Analysis , 27 : 205 – 224 .
  • Hong , G. and Yu , B. 2007 . Early-grade retention and children's reading and math learning in elementary years . Educational Evaluation and Policy Analysis , 29 : 239 – 261 . doi:10.3102/0162373707309073
  • Hong , G. and Yu , B. 2008 . Effects of kindergarten retention on children's social-emotional development: An application of propensity score method to multivariate, multilevel data . Developmental Psychology , 44 : 407 – 421 .
  • Jennings , J. L. and Beveridge , A. A. 2009 . How does test exemption affect schools' and students' academic performance? . Educational Evaluation and Policy Analysis , 31 : 153 – 175 . doi:10.3102/0162373708328468
  • Jones , A. S. , D'Agostino , J. R. R.B. , Gondolf , E. W. and Heckert , A. 2004 . Assessing the effect of batterer program completion on reassault using propensity scores . Journal of Interpersonal Violence , 19 : 1002 – 1020 .
  • Koh , E. and Testa , M. F. 2008 . Propensity score matching of children in kinship and nonkinship foster care: Do permanency outcomes still differ? . Social Work Research , 32 : 105 – 116 .
  • Kohls , N. and Walach , H. 2008 . Validating four standard scales in spiritually practicing and nonpracticing samples using propensity score matching . European Journal of Psychological Assessment , 24 : 165 – 173 . doi:10.1027/1015–5759.24.3.165
  • Lee , B. R. and Thompson , R. 2008 . Comparing outcomes for youth in treatment foster care and family-style group care . Children and Youth Services Review , 30 : 746 – 757 . doi:10.1016/j.childyouth.2007.12.002
  • Lee , J. C. 2007 . When work matters: The varying impact of work intensity on high school dropout . Sociology of Education , 80 : 158 – 178 .
  • Lei , X. Y. and Lin , W. C. 2009 . The new cooperative medical scheme in rural China: Does more coverage mean more service and better health? . Health Economics , 18 : S25 – S46 . doi:10.1002/hec.1501
  • Leitch , M. L. , Vanslyke , J. and Allen , M. 2009 . Somatic experiencing treatment with social service workers following hurricanes Katrina and Rita . Social Work , 54 : 9 – 18 .
  • Leow , C. , Marcus , S. , Zanutto , E. and Boruch , R. 2004 . Effects of advanced course-taking on math and science achievement: Addressing selection bias using propensity scores . American Journal of Evaluation , 25 : 461 – 478 .
  • Lincove , J. A. and Painter , G. 2006 . Does the age that children start kindergarten matter? Evidence of long-term educational and social outcomes . Educational Evaluation and Policy Analysis , 28 : 153 – 179 .
  • Long , B. T. and Kurlaender , M. 2009 . Do community colleges provide a viable pathway to a baccalaureate degree? . Educational Evaluation and Policy Analysis , 31 : 30 – 53 . doi:10.3102/0162373708327756
  • Lorentzen , T. and Dahl , E. 2005 . Active labour market programmes in Norway: Are they helpful for social assistance recipients? . Journal of European Social Policy , 15 : 27 – 45 . doi:10.11770958928705049161
  • Lundquist , J. H. 2004 . When race makes no difference: Marriage and the military . Social Forces , 83 : 731 – 757 .
  • Luo , Z. , Jose , P. E. , Huntsinger , C. S. and Pigott , T. D. 2007 . Fine motor skills and mathematics achievement in East Asian American and European American kindergartners and first graders . British Journal of Developmental Psychology , 25 : 595 – 614 . doi:10.1348/026151007x185329
  • McCoy , S. and Smyth , E. 2007 . So much to do, so little time: Part-time employment among secondary students in Ireland . Work Employment and Society , 21 : 227 – 246 . doi:10.1177/0950017007076630
  • Meier , A. M. 2007 . Adolescent first sex and subsequent mental health . American Journal of Sociology , 112 : 1811 – 1847 .
  • Paternoster , R. and Brame , R. 2008 . Reassessing race disparities in Maryland capital cases . Criminology , 46 : 971 – 1008 . doi:10.1111/j.1745–9125.2008.00132.x
  • Ronsen , M. and Skardhamar , T. 2009 . Do welfare-to-work initiatives work? Evidence from an activation programme targeted at social assistance recipients in Norway . Journal of European Social Policy , 19 : 61 – 77 . doi:10.1177/0958928708098524
  • Ryan , J. P. , Herz , D. , Hernandez , P. M. and Marshall , J. M. 2007 . Maltreatment and delinquency: Investigating child welfare bias in juvenile justice processing . Children and Youth Services Review , 29 : 1035 – 1050 . doi:10.1016/j.childyouth.2007.04.002
  • Ryan , J. P. , Marshall , J. M. , Herz , D. and Hernandez , P. A. 2008 . Juvenile delinquency in child welfare: Investigating group home effects . Children and Youth Services Review , 30 : 1088 – 1099 . doi: 10.1016/j.childyouth.2008.02.004
  • Sigle-Rushton , W. 2005 . Young fatherhood and subsequent disadvantage in the United Kingdom . Journal of Marriage and the Family , 67 : 735 – 753 .
  • Smith , R. A. , Downs , E. and Witte , K. 2007 . Drama theory and entertainment education: Exploring the effects of a radio drama on behavioral intentions to limit HIV transmission in Ethiopia . Communication Monographs , 74 : 133 – 153 . doi:10.1080/03637750701393048
  • Smyth , E. 2008 . The more, the better? Intensity of involvement in private tuition and examination performance . Educational Research and Evaluation , 14 : 465 – 476 .
  • Stephan , J. L. , Rosenbaum , J. E. and Person , A. E. 2009 . Stratification in college entry and completion . Social Science Research , 38 : 572 – 593 . doi:10.1016/j.ssresearch.2009.02.001
  • Stuart , E. A. and Green , K. M. 2008 . Using full matching to estimate causal effects in nonexperimental studies: Examining the relationship between adolescent marijuana use and adult outcomes . Developmental Psychology , 44 : 395 – 406 .
  • Swanson , J. W. , Swartz , M. S. , Elbogen , E. B. , VanDorn , R. A. , Wagner , H. R. , Moser , L. A. and Gilbert , A. R. 2008 . Psychiatric advance directives and reduction of coercive crisis interventions . Journal of Mental Health , 17 : 255 – 267 . doi:10.1080/09638230802052195
  • Sweeten , G. and Apel , R. 2007 . Incapacitation: Revisiting an old question with a new method and new data . Journal of Quantitative Criminology , 23 : 303 – 326 . doi:10.1007/s10940–007–9032–4
  • Tita , G. and Ridgeway , G. 2007 . The impact of gang formation on local patterns of crime . Journal of Research in Crime and Delinquency , 44 : 208 – 237 . doi:10.1177/0022427806298356
  • Titus , M. A. 2007 . Detecting selection bias, using propensity score matching, and estimating treatment effects: An application to the private returns to a master's degree . Research in Higher Education , 48 : 487 – 521 . doi:10.1007/s11162–006–9034–3
  • Urquieta-Salomon , J. E. , Tepichin-Valle , A. M. and Tellez-Rojo , M. M. 2009 . Poverty and gender perspective in productive projects for rural women in Mexico: Impact evaluation of a pilot project . Evaluation Review , 33 : 27 – 53 .
  • Verhoeven , W. J. , Flap , H. , Dessens , J. and Jansen , W. 2008 . Income advantages of Communist Party members before and during the transformation process . European Societies , 10 : 379 – 402 . doi:10.1080/14616690701744406
  • Wang , H. , Yip , W. , Zhang , L. C. and Hsiao , W. C. 2009 . The impact of rural mutual health care on health status: Evaluation of a social experiment in rural China . Health Economics , 18 : S65 – S82 . doi:10.1002/hec.1465
  • Weatherburn , D. and Bartels , L. 2008 . The recidivism of offenders given suspended sentences in New South Wales, Australia . British Journal of Criminology , 48 : 665 – 681 . doi:10.1093/bjc/azn049
  • Weigensberg , E. C. , Barth , R. P. and Guo , S. 2009 . Family group decision making: A propensity score analysis to evaluate child and family services at baseline and after 36 months . Children and Youth Services Review , 31 : 383 – 390 . doi:10.1016/j.childyouth.2008.09.001
  • Wolf , E. M. and Wolf , D. A. 2008 . Mixed results in a transitional planning program for alternative school students . Evaluation Review , 32 : 187 – 215 .
  • Worcel , S. D. , Furrer , C. J. , Green , B. L. , Burrus , S. W. M. and Finigan , M. W. 2008 . Effects of family treatment drug courts on substance abuse and child welfare outcomes . Child Abuse Review , 17 : 427 – 443 .
  • Wright , R. , John , L. , Ellenbogen , S. , Offord , D. R. , Duku , E. K. and Rowe , W. 2006 . Effect of a structured arts program on the psychosocial functioning of youth from low-income communities: Findings from a Canadian longitudinal study . Journal of Early Adolescence , 26 : 186 – 205 .
  • Wu , W. , West , S. G. and Hughes , J. N. 2008 . Effect of retention in first grade on children's achievement trajectories over 4 years: A piecewise growth analysis using propensity score matching . Journal of Educational Psychology , 100 : 727 – 740 . doi: 10.1037/a0013098
  • Wyse , A. E. , Keesler , V. and Schneider , B. 2008 . Assessing the effects of small school size on mathematics achievement: A propensity score-matching approach . Teachers College Record , 110 : 1879 – 1900 .
  • Yanovitzky , I. , Zanutto , E. and Hornik , R. 2005 . Estimating causal effects of public health education campaigns using propensity score methodology . Evaluation and Program Planning , 28 : 209 – 220 . doi:10.1016/j.evalprogplan.2005.01.004

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Order Reprints Request Corporate Permissions

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

Request Academic Permissions

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.

Related research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.