The Implications of Teacher Selection and the Teacher Effect in Individually Randomized Group Treatment Trials

REFERENCES

• Abdulkadiroglu , A. , Angrist , J. , Dynarski , S. , Kane , T. J. and Pathak , P. 2009 . Accountability and flexibility in public schools: Evidence from Boston's charters and pilots , (NBER Working Paper No. 15549) Cambridge, MA : National Bureau of Economic Research .
   Google Scholar
• Bauer , D. J. , Sterba , S. K. and Hallfors , D. D. 2008 . Evaluating group-based interventions when control participants are ungrouped . Multivariate Behavioral Research , 43 : 210 – 236 .
   Google Scholar
• Bernstein , L. , Yamaguchi , R. , Unlu , F. , Edmunds , J. , Glennie , E. and Willse , J. Paper presented at the conference for the Society for Research on Educational Excellence . Washington, DC. Early findings from the implementation and impact study of early college high school ,
   Google Scholar
• Bloom , D. and Sommo , C. 2005 . Building learning communities early results from the Opening Doors demonstration at Kingsborough Community College , New York : MDRC .
   Google Scholar
• Bloom , H. S. 2006 . The core analytics of randomized experiments for social research , (MDRC Working Papers on Research Methodology) New York : MDRC .
   Google Scholar
• Bloom , H. S. , Richburg-Hayes , L. and Black , A. R. 2007 . Using covariates to improve precision for studies that randomize schools to evaluate educational interventions . Educational Evaluation and Policy Analysis , 29 ( 1 ) : 30 – 59 .
   Google Scholar
• Bloom , H. S. , Zhu , P. , Jacob , R. , Raudenbush , S. , Martinez , A. and Lin , F. 2008 . Empirical issues in the design of group-randomized studies to measure the effects of interventions for children , (MDRC Working Papers on Research Methodology) New York : MDRC .
   Google Scholar
• Brock , T. , LeBlanc , A. and MacGregor , C. 2005 . Promoting student success in community college and beyond. The Opening Doors demonstration , New York : MDRC .
   Google Scholar
• Calcagno , J. C. and Long , B. T. 2008 . The impact of postsecondary remediation using a regression discontinuity approach: Addressing endogenous sorting and noncompliance , (NCPR Working Paper) New York : National Center for Postsecondary Research, Teachers College, Columbia University .
   Google Scholar
• Clotfelter , C. T. , Ladd , H. F. and Vigdor , J. L. 2007 . Teacher credentials and student achievement: Longitudinal analysis with student fixed effects . Economics of Education Review , 26 : 673 – 682 .
   Google Scholar
• Corrin , W. , Somers , M.-A. , Kemple , J. J. , Nelson , E. and Sepanik , S. 2008 . The Enhanced Reading Opportunities Study: Findings from the second year of implementation , (Executive Summary. NCEE 2009-4037) Jessup, MD : National Center for Education Evaluation and Regional Assistance .
   Google Scholar
• Crits-Christoph , P. and Mintz , J. 1991 . Implications of therapist effects for the design and analysis of comparative studies of psychotherapies . Journal of Consulting and Clinical Psychology , 59 ( 1 ) : 20 – 26 .
   Google Scholar
• Decker , P. T. , Mayer , D. P. and Glazerman , S. 2004 . The effects of Teach For America on students: Findings from a national evaluation , (Discussion Paper no. 1285-04) Madison, WI : Institute for Research on Poverty .
   Google Scholar
• Dynarski , M. and Gleason , P. 2002 . How can we help? What we have learned from recent federal dropout prevention evaluations . Journal of Education for Students Placed at Risk , 7 ( 1 ) : 43 – 69 .
   Google Scholar
• Frank , K. A. 2000 . Impact of a confounding variable on a regression coefficient . Sociological Methods Research , 29 : 147 – 194 .
   Google Scholar
• Hedges , L. V. 2007a . Correcting a significance test for clustering . Journal of Educational and Behavioral Statistics , 32 : 151 – 179 .
   Google Scholar
• Hedges , L. V. 2007b . Effect sizes in cluster-randomized designs . Journal of Educational and Behavioral Statistics , 32 : 341 – 370 .
   Google Scholar
• Hedges , L. V. and Hedberg , E. C. 2007 . Intraclass correlation values for planning group-randomized trials in education . Educational Evaluation and Policy Analysis , 29 ( 1 ) : 60 – 87 .
   Google Scholar
• Hoxby , C. M. and Murarka , S. 2009 . Charter schools in New York City: Who enrolls and how they affect their students’ achievement , (NBER Working Paper No. 14852) Cambridge, MA : National Bureau of Economic Research .
   Google Scholar
• Kane , T. J. and Staiger , D. O. 2008 . Estimating teacher impacts on student achievement: An experimental evaluation , (NBER Working Paper No. 14607) Cambridge, MA : National Bureau of Economic Research .
   Google Scholar
• Kemple , J. J. 2004, March . Career academies: Impacts on labor market outcomes and educational attainment , New York : MDRC .
   Google Scholar
• Klein , A. , Starkey , P. , Clements , D. , Sarama , J. and Iyer , R. 2008 . Effects of a pre-kindergarten mathematics intervention: A randomized experiment . Journal of Research on Educational Effectiveness , 1 : 155 – 178 .
   Google Scholar
• Konstantopoulos , S. 2008a . The power of the test for treatment effects in three-level block randomized designs . Journal of Research on Educational Effectiveness , 1 : 265 – 288 .
   Google Scholar
• Konstantopoulos , S. 2008b . The power of the test for treatment effects in three-level cluster randomized designs . Journal of Research on Educational Effectiveness , 1 : 66 – 88 .
   Google Scholar
• Krause , M. S. and Lutz , W. 2009 . Process transforms inputs to determine outcomes: Therapists Are responsible for managing process . Clinical Psychology: Science and Practice , 16 : 73 – 81 .
   Google Scholar
• Kukla-Acevedo , S. 2009 . Do teacher characteristics matter? New results on the effects of teacher preparation on student achievement . Economics of Education Review , 28 ( 1 ) : 49 – 57 .
   Google Scholar
• Lambert , M. J. and Baldwin , S. A. 2009 . Some observations on studying therapists instead of treatment packages . Clinical Psychology: Science and Practice , 16 : 82 – 85 .
   Google Scholar
• Lang , L. , Torgesen , J. , Vogel , W. , Chanter , C. , Lefsky , E. and Petscher , Y. 2009 . Exploring the Relative Effectiveness of Reading Interventions for High School Students . Journal of Research on Educational Effectiveness , 2 : 149 – 175 .
   Google Scholar
• Love , J. M. , Kisker , E. E. , Ross , C. M. , Schochet , P. Z. , Brooks-Gunn , J. and Paulsell , D. 2002 . Making a difference in the lives of infants and toddlers and their families: The impacts of Early Head Start. Volumes I-III: Final Technical Report [and] Appendixes [and] Local Contributions to Understanding the Programs and Their Impacts Retrieved from http://www.acf.dhhs.gov/programs/core/ongoing_research/ehs/ehs_intro.html
   Google Scholar
• Michalopoulos , C. 2005 . “ Precedents and prospects for randomized experiments ” . In Learning more from social experiments: Evolving analytic approaches , Edited by: Bloom , H. 1 – 36 . New York : Russell Sage Foundation .
   Google Scholar
• Nye , B. , Konstantopoulos , S. and Hedges , L. V. 2004 . How large are teacher effects? . Educational Evaluation and Policy Analysis , 26 : 237 – 257 .
   Google Scholar
• Pals , S. L. , Murray , D. M. , Alfano , C. M. , Shadish , W. R. , Hannan , P. J. and Baker , W. L. 2008 . Individually randomized group treatment trials: A critical appraisal of frequently used design and analytic approaches . American Journal of Public Health , 98 : 1418 – 1424 .
   Google Scholar
• Raudenbush , S. W. 1997 . Statistical analysis and optimal design for cluster randomized trials . Psychological Methods , 2 : 173 – 185 .
   Google Scholar
• Raudenbush , S. W. 2008 . Advancing educational policy by advancing research on instruction . American Educational Research Journal , 45 ( 1 ) : 206 – 230 .
   Google Scholar
• Richburg-Hayes , L. , Visher , M. G. and Bloom , D. 2008 . Do learning communities effect academic outcomes? Evidence from an experiment in a community college . Journal of Research on Educational Effectiveness , 1 ( 1 ) : 33 – 65 .
   Google Scholar
• Roberts , C. and Roberts , S. A. 2005 . Design and analysis of clinical trials with clustering effects due to treatment . Clinical Trials , 2 : 152 – 162 .
   Google Scholar
• Rockoff , J. E. 2003 . The impact of individual teachers on student achievement: Evidence from panel data Retrieved from http://econwpa.wustl.edu:8089/eps/pe/papers/0304/0304002.pdf
   Google Scholar
• Rockoff , J. E. , Jacob , B. A. , Kane , T. J. and Staiger , D. O. 2008 . Can you recognize an effective teacher when you recruit one? , (NBER Working Paper No. 14485) Cambridge, MA : National Bureau of Economic Research .
   Google Scholar
• Rosenbaum , P. R. and Rubin , D. B. 1983 . The central role of the propensity score in observational studies for causal effects . Biometrika , 70 ( 1 ) : 41 – 55 .
   Google Scholar
• Scrivener , S. and Au , J. 2007 . Enhancing student services at Lorain County Community College: Early results from the Opening Doors demonstration in Ohio , New York : MDRC .
   Google Scholar
• Scrivener , S. , Bloom , D. , LeBlanc , A. , Paxson , C. , Rouse , C. E. and Sommo , C. 2008 . A good start: Two-year effects of a freshmen learning community program at Kingsborough Community College , New York : MDRC .
   Google Scholar
• Scrivener , S. and Pih , M. 2007 . Enhancing student services at Owens Community College: Early results from the Opening Doors demonstration in Ohio , New York : MDRC .
   Google Scholar
• Spybrook , J. 2008 . Are power analyses reported with adequate detail? Evidence from the first wave of group randomized trials funded by the Institute of Education Sciences . Journal of Research on Educational Effectiveness , 1 : 215 – 235 .
   Google Scholar
• Stiles , W. B. 2009 . Responsiveness as an obstacle for psychotherapy outcome research: It's worse than you think . Clinical Psychology: Science and Practice , 16 : 86 – 91 .
   Google Scholar
• Visher , M. G. , Wathington , H. , Richburg-Hayes , L. and Schneider , E. 2008 . The Learning Communities demonstration: Rationale, sites, and research design , (NCPR Working Paper) New York : National Center for Postsecondary Research, Teachers College, Columbia University .
   Google Scholar
• Wolf , P. , Gutmann , B. , Puma , M. , Kisida , B. , Rizzo , L. and Eissa , N. 2009 . Evaluation of the DC Opportunity Scholarship Program: Impacts after three years , (NCEE 2009-4050) Jessup, MD : National Center for Education Evaluation and Regional Assistance .
   Google Scholar