Reassessing RCTs as the ‘gold standard’: synergy not separatism in evaluation designs

References

• Abrahams, I., J. Bennett, A. Cheung, L. Elliott, P. Hanley, Z. Oberio, P. Rudd, R. Slavin, and M. Turkenburg. 2014. Evaluation of the Impact of a Continuing Professional Development (CPD) Course for Primary Science Specialists: Final Report. London: The Wellcome Trust.
   Google Scholar
• Asmussen, K. 2011. The Evidence-Based Parenting Practitioner's Handbook. Abingdon: Routledge.
   Google Scholar
• Biesta, G. 2010. “Why ‘What Works’ Still Won't Work: From Evidence-Based Education to Value-Based Education.” Studies in Philosophy and Education 29 (5): 491–503. doi:10.1007/s11217-010-9191-x.
   Web of Science ®Google Scholar
• Bonell, C., A. Fletcher, M. Morton, T. Lorenc, and L. Moore. 2012. “Realist Randomised Controlled Trials: A New Approach to Evaluating Complex Public Health Interventions”. Social Science and Medicine 75: 2299–2306. doi:10.1016/j.socscimed.2012.08.032.
   PubMed Web of Science ®Google Scholar
• Cartwright, N., and J. Hardie. 2012. Evidence-Based Policy: A Practical Guide to Doing It Better. New York: Oxford University Press.
   Google Scholar
• Century, J., M. Rudnick, and C. Freeman. 2010. “A Framework for Measuring Fidelity of Implementation: A Foundation for Shared Language and Accumulation of Knowledge”. American Journal of Evaluation 31 (2): 199–218. doi:10.1177/1098214010366173.
   Web of Science ®Google Scholar
• Clegg, S. 2005. “Evidence-Based Practice in Educational Research: A Critical Realist Critique of Systematic Review.” British Journal of Sociology of Education 26 (3): 415–428. doi:10.1080/01425690500128932.
   Web of Science ®Google Scholar
• Cook, T. D. 2007. “Randomized Experiments in Education: Assessing the Objections to Doing Them.” Economics of Innovation and New Technology 16 (5): 331–355. doi:10.1080/10438590600982335.
   Google Scholar
• Education Committee. 2013. “Uncorrected Transcript of Oral Evidence”. Accessed January 23. http://www.publications.parliament.uk/pa/cm201213/cmselect/cmeduc/uc853-i/uc85301.htm .
   Google Scholar
• EEF (Education Endowment Foundation). (2011–2012). Annual Report 2011/12. London: EEF.
   Google Scholar
• EEF (Education Endowment Foundation). (2015a. “ EEF Evaluators’ Conference 2015.”) https://educationendowmentfoundation.org.uk/evaluation/evaluation-resources/eef-evaluators-conference-2015/.
   Google Scholar
• EEF (Education Endowment Foundation). 2015b. “Evaluation Glossary.” Accessed October 1, 2015. https://educationendowmentfoundation.org.uk/evaluation/evaluation-glossary /.
   Google Scholar
• Education Sciences Reform Act of 2002 (Pub. L. No. 107–279). https://www2.ed.gov/policy/rschstat/leg/PL107–279.pdf .
   Google Scholar
• Foray, D., R. Murnane, and R. Nelson. 2007. “Randomized Trials of Education and Medical Practices: Strengths and Limitations”. Economics of Innovation and New Technology 16 (5): 303–306. doi:10.1080/10438590600982194.
   Google Scholar
• Forsetlund, L., I. Chalmers, and A. Bjørndal. 2007. “When was Random Allocation First Used to Generate Comparison Groups in Experiments to Assess the Effects of Social Interventions?” Economics of Innovation and New Technology 16 (5): 371–384. doi:10.1080/10438590600982467.
   Google Scholar
• Furedi, F. 2013. “Teaching Is Not Some Kind of Clinical Cure.” Times Educational Supplement, October 4.
   Google Scholar
• Gondolf, E. W. 2015. “ The Evidence-Based Practice Movement.” Emerging Trends in the Social and Behavioral Sciences. Hoboken, NJ: John Wiley & Sons.
   Google Scholar
• Gorard, S., and T. Cook. 2007. “Where Does Good Evidence Come From?” International Journal of Research and Method in Education 30 (3): 307–323. doi:10.1080/17437270701614790.
   Google Scholar
• Gorard, S., N. Siddiqui, and B. H. See. 2014. “An Evaluation of the ‘Switch-on Reading’ Literacy Catch-up Programme.” British Educational Research Journal. Advance online publication. doi:10.1002/berj.3157.
   Web of Science ®Google Scholar
• Guskey, T. R. 2000. Evaluating Professional Development. Thousand Oaks, CA: Corwin Press.
   Google Scholar
• Hammersley, M. 2008. “Paradigm War Revived? On The Diagnosis of Resistance to Randomized Controlled Trials and Systematic Review in Education.” International Journal of Research and Method in Education 31 (1): 3–10. doi:10.1080/17437270801919826.
   Google Scholar
• Haynes, L., O. Service, B. Goldacre, and D. Torgerson. 2012. Test, Learn, Adapt: Developing Public Policy with Randomised Controlled Trials. London: Cabinet Office-Behavioural Insights Team.
   Google Scholar
• Holmes, D., S. J. Murray, A. Perron, and G. Rail. 2006. “Deconstructing the Evidence-Based Discourse in Health Sciences: Truth, Power and Fascism.” International Journal of Evidence-Based Healthcare 4 (3): 180–186. doi:10.1111/j.1479-6988.2006.00041.x.
   PubMedGoogle Scholar
• Howe, K. R. 2005. “The Education Science Question: A Symposium." Educational Theory 55 (3): 235–243.
   Google Scholar
• Institute of Education Sciences (IES) and The National Science Foundation (NSF). 2013. Common Guidelines for Education Research and Development. Washington, DC: IES and NSF.
   Google Scholar
• Jones, S., D. Myhill, and T. Bailey. 2013. “Grammar for Writing? An Investigation of the Effects of Contextualised Grammar Teaching on Students’ Writing.” Reading and Writing 26 (8): 1241–1263. doi:10.1007/s11145-012-9416-1.
   Web of Science ®Google Scholar
• Lather, P. 2003. “This IS Your Father's Paradigm: Government Intrusion and the Case of Qualitative Research in Education”. Paper presented at AERA Special Interest Group: Qualitative Research, Chicago, April.
   Google Scholar
• Lendrum, A., and N. Humphrey. 2012. “The Importance of Studying the Implementation of Interventions in School Settings.” Oxford Review of Education 38: 635–652. doi:10.1080/03054985.2012.734800.
   Web of Science ®Google Scholar
• Mertens, D. M., and S. Hesse-Biber. 2013. “Mixed Methods and Credibility of Evidence in Evaluation”. New Directions for Evaluation, 138: 5–13. doi:10.1002/ev.20053.
   Google Scholar
• Mitchell, D. 2008. What Really Works in Special and Inclusive Education. Abingdon: Routledge.
   Google Scholar
• Morrison, K. 2001. “Randomised Controlled Trials for Evidence-Based Education: Some Problems in Judging ‘What Works’.” Evaluation and Research in Education 15 (2): 69–83. doi:10.1080/09500790108666984.
   Google Scholar
• NIHR. 2015. “Glossary of Research Terms for the NIHR Evaluation, Trials and Studies Coordinating Centre.” Accessed October 1, 2015. www.nets.nihr.ac.uk/ppi/?a=35974.
   Google Scholar
• No Child Left Behind (NCLB) Act of 2001. 2002. Pub. L. No. 107–110, § 115, Stat. 1425.
   Google Scholar
• Norman, G. 2004. “Editorial – Beyond PBL”. Advances in Health Sciences Education 9 (4): 257–260. doi:10.1007/s10459-004-5539-8.
   PubMed Web of Science ®Google Scholar
• Oakley, A. 2006. “Resistances to ‘New’ Technologies of Evaluation: Education Research in the UK as a Case Study.” Evidence and Policy: A Journal of Research, Debate and Practice 2 (1): 63–87. doi:10.1332/174426406775249741.
   Google Scholar
• Oakley, A., V. Strange, C. Bonell, E. Allen, J. Stephenson, and RIPPLE Study Team. 2006. “Process Evaluation in Randomised Controlled Trials of Complex Interventions.” British Medical Journal 332 (7538): 413–416. doi:10.1136/bmj.332.7538.413.
   PubMed Web of Science ®Google Scholar
• Oxford Dictionary of English. 2005. 2nd ed. Oxford: Oxford University Press. Also available at http://www.oxforddictionaries.com/definition/english/.
   Google Scholar
• Shepherd, J. 2007. “The Production and Management of Evidence for Public Service Reform.” Evidence & Policy: A Journal of Research, Debate and Practice 3 (2): 231–251. doi: 10.1332/174426407781172225
   Google Scholar
• Slavin, R. 1991. Student Team Learning. Washington, DC: National Education Association.
   Google Scholar
• Slavin, R. 2008. “What Works? Issues in Synthesizing Educational Program Evaluations”. Educational Researcher 37 (1): 5–14. doi:10.3102/0013189X08314117.
   Web of Science ®Google Scholar
• Slavin, R., and C. Lake. 2008. “Effective Programs in Elementary Mathematics: A Best-Evidence Synthesis.” Review of Educational Research 78 (3): 427–515. doi:10.3102/0034654308317473.
   Web of Science ®Google Scholar
• Slavin, R. E., C. Lake, and C. Groff. 2009. “Effective Programs in Middle and High School Mathematics: A Best-Evidence Synthesis.” Review of Educational Research, 79 (2): 839–911. doi:10.3102/0034654308330968.
   Web of Science ®Google Scholar
• Stewart-Brown, S., R. Anthony, L. Wilson, S. Winstanley, N. Stallard, H. Snooks, and D. Simkiss. 2011. “Should Randomised Controlled Trials Be the “Gold Standard” for Research on Preventive Interventions for Children?” Journal of Children's Services 6 (4): 228–235. doi:10.1108/17466661111190929.
   Google Scholar
• Torgerson, C. J., and D. J. Torgerson. (2008). Designing Randomised Controlled Trials in Health, Education, and the Social Sciences: An Intr. New York: Palgrave Macmillan.
   Google Scholar
• Torgerson, C. J., A. Wiggins, D. J. Torgerson, H. Ainsworth, H. Barmby, C. Hewitt, K. Jones et al. 2011. Every Child Counts: The Independent Evaluation. London: Department for Education.
   Google Scholar
• Tracey, L., N. A. Madden, and R. E. Slavin. 2010. “Effects of Co-Operative Learning on the Mathematics Achievement of Years 4 and 5 Pupils in Britain: A Randomised Control Trial”. Effective Education 2 (1): 85–97. doi:10.1080/19415531003616904.
   Google Scholar
• Vignoles, A., J. Jerrim, and R. Cowan. 2015. Mathematics Mastery: Primary Evaluation Report. London: Education Endowment Foundation.
   Google Scholar
• Windschitl, M. 2004. “Folk Theories of ‘Inquiry’: How Preservice Teachers Reproduce the Discourse and Practices of an Atheoretical Scientific Method.” Journal of Research in Science Teaching 41 (5): 481–512. doi:10.1002/tea.20010.
   Web of Science ®Google Scholar