Putting RCTs in their place: implications from an RCT of the integrated group reading approach

References

• Al Otaiba, S., C. M. Connor, J. S. Folsom, J. Wanzek, L. Greulich, C. Schatschneider, and R. K. Wagner. 2014. “To Wait in Tier 1 or Intervene Immediately: A Randomized Experiment Examining First-Grade Response to Intervention in Reading.” Exceptional Children 81 (1): 11–27. doi: 10.1177/0014402914532234
   PubMed Web of Science ®Google Scholar
• Bentley, T., and S. Gillinson. 2007. A D&R System for Education. London: Innovation Unit.
   Google Scholar
• Brooks, G. 2016. What Works for Pupils with Literacy Difficulties. London: The Dyslexia-SpLD Trust.
   Google Scholar
• Brown, A. 1992. “Design Experiments; Theoretical and Methodological Challenges in Creating Complex Interventions in Classroom Settings.” Journal of the Learning Sciences 2 (2): 141–178. doi: 10.1207/s15327809jls0202_2
   Google Scholar
• Cartwright, N. 2007. “Are RCTs the Gold Standard?” BioSocieties 2 (2): 11–20. doi: 10.1017/S1745855207005029
   Google Scholar
• Charlton, B., R. L. Williams, and T. F. McLaughlin. 2005. “Educational Games: A Technique to Accelerate the Acquisition of Reading Skills of Children with Learning Disabilities.” International Journal of Special Education 20 (2): 66–72.
   Google Scholar
• Cronbach, L. J. 1975. “Beyond the Two Disciplines of Scientific Psychology.” American Psychologist 30 (2): 116–127. doi: 10.1037/h0076829
   Web of Science ®Google Scholar
• Department for Education. 2013. Phonics Screening Check and National Curriculum Assessments at Key Stage 1 in England. https://www.gov.uk/government/publications/phonics-screening-check-and-national-curriculum-assessments-at-key-stage-1-in-england-2013.
   Google Scholar
• EEF (Education Endowment Foundation). 2015. Making Best Use of Teaching Assistants: Guidance Report. London: EEF.
   Google Scholar
• EEF (Education Endowment Foundation). 2016. EEF at 5. https://educationendowmentfoundation.org.uk.
   Google Scholar
• EEF (Education Endowment Foundation). 2018. Information for Grantees about EEF’s Approach to Evaluation. https://educationendowmentfoundation.org.uk/projects-and-evaluation/evaluating-projects/evaluation-information-for-grantees/.
   Google Scholar
• Fien, H., J. L. M. K. Smith, S. K. Smolkowski, S. K. Baker, N. J. Nelson, and E. Chaparro. 2015. “An Examination of the Efficacy of a Multi-tiered Intervention on Early Reading Outcomes for First Grade Students at Risk for Reading Difficulties.” Journal of Learning Disabilities 48 (6): 602–621. doi: 10.1177/0022219414521664
   PubMed Web of Science ®Google Scholar
• Flanagan, O. J. 1981. “Psychology, Progress, and the Problem of Reflexivity: A Study in the Epistemological Foundations of Psychology.” Journal of the History of the Behavioral Sciences 17: 375–386. doi: 10.1002/1520-6696(198107)17:3<375::AID-JHBS2300170308>3.0.CO;2-U
   PubMed Web of Science ®Google Scholar
• Furedi, F. 2013. Teaching is not Some Kind of Clinical Cure Comment. http://www.frankfuredi.com/newsite/article/teaching_is_not_some_kind_of_clinical_cure.
   Google Scholar
• Goldacre, B. 2013. Building Evidence into Education. https://media.education.gov.uk/assets/files/pdf/b/ben%20goldacre%20paper.pdf.
   Google Scholar
• Hammersley, M. 2008. “Paradigm War Revived? On the Diagnosis of Resistance to Randomized Controlled Trials and Systematic Review in Education.” International Journal of Research and Method in Education 31 (1): 3–10. doi: 10.1080/17437270801919826
   Google Scholar
• Hammersley, M. 2013. The Myth of Research-based Policy and Practice. London: Sage.
   Google Scholar
• Hargreaves, D. 1996. Teaching as a Research-Based Profession: Possibilities and Prospects. TTA Annual Lecture. London: TTA
   Google Scholar
• Humphrey, N. 2018. “Are the Kids Alright? Examining the Intersection Between Education and Mental Health.” The Psychology of Education Review 42 (1): 4–12.
   Google Scholar
• Humphrey, N., A. Lendrum, E. Ashworth, K. Frearson, R. Buck, and K. Kerr. n.d. Implementation and Process Evaluation (IPE) for Interventions in Education Settings: An Introductory Handbook. London: EEF.
   Google Scholar
• Hutchinson, D., and B. Styles. 2010. A Guide to Running Randomised Controlled Trails for Educational Researchers. Sough: NFER.
   Google Scholar
• Koutsouris, G., and B. Norwich. 2018. “What Exactly do RCT Findings Tell Us in Education Research?” British Educational Research Journal, doi:10.1002/berj.3464.
   Web of Science ®Google Scholar
• Lewis, C., R. Perry, and A. Murata. 2006. “How Should Research Contribute to Instructional Improvement? The Case of Lesson Study.” Educational Researcher 35 (3): 3–14. doi: 10.3102/0013189X035003003
   Google Scholar
• MacIntyre, A. 1985. After Virtue: A Study in Moral Theory. London: Duckworth.
   Google Scholar
• Moore, G. F., S. Audrey, M. Barker, L. Bond, C. Bonell, W. Hardeman, L. Moore, et al. 2015. “Process Evaluation of Complex Interventions: Medical Research Council Guidance.” BMJ 350: h1258. doi: 10.1136/bmj.h1258
   PubMed Web of Science ®Google Scholar
• Muter, V., C. Hulme, M. J. Snowling, and J. Stevenson. 2004. “Phonemes, Rimes, Vocabulary, and Grammatical Skills as Foundations of Early Reading Development: Evidence from a Longitudinal Study..” Developmental Psychology 40: 665–681. doi: 10.1037/0012-1649.40.5.665
   PubMed Web of Science ®Google Scholar
• Norwich, B. 2014. “Context, Interests and Methodologies, in Research in Special Needs and Inclusive Education: the Interface with Policy and Practice.” Journal of Research in Special Educational Needs 14 (3): 193–196. doi: 10.1111/1471-3802.12070_3
   Google Scholar
• Norwich, B., and G. Koutsouris. in press. “An Inclusive Model of Targeting Literacy Teaching for 7–8 Year Old Children Who are Struggling to Learn to Read: The Integrated Group Reading (IGR) Approach.” In Inclusive Education: Global Issues and Controversies, edited by Boyle, C. S. Mavropoulou, J. Anderson, and A. Paige.
   Google Scholar
• Norwich, B., G. Koutsouris, and A. Bessudnov. 2018. An Innovative Classroom Reading Intervention for Year 2 and 3 Pupils Who are Struggling to Learn to Read: Evaluating the Integrated Group Reading Programme. Project Report for Nuffield Foundation. http://www.integratedgroupreading.co.uk/evaluation-project/.
   Google Scholar
• Pawson, R., and N. Tilley. 1997. Realistic Evaluation. London: Sage.
   Google Scholar
• Pawson, R., and N. Tilley. 2004. Realist Evaluation. Accessed Februar 27, 2018. http://www.communitymatters.com.au/RE_chapter.pdf.
   Google Scholar
• Primary National Strategy. 2007. Letters and Sounds: Principles and Practice of High Quality Phonics. London: Department for Education and Skills. https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/190599/Letters_and_Sounds_-_DFES-00281-2007.pdf.
   Google Scholar
• Rose, J. 2009. Identifying and Teaching Children and Young People with Dyslexia and Literacy Difficulties. DCSF-00659-2009. London: DCSF.
   Google Scholar
• Sharples, J., B. Albers, and S. Fraser. 2018. Putting Evidence to Work: A School’s Guide to Implementation: Guidance Report. London EEF. Accessed August 9, 2018. https://educationendowmentfoundation.org.uk/public/files/Publications/Campaigns/Implementation/EEF-Implementation-Guidance-Report.pdf.
   Google Scholar
• Stebbing, J. 2013. Putting it All Together: Integrated Group Reading for Raising the Attainment of Children Needing Systematic, Integrated Reading Experience in Years 2 and 3. (Unpublished paper: contact first author for copy).
   Google Scholar
• Stentiford, L., G. Koutsouris, and B. Norwich. 2018. “A Systematic Literature Review of the Organisational Arrangements of Primary School-Based Reading Interventions for Struggling Readers.” Journal of Research in Reading 41S1: 197–225. (revised version under review). doi: 10.1111/1467-9817.12264
   Google Scholar
• Thomas, G. 2016. “After the Gold Rush: Questioning the ‘Gold Standard’ and Reappraising the Status of Experiment and RCT in Education.” Harvard Educational Review 86 (3): 390–411. doi: 10.17763/1943-5045-86.3.390
   Web of Science ®Google Scholar
• Thomas, G., and R. Pring. 2004. Evidence-based Practice in Education. Maidenhead: Open University Press.
   Google Scholar
• Topping, K., D. Miller, A. Thurston, K. McGavock, and N. Conlin. 2011. “Peer Tutoring in Reading in Scotland: Thinking Big.” Literacy 45 (1): 3–9. doi: 10.1111/j.1741-4369.2011.00577.x
   Web of Science ®Google Scholar
• Torgeson, C. J. 2009. “Randomised Controlled Trials in Education Research: A Case Study of an Individually Randomised Pragmatic Trial.” Education 3-13 37 (4): 313–321. doi: 10.1080/03004270903099918
   Google Scholar
• Torgeson, C., G. Brooks, L. Gascoine, and S. Higgins. 2018. “Phonics: Reading Policy and the Evidence of Effectiveness from a Systematic Tertiary Review.” Research Papers in Education, doi:10.10.1080/0267/1522.2017.1420816.
   Web of Science ®Google Scholar
• Torrance, H. 2013. “Building Evidence in Education: Why Not Look at the Evidence?” Research Intelligence 121: 26–28.
   Google Scholar
• Toulmin, S. E. 1972. Human Understanding, Volume I: The Collective Use and Evolution of Concepts. Princeton: Princeton University Press.
   Google Scholar
• What Works Clearinghouse. 2013. Updated Intervention Report: Reading Recovery. Washington, DC: U.S. Department of Education, Institute of Education Sciences.
   Google Scholar
• Wyse, D., and C. Torgeson 2017. “Experimental Trials and ‘What Works?’ in Education: The Case of Grammar for Writing.” British Educational Research Journal 43 (6): 1019–1047. doi: 10.1002/berj.3315
   Web of Science ®Google Scholar