Advanced search
Publication Cover
Educational Research Volume 60, 2018 - Issue 3: Randomised Controlled Trials (RCTs) in education research – methodological debates, questions, challenges
Submit an article Journal homepage
23,687
Views
92
CrossRef citations to date
0
Altmetric
Articles

The trials of evidence-based practice in education: a systematic review of randomised controlled trials in education research 1980–2016

Paul ConnollyCentre for Evidence and Social Innovation, Queen’s University Belfast, Belfast, Northern IrelandCorrespondence[email protected]
ORCID Iconhttp://orcid.org/0000-0001-9176-9592
ORCID Icon,
Ciara KeenanCentre for Evidence and Social Innovation, Queen’s University Belfast, Belfast, Northern IrelandORCID Iconhttp://orcid.org/0000-0003-0831-7347
ORCID Icon &
Karolina UrbanskaSchool of Psychology, Queen’s University Belfast and LAPSCO, Université Clermont Auvergne, Clermont-Ferrand, FranceORCID Iconhttp://orcid.org/0000-0001-5063-4747
ORCID Icon
Pages 276-291 | Received 11 Dec 2017, Accepted 22 Jun 2018, Published online: 09 Jul 2018

Citations (92)

Keep up to date with the latest research on this topic with citation updates for this article.

Subscribe to citation updates

Read on this site (15)

Sam Sims, Jake Anders, Matthew Inglis & Hugues Lortie-Forgues. (2023) Quantifying “Promising Trials Bias” in Randomized Controlled Trials in Education. Journal of Research on Educational Effectiveness 16:4, pages 663-680.
Read now
Debra McGregor, Sarah Frodsham & Helen Wilson. (2022) The nature of epistemological opportunities for doing, thinking and talking about science: Reflections on an effective intervention that promotes creativity. Research in Science & Technological Education 40:3, pages 363-388.
Read now
Rhyall Barry Gordon, Matt Lumb, Matthew Bunn & Penny Jane Burke. (2022) Evaluation for equity: reclaiming evaluation by striving towards counter-hegemonic democratic practices. Journal of Educational Administration and History 54:3, pages 277-290.
Read now
John F. Brown. (2022) Replication studies: an essay in praise of ground-up conceptual replications in the science of learning. Educational Research and Evaluation 27:1-2, pages 188-207.
Read now
Thomas Perry & Beng Huat See. (2022) Replication study in education. Educational Research and Evaluation 27:1-2, pages 1-7.
Read now
Mathilde Lamotte, Marie Izaute & Céline Darnon. (2021) Can tests improve learning in real university classrooms?. Journal of Cognitive Psychology 33:8, pages 974-992.
Read now
Angela M Coderre-Ball, Madison Robertson, Elizabeth Matzinger, Paola Durando & Rylan Egan. (2021) Training initiatives that enhance knowledge, attitudes, and practices regarding the prevention, diagnosis and treatment of Lyme disease: a systematic review. International Journal of Health Promotion and Education 0:0, pages 1-24.
Read now
Jennifer M. Gore. (2021) The quest for better teaching. Oxford Review of Education 47:1, pages 45-60.
Read now
Lucinda McKnight & Andy Morgan. (2020) A broken paradigm? What education needs to learn from evidence-based medicine. Journal of Education Policy 35:5, pages 648-664.
Read now
Laura A. Outhwaite, Anthea Gulliford & Nicola J. Pitchford. (2020) A new methodological approach for evaluating the impact of educational intervention implementation on learning outcomes. International Journal of Research & Method in Education 43:3, pages 225-242.
Read now
Slavko Rogan, Jan Taeymans, Stefan Zuber & Evert Zinzen. (2020) Impact of guided self-study on learning success in undergraduate physiotherapy students – a study protocol for a randomized controlled feasibility trial. Physical Therapy Reviews 25:2, pages 143-148.
Read now
Zewelanji N. Serpell. (2020) Supporting the integration of evidence into federal educational policy and reform efforts: A navigational framework for educational researchers. Educational Psychologist 55:1, pages 40-48.
Read now
Leonidas Kyriakides, Evi Charalambous, H. P. M. (Bert) Creemers & Andria Dimosthenous. (2019) Improving quality and equity in schools in socially disadvantaged areas. Educational Research 61:3, pages 274-301.
Read now
Juan David Parra & D. Brent Edwards$suffix/text()$suffix/text(). Challenging the gold standard consensus: Randomised controlled trials (RCTs) and their pitfalls in evidence-based education. Critical Studies in Education 0:0, pages 1-18.
Read now
Lorraine Gilleece & Aidan Clerkin. Towards more robust evaluation of policies and programmes in education: identifying challenges in evaluating DEIS and Reading Recovery. Irish Educational Studies 0:0, pages 1-29.
Read now

Articles from other publishers (77)

Giuseppe Aleo, Nicola Pagnucci, Niamh Walsh, Roger Watson, Deirdre Lang, Thomas Kearns, Mark White & Catherine Fitzgerald. (2024) The effectiveness of continuing professional development for the residential long-term care workforce: A systematic review. Nurse Education Today 137, pages 106161.
Crossref
Debbie L. Hahs-Vaughn, Christine Depies DeStefano, Christopher D. Charles & Mary Little. (2024) Challenges and Adjustments in a Multisite School-Based Randomized Field Trial. American Journal of Evaluation.
Crossref
Anna Broseghini, Miina Lõoke, Marta Brscic, Juliana Raffaghelli, Barbara Cardazzo, Antonella Lotti, Laura Cavicchioli & Lieta Marinelli. (2024) Exploring the Effectiveness of Problem-Based Learning in an International Undergraduate Program in Veterinary Sciences: Students’ Satisfaction, Experience and Learning. Veterinary Sciences 11:3, pages 104.
Crossref
Ellen Kingsley, Katie Biggs, Kiera Solaiman, Anna Packham, Roshanak Nekooi, Matthew Bursnall, Kirsty McKendrick, Cindy L Cooper & Barry Wright. (2024) Implementation successes and lessons learnt from a randomised controlled trial of a complex school-based intervention. Research Methods in Medicine & Health Sciences.
Crossref
Daniel Mateos-Moreno & Ernst Erlanson. (2022) Investigating one-to-one instrumental music lessons in relation to a training programme on Paul Harris’ simultaneous learning. International Journal of Music Education 42:1, pages 148-160.
Crossref
May C I van Schalkwyk, Benjamin Hawkins, Mark Petticrew, Nason Maani, Amandine Garde, Aaron Reeves & Martin McKee. (2024) Agnogenic practices and corporate political strategy: the legitimation of UK gambling industry-funded youth education programmes. Health Promotion International 39:1.
Crossref
Amanda B Lees, Rosemary Godbold & Simon Walters. (2023) Reconceptualizing participant vulnerability in Scholarship of Teaching and Learning research: exploring the perspectives of health faculty students in Aotearoa New Zealand. Research Ethics 20:1, pages 36-63.
Crossref
Ricarda Neubauer, Claus Juergen Bauer, Christoph F. Dietrich, Brigitte Strizek, Valentin Sebastian Schäfer & Florian Recker. (2024) Evidence-based Ultrasound Education? – A Systematic Literature Review of Undergraduate Ultrasound Training Studies. Ultrasound International Open 10:CP.
Crossref
Ilker Cingillioglu, Uri Gal & Artem Prokhorov. (2024) Running a double-blind true social experiment with a goal oriented adaptive AI-based conversational agent in educational research. International Journal of Educational Research 124, pages 102323.
Crossref
Ulrich Trautwein, Jessika Golle, Ann‐Kathrin Jaggy, Marcus Hasselhorn & Benjamin Nagengast. (2023) Mutual benefits for research and practice: Randomized controlled trials in the Hector Children's Academy Program. Annals of the New York Academy of Sciences 1530:1, pages 96-104.
Crossref
Herb Turner & Raifu Durodoye. (2023) A Road Less Traveled for Designing Rigorous Studies to Identify Effective Technology-Based Reading Interventions. Technology, Knowledge and Learning.
Crossref
Nicole Harris & Sarah Wright. (2023) Precision Teaching for maths: An academic critique. DECP Debate 1:186, pages 6-17.
Crossref
Nicola Pagnucci, Giuseppe Aleo, Witold Orlik, Paul Mahon, Thomas Kearns, Carmel Kelly, Thomas Lordan & Catherine Fitzgerald. (2023) Teaching and learning modalities for continuing professional development in the long-term care: A rapid synthesis review. Nurse Education in Practice 70, pages 103638.
Crossref
Noémi Kis & József Balázs Fejes. (2023) Oktatási intervenció – értékes, de ritka jószág. Magyar Pedagógia 123:2, pages 67-81.
Crossref
Fernanda Ostermann, Cláudio J. de H. Cavalcanti, Matheus M. Nascimento & Nathan W. Lima. (2023) Speech analysis under a Bakhtinian approach: Contributions to research on physics education. Physical Review Physics Education Research 19:1.
Crossref
Theresa Wilkes & Robin Stark. (2022) Probleme evidenzorientierter UnterrichtspraxisProblems of an evidence-oriented educational practice. Unterrichtswissenschaft 51:2, pages 289-313.
Crossref
Annie Padwick, Opeyemi Dele-Ajayi, Carol Davenport & Rebecca Strachan. (2023) Evaluating a complex and sustained STEM engagement programme through the lens of science capital: insights from Northeast England. International Journal of STEM Education 10:1.
Crossref
Elisabeth Schenk, Jan Taeymans & Slavko Rogan. (2023) The impact of guided self-study on knowledge and skills in Swiss pre-clinical physiotherapy students – a feasibility study protocol. Frontiers in Medicine 10.
Crossref
Catriona Windsor, Tingwei Zhang, Nathan J. Wilson, Katrina Blyth, Natalie Ballentine & Renée Speyer. (2023) Psychosocial‐behavioural interventions for school‐aged children with intellectual disabilities: A systematic review of randomised control trials. Journal of Applied Research in Intellectual Disabilities 36:3, pages 458-485.
Crossref
Noam Angrist, Elisabetta Aurino, Harry A. Patrinos, George Psacharopoulos, Emiliana Vegas, Ralph Nordjo & Brad Wong. (2023) Improving Learning in Low- and Lower-Middle-Income Countries. Journal of Benefit-Cost Analysis 14:S1, pages 55-80.
Crossref
Meral Koldas, Mehmet Filiz, Catherine Storey & Nichola Booth. (2023) Evaluating the efficacy of Online Verbal Behaviour Training to ABA-Practitioners working with autistic individuals. International Journal of Educational Research 117, pages 102126.
Crossref
David Armstrong. 2023. International Encyclopedia of Education(Fourth Edition). International Encyclopedia of Education(Fourth Edition) 177 182 .
Howard White & Ting Yang. 2023. International Encyclopedia of Education(Fourth Edition). International Encyclopedia of Education(Fourth Edition) 599 607 .
Aileen Kennedy. 2023. International Encyclopedia of Education(Fourth Edition). International Encyclopedia of Education(Fourth Edition) 681 689 .
Sanjaya Mishra & Pradeep K. Misra. 2023. Handbook of Open, Distance and Digital Education. Handbook of Open, Distance and Digital Education 337 353 .
Franz Buscha & Matt Dickson. 2020. Handbook of Labor, Human Resources and Population Economics. Handbook of Labor, Human Resources and Population Economics 1 39 .
Marita Turpin & Tania Prinsloo. 2023. Digital-for-Development: Enabling Transformation, Inclusion and Sustainability Through ICTs. Digital-for-Development: Enabling Transformation, Inclusion and Sustainability Through ICTs 3 16 .
Ira Malmberg-Heimonen & Anne Grete Tøge. (2022) Behandlingskontrast i eksperimenter innen velferd og utdanning. Tidsskrift for samfunnsforskning 63:4, pages 278-289.
Crossref
Sonia Ilie, Konstantina Maragkou, Ashton Brown & Eliza Kozman. (2022) No Budge for any Nudge: Information Provision and Higher Education Application Outcomes. Education Sciences 12:10, pages 701.
Crossref
Julie A. Edmunds, Dora Gicheva, Beth Thrift & Marie Hull. (2021) Using Mixed Methods to Explore Variations in Impact Within RCTs: The Case of Project COMPASS. Journal of Mixed Methods Research 16:4, pages 478-499.
Crossref
Mark D. Weist, Joni W. Splett, Colleen A. Halliday, Nicholas A. Gage, Michael A. Seaman, Katherine A. Perkins, Kelly Perales, Elaine Miller, Darien Collins & Christine DiStefano. (2022) A randomized controlled trial on the interconnected systems framework for school mental health and PBIS: Focus on proximal variables and school discipline. Journal of School Psychology 94, pages 49-65.
Crossref
Terry Byers, Vicky Leighton, Jack Leggett, Alex Krzensk, Rebecca Adamson, Christopher Pollock & Stephanie MacMahon. (2022) The impact of a preparatory science of learning intervention in secondary schools contexts in Australia. Review of Education 10:1.
Crossref
Jane Pegram, Richard C. Watkins, Marguerite Hoerger & John Carl Hughes. (2022) Assessing the range and evidence‐base of interventions in a cluster of schools. Review of Education 10:1.
Crossref
Şule DAĞ & Tuğba HORZUM. (2022) Matematik eğitiminde kavram yanılgıları ile ilgili yazılan lisansüstü tezlerin incelenmesi: Bir sistematik derlemeExamination of graduate theses written about misconceptions In mathematics education: A systematic review. e-Kafkas Eğitim Araştırmaları Dergisi 9:1, pages 434-465.
Crossref
Ann Yinqi Zhang. (2022) From Clinical Trial to Education: Methodologies, Assumptions, and Directions. International Journal of Methodology 1:1, pages 2-10.
Crossref
Céline Darnon & Michel Fayol. (2021) Can an early mathematical intervention boost the progress of children in kindergarten? A field experiment. European Journal of Psychology of Education 37:1, pages 1-18.
Crossref
Brandy G. Elrod, Kenneth G. Rice & Joel Meyers. (2021) PBIS fidelity, school climate, and student discipline: A longitudinal study of secondary schools. Psychology in the Schools 59:2, pages 376-397.
Crossref
Jo-Anne Baird. (2022) On the use of cognitive science in teacher education in England. Vernon Wall Lecture 1:Anniversary Edition, pages 34-48.
Crossref
Lindsey Gale, Pranashree Bhushan, Shweta Eidnani, Lorraine Graham, Matthew Harrison, Lisa McKay-Brown, Rucha Pande, Shreya Shreeraman & Chandhni Sivashunmugam. (2022) Overcoming barriers to inclusion in education in India: A scoping review. Social Sciences & Humanities Open 5:1, pages 100237.
Crossref
Sanjaya Mishra & Pradeep K. Misra. 2022. Handbook of Open, Distance and Digital Education. Handbook of Open, Distance and Digital Education 1 17 .
Michael Liebendörfer, Reinhard Hochmuth, Rolf Biehler, Niclas Schaper, Christiane Büdenbender-Kuklinski, Elisa Lankeit, Johanna Ruge & Mirko Schürmann. 2022. Unterstützungsmaßnahmen in mathematikbezogenen Studiengängen. Unterstützungsmaßnahmen in mathematikbezogenen Studiengängen 33 65 .
Haifa Alwahaby, Mutlu Cukurova, Zacharoula Papamitsiou & Michail Giannakos. 2022. The Multimodal Learning Analytics Handbook. The Multimodal Learning Analytics Handbook 289 325 .
Beata Beigman Klebanov & Nitin Madnani. 2022. Automated Essay Scoring. Automated Essay Scoring.
Mel Ainscow. 2021. Implementing Educational Reform. Implementing Educational Reform 17 40 .
Ayelet Becher & Adam Lefstein. (2020) Teaching as a Clinical Profession: Adapting the Medical Model. Journal of Teacher Education 72:4, pages 477-488.
Crossref
Manuel B. Garcia. (2021) Cooperative learning in computer programming: A quasi-experimental evaluation of Jigsaw teaching strategy with novice programmers. Education and Information Technologies 26:4, pages 4839-4856.
Crossref
Claire Dorris, Karen Winter, Liam O'Hare & Edda Tandi Lwoga. (2021) PROTOCOL: A systematic review of mobile device use in the primary school classroom and its impact on pupil literacy and numeracy attainment. Campbell Systematic Reviews 17:2.
Crossref
Gary Thomas. (2020) Experiment’s persistent failure in education inquiry, and why it keeps failing. British Educational Research Journal 47:3, pages 501-519.
Crossref
Steven Donbavand & Bryony Hoskins. (2021) Citizenship Education for Political Engagement: A Systematic Review of Controlled Trials. Social Sciences 10:5, pages 151.
Crossref
Kimberly T. Nesbitt & Dale C. Farran. (2021) Effects of Prekindergarten Curricula: Tools of the Mind as a Case Study . Monographs of the Society for Research in Child Development 86:1, pages 7-119.
Crossref
Vicente Miñana-Signes, Manuel Monfort-Pañego & Javier Valiente. (2021) Teaching Back Health in the School Setting: A Systematic Review of Randomized Controlled Trials. International Journal of Environmental Research and Public Health 18:3, pages 979.
Crossref
Ingunn Størksen, Sigrun K. Ertesvåg & Mari Rege. (2021) Implementing implementation science in a randomized controlled trial in Norwegian early childhood education and care. International Journal of Educational Research 108, pages 101782.
Crossref
Andrea B. Troxel. 2021. Pragmatic Randomized Clinical Trials. Pragmatic Randomized Clinical Trials 413 426 .
Robin Henson, Genéa Stewart & Lee Bedford. (2020) Key Challenges and Some Guidance on Using Strong Quantitative Methodology in Education Research. Journal of Urban Mathematics Education 13:2.
Crossref
Laura A. Outhwaite, Anthea Gulliford & Nicola J. Pitchford. (2020) Language counts when learning mathematics with interactive apps. British Journal of Educational Technology 51:6, pages 2326-2339.
Crossref
Jesús Honorato-Errázuriz & María Soledad Ramírez-Montoya. (2020) Innovative public policies in the development of reading skills in basic education: Regarding the systematic mapping protocol. Innovative public policies in the development of reading skills in basic education: Regarding the systematic mapping protocol.
Jesus Honorato-Errázuriz & María Soledad Ramírez-Montoya. (2020) Intervention model to promote reading in basic education: contributions to public policies. Intervention model to promote reading in basic education: contributions to public policies.
Catherine Wheatley, Nick Beale, Thomas Wassenaar, Mackenzie Graham, Emma Eldridge, Helen Dawes & Heidi Johansen-Berg. (2020) Fit to Study: Reflections on designing and implementing a large-scale randomized controlled trial in secondary schools. Trends in Neuroscience and Education 20, pages 100134.
Crossref
Richard Churches, Eleanor J. Dommett, Ian M. Devonshire, Robin Hall, Steve Higgins & Astrid Korin. (2020) Translating Laboratory Evidence into Classroom Practice with Teacher‐Led Randomized Controlled Trials—A Perspective and Meta‐Analysis. Mind, Brain, and Education 14:3, pages 292-302.
Crossref
Amy McPherson, Sue Saltmarsh & Sara Tomkins. (2020) Reconsidering assent for randomised control trials in education: Ethical and procedural concerns. British Educational Research Journal 46:4, pages 728-746.
Crossref
Hüseyin Atakan KESKİN & Mehmet Levent YILMAZ. (2020) REVIEW OF EXPERIMENTAL DESIGNS AND METHODS IN ECONOMICS OF EDUCATION RESEARCH. Finansal Araştırmalar ve Çalışmalar Dergisi.
Crossref
Michael D. Fetters & José F. Molina-Azorin. (2020) Utilizing a Mixed Methods Approach for Conducting Interventional Evaluations. Journal of Mixed Methods Research 14:2, pages 131-144.
Crossref
Cigdem Yucel, Glenda Hawley, Fusun Terzioglu & Fiona Bogossian. (2020) The Effectiveness of Simulation-Based Team Training in Obstetrics Emergencies for Improving Technical Skills. Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare 15:2, pages 98-105.
Crossref
Irena Pietrzyk & Melinda Erdmann. (2020) Investigating the impact of interventions on educational disparities: Estimating average treatment effects (ATEs) is not sufficient. Research in Social Stratification and Mobility 65, pages 100471.
Crossref
Josef Schrader, Marcus Hasselhorn, Petra Hetfleisch & Annika Goeze. (2020) Stichwortbeitrag Implementationsforschung: Wie Wissenschaft zu Verbesserungen im Bildungssystem beitragen kannImplementation research: How science can contribute to improvements in the education system. Zeitschrift für Erziehungswissenschaft 23:1, pages 9-59.
Crossref
Michael Wigelsworth. (2020) A (critical) case for evidence-based interventions in the context of social and emotional learning: Commentary on Professor Raven’s paper for open dialogue. Psychology of Education Review 44:1, pages 43-47.
Crossref
Gayle L. MacklemGayle L. Macklem. 2020. Brief SEL Interventions at School. Brief SEL Interventions at School 29 50 .
Michelle Jayman. 2020. Researching Within the Educational Margins. Researching Within the Educational Margins 45 61 .
Roselyn M. Dixon & Irina Verenikina. 2020. Curriculum, Schooling and Applied Research. Curriculum, Schooling and Applied Research 237 256 .
Brian Tarran. (2019) Education Trials and Tribulations. Significance 16:6, pages 8-9.
Crossref
Jing Chen, Jun Feng, Jingzhao Hu & Xia Sun. (2019) Causal Analysis of Learning Performance Based on a Bayesian Network and Mutual Information. Entropy 21:11, pages 1102.
Crossref
Yao-Ting Sung, Han-Yueh Lee, Je-Ming Yang & Kuo-En Chang. (2019) The quality of experimental designs in mobile learning research: A systemic review and self-improvement tool. Educational Research Review 28, pages 100279.
Crossref
Darcy L. Strouse & Kathryn Moore. (2019) Commentary: Contextualizing Alternatives to RCTs: Measuring the Impact of a Non‐Governmental Sponsorship Organization's Projects to Strengthen Children's Supportive Environments. New Directions for Child and Adolescent Development 2019:167, pages 141-158.
Crossref
David Jaitner, Raven Rinas, Christoph Becker, Christina Niermann, Jennifer Breithecker & Filip Mess. (2019) Supporting Subject Justification by Educational Psychology: A Systematic Review of Achievement Goal Motivation in School Physical Education. Frontiers in Education 4.
Crossref
Howard White. (2019) The twenty-first century experimenting society: the four waves of the evidence revolution. Palgrave Communications 5:1.
Crossref
Andrew Miller, Jennifer Gore, Claire Wallington, Jess Harris, Elena Prieto-Rodriguez & Max Smith. (2019) Improving student outcomes through professional development: Protocol for a cluster randomised controlled trial of Quality Teaching Rounds. International Journal of Educational Research 98, pages 146-158.
Crossref
Jake Anders & Morag Henderson. 2019. Socioeconomic Inequality and Student Outcomes. Socioeconomic Inequality and Student Outcomes 41 62 .

Related research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.