What is meant by “rigour” in evidence-based educational policy and what’s so good about it?

References

• Angrist, J. D., & Pischke, J.-S. (2010). The credibility revolution in empirical economics: How better research design is taking the con out of econometrics. Journal of Economic Perspectives, 24(2), 3–30. doi: 10.1257/jep.24.2.3
   Web of Science ®Google Scholar
• Bareinboim, E., & Pearl, J. (2012). Transportability of causal effects: Completeness results. In Proceedings of the Twenty-Sixth Conference on Artificial Intelligence (AAAI-12) (pp. 698–704). Menlo Park, CA: AAAI Press.
   Google Scholar
• Bareinboim, E., & Pearl, J. (2013). A general algorithm for deciding transportability of experimental results. Journal of Causal Inference, 1(1), 107–134.
   Google Scholar
• Broadbent, A. (2015). Causation and prediction in epidemiology: A guide to the “Methodological Revolution”. Studies in History and Philosophy of Science Part C: Studies in History and Philosophy of Biological and Biomedical Sciences, 54, 72–80. doi: 10.1016/j.shpsc.2015.06.004
   PubMed Web of Science ®Google Scholar
• Cartwright, N. (1989). Nature’s capacities and their measurement. Oxford: Clarendon Press.
   Google Scholar
• Cartwright, N. (in press). Middle-level theory. The Lullius Lectures 2018. Theoria.
   Google Scholar
• Cartwright, N., & Hardie J. (2012). Evidence-based policy: A practical guide to doing it better. New York, NY: Oxford University Press.
   Google Scholar
• Chang, H. (2007). Inventing temperature: Measurement and scientific progress. Oxford, UK: Oxford University Press.
   Google Scholar
• Coll, R. K., Chang, W.-H., Dillon, J., Justi, R., Mortimer, E., Tan, K. C. D., … Paul, W. (2009). An international perspective of monitoring educational research quality: Commonalities and differences. In M. C. Shelley II, L. D. Yore, & B. Hand (Eds.), Quality research in literacy and science education: International perspectives and gold standards (pp. 107–137). Dordrecht: Springer. doi: 10.1007/978-1-4020-8427-0_6
   Google Scholar
• Cupri, V. (2015). Confirmation theory. In E. N. Zalta (Ed.), The Stanford encyclopedia of philosophy (Winter 2016 ed.). Retrieved from https://plato.stanford.edu/entries/confirmation/
   Google Scholar
• Deaton, A., & Cartwright, N. (2018). Understanding and misunderstanding randomized controlled trials. Social Science & Medicine, 210, 2–21. doi: 10.1016/j.socscimed.2017.12.005
   PubMed Web of Science ®Google Scholar
• Eisenhart, M., & Towne, L. (2003). Contestation and change in national policy on “scientifically based” education research. Educational Researcher, 32(7), 31–38. doi: 10.3102/0013189X032007031
   Google Scholar
• Elster, J. (2015). Explaining social behavior: More nuts and bolts for the social sciences (Rev. ed.). New York, NY: Cambridge University Press.
   Google Scholar
• Gallin, J. I., Ognibene, F. P., & Johnson, L. L. (2017). Principles and practice of clinical research (4th ed.). Cambridge, MA: Academic Press.
   Google Scholar
• Given, L. (Ed.). (2008). The SAGE encyclopedia of qualitative research methods. London: SAGE. doi: 10.4135/9781412963909.n409
   Google Scholar
• Harris, A., & Jones, M. (2018). Why context matters: A comparative perspective on education reform and policy implementation. Educational Research for Policy and Practice, 17(3), 195–207. doi: 10.1007/s10671-018-9231-9
   Web of Science ®Google Scholar
• Henderson, L. (2018). The problem of induction. In E. N. Zalta (Ed.), The Stanford encyclopedia of philosophy (Spring 2019 ed.). Retrieved from https://plato.stanford.edu/entries/induction-problem/
   Google Scholar
• Hendry, D. F. (1980). Econometrics – Alchemy or science? Economica, 47(188), 387–406. doi: 10.2307/2553385
   Web of Science ®Google Scholar
• Hendry, D. F., Marcellino, M., & Mizon, G. E. (Eds.). (2008). Special issue on encompassing [Special issue]. Oxford Bulletin of Economics and Statistics, 70(s1).
   Google Scholar
• Higgins, S., & Katsipataki, M. (2016). Communicating comparative findings from meta-analysis in educational research: Some examples and suggestions. International Journal of Research & Method in Education, 39(3), 237–254. doi: 10.1080/1743727X.2016.1166486
   Web of Science ®Google Scholar
• Hutchison, D., & Styles, B. (2010). A guide to running randomised controlled trials for educational researchers. Slough: National Foundation for Educational Research.
   Google Scholar
• Keddie, A. (2019). Context matters: Primary schools and academies reform in England. Journal of Educational Policy, 34(1), 6–21. doi: 10.1080/02680939.2017.1402959
   Web of Science ®Google Scholar
• Layne, C. M., Steinberg, J. R., & Steinberg, A. M. (2014). Causal reasoning skills training for mental health practitioners: Promoting sound clinical judgment in evidence-based practice. Training and Education in Professional Psychology, 8(4), 292–302. doi: 10.1037/tep0000037
   Web of Science ®Google Scholar
• Leamer, E. E. (1983). Let’s take the con out of econometrics. American Economic Review, 73(1), 31–43.
   Web of Science ®Google Scholar
• Mays, N., & Pope, C. (1995). Rigour and qualitative research. BMJ, 311(6997), 109–112. doi: 10.1136/bmj.311.6997.109
   PubMed Web of Science ®Google Scholar
• Mill, J. S. (1967). On the definition of political economy and on the methods of philosophical investigation in that science. In Collected Works of John Stuart Mill (Vol. 4). Toronto: University of Toronto Press. ( Original work published 1836)
   Google Scholar
• Mill, J. S. (1973). On the logic of the moral sciences. In System of logic, reprinted in Collected Works of John Stuart Mill (Vols. 7–8). Toronto: University of Toronto Press. ( Original work published 1843)
   Google Scholar
• Munro, E., Cartwright, N., Hardie, J., & Montuschi, E. (2017). Improving child safety: Deliberation, judgement and empirical research (CHESS Working Paper 2017-1). Retrieved from https://www.dur.ac.uk/resources/chess/ONLINE_Improvingchildsafety-15_2_17-FINAL.pdf
   Google Scholar
• Murad, M. H., Asi, N., Alsawas, M., & Alahdab, F. (2016). New evidence pyramid. BMJ Evidence-Based Medicine, 21(4), 125–127. doi: 10.1136/ebmed-2016-110401
   Google Scholar
• Nature Conservancy (2016). Conservation by design 2.0: Guidance document (Version 1.0). Retrieved from https://www.conservationgateway.org/ConservationPlanning/cbd/Documents/CbD2.0_Guidance%20Doc_Version%201.pdf
   Google Scholar
• Norton, J. D. (2003). A material theory of induction. Philosophy of Science, 70(4), 647–670. doi: 10.1086/378858
   Web of Science ®Google Scholar
• Oancea, A., & Furlong, J. (2007). Expressions of excellence and the assessment of applied and practice-based research. Research Papers in Education, 22(2), 119–137. doi: 10.1080/02671520701296056
   Google Scholar
• Oxman, A., & Hanney, S. (2009). SUPPORT tools for evidence-informed health policymaking (STP): Guides. Health Research Policy and Systems, 7(Suppl 1). Retrieved from https://health-policy-systems.biomedcentral.com/articles/supplements/volume-7-supplement-1
   Google Scholar
• Popper, K. (2002). The logic of scientific discovery. Abingdon: Routledge. ( Original work published 1959)
   Google Scholar
• Reiss, J. (2013). Philosophy of economics. A contemporary introduction. Abingdon: Routledge.
   Google Scholar
• Rigorous. (2003). In Oxford Compact English Dictionary. Oxford: Oxford University Press.
   Google Scholar
• Schulze, R. (2004). Meta-analysis: A comparison of approaches. Goettingen: Hogrefe & Huber.
   Google Scholar
• Seckinelgin, H. (2017). The politics of global aids: Institutionalization of solidarity, exclusion of context. New York, NY: Springer.
   Google Scholar
• Shavelson, R. J., & Towne, L. (Eds.). (2002). Scientific research in education. Washington, DC: National Academy Press.
   Google Scholar
• Short, T. G., & Leslie, K.(2014). Known unknowns and unknown unknowns: Electroencephalographic burst suppression and mortality. BJA: British Journal of Anaesthesia, 113(6), 897–899. doi: 10.1093/bja/aeu147
   PubMed Web of Science ®Google Scholar
• Sims, C. A. (1980). Macroeconomics and reality. Econometrica, 48(1), 1–48. doi: 10.2307/1912017
   Web of Science ®Google Scholar
• Talbott, W. (2008). Bayesian epistemology. In E. N. Zalta (Ed.), The Stanford encyclopedia of philosophy (Winter 2016 ed.). Retrieved from https://plato.stanford.edu/entries/epistemology-bayesian/
   Google Scholar
• Thornton, S. (2018). Karl Popper. In E. N. Zalta (Ed.), The Stanford encyclopedia of philosophy (Fall 2018 ed.). Retrieved from https://plato.stanford.edu/entries/popper/
   Google Scholar
• Torgerson, D. J., & Torgerson, C. J. (2008). Designing randomised trials in health, education and the social sciences: An introduction. Basingstoke: Palgrave Macmillan.
   Google Scholar
• Turnell, A., & Murphy, T. (2017). Signs of safety: Comprehensive briefing paper (4th ed.). Retrieved from https://knowledgebank.signsofsafety.net/resources/introduction-to-signs-of-safety/signs-of-safety-comprehensive-briefing-paper-public?
   Google Scholar
• US Department of Education. (2002). Strategic plan for 2002–2007. Retrieved from https://eric.ed.gov/?id=ED466025
   Google Scholar
• What Works Clearinghouse. (2005). Key items to get right when conducting a randomized controlled trial in education. Retrieved from http://coalition4evidence.org/wp-content/uploads/2012/05/Guide-Key-items-to-Get-Right-RCT.pdf
   Google Scholar
• Yatvin, J. (2012, August 17). What schools need: Vigor instead of rigor [Web log post]. Retrieved from https://www.washingtonpost.com/blogs/answer-sheet/post/what-schools-need-vigor-instead-of-rigor/2012/08/16/68be3d0c-e7fb-11e1-8487-64e4b2a79ba8_blog.html
   Google Scholar