The suspect statistics of best practices: a triple critique of knowledge production and mobilisation in the global education policy field

References

• Auld, E., and P. Morris. 2014. “Comparative Education, the ‘New Paradigm’ and Policy Borrowing: Constructing Knowledge for Educational Reform.” Comparative Education 50 (2): 129–155.
   Web of Science ®Google Scholar
• Baker, J. 2002. Evaluating the Impact of Development Projects on Poverty: A Handbook for Practitioners. Washington, DC: World Bank.
   Google Scholar
• Barrera-Osorio, F. 2005. Impact of Private Provision of Public Education: Empirical Evidence from Bogotá’s Concessions Schools, Prepared for the Conference Mobilizing the Private Sector for Public Education, World Bank and Kennedy School of Government, Harvard University, October 5–6.
   Google Scholar
• Barrera-Osorio, F. 2006. “The Impact of Private Provision of Public Education: Empirical Evidence from Bogota’s Concession Schools.” Work Bank Policy Research Working Paper 4121, Impact Evaluation Series No. 10.
   Google Scholar
• Barrera-Osorio, F. 2009. “The Concession Schools of Bogotá.” In School Choice International: Exploring Public-private Partnerships, edited by R. Chakrabarti and P. Perterson, 193–218. Cambridge, MA: MIT.
   Google Scholar
• Beech, J., and A. Artopoulos. 2016. “Interpreting the Circulation of Educational Discourse Across Space: Searching for New Vocabularies.” Globalisation, Societies and Education 14 (2): 251–271.
   Web of Science ®Google Scholar
• Bonilla, J. 2010. El impacto de los Colegios en Concesión en el rendimiento académico [The Impact of the Concession Schools on Academic Achievement]. College Park: University of Maryland.
   Google Scholar
• Bonilla, J. 2011a. Contracting Out Public Schools for Academic Achievement. Sao Paolo: Department of Economics, University of Sao Paolo.
   Google Scholar
• Bonilla, J. 2011b. “Contracting Out Public Schools and Academic Performance: Evidence from Colombia.” Diss., University of Maryland.
   Google Scholar
• Broad, R. 2006. “Research, Knowledge, and the Art of ‘Paradigm Maintenance’: The World Bank’s Development Economics Vice-Presidency (DEC).” Review of International Political Economy 13 (3): 387–419.
   Web of Science ®Google Scholar
• Davis, K., B. Kingsbury, and S. Merry. 2012. “Indicators as a Technology of Global Governance.” Law & Society Review 46 (1): 71–104.
   Web of Science ®Google Scholar
• Deaton, A. 2010. “Instruments, Randomization, and Learning About Development.” Journal of Economic Literature 48 (2): 424–455.
   Web of Science ®Google Scholar
• Edwards Jr., D. B. 2018. Global Education Policy, Impact Evaluations, and Alternatives: The Political Economy of Knowledge Production. New York: Palgrave MacMillan.
   Google Scholar
• Edwards Jr., D. B. 2020. “Best Practices from Best Methods? Big Data and the Limitations of Impact Evaluation in the Global Governance of Education.” In The Educational Intelligent Economy: Artificial Intelligence, Machine Learning and the Internet of Things in Education, edited by T. Jules and F. Salajan, 69–85. Emerald, UK: Bingley.
   Google Scholar
• Edwards Jr., D. B., D. DeMatthews, and H. Hartley. 2017. “Public-private Partnerships, Accountability, and Competition: Theory Versus Reality in Concession Schools in Bogotá, Colombia.” Education Policy Analysis Archives 25 (10): 1–32.
   Google Scholar
• Edwards Jr., D. B. forthcoming. “The ‘Significance’ of Epistemicide: Unpacking the Problematic Statistical Foundations of Knowledge Production in Global Education Governance.” In Interrogating and Innovating Comparative and International Education: Decolonizing Practices for Inclusive, Safe Spaces, edited by E. Anderson. Rotterdam: Sense.
   Google Scholar
• Edwards Jr., D. B., and S. Hall. 2018. “Neglected Issues: How Charters Schools Manage Teachers and Acquire Resources.” Teachers College Record 120 (10): 1–40.
   Web of Science ®Google Scholar
• Edwards Jr., D. B., and H. Hartley. 2015a. Accountability and Competition for Charter Schools? Theory versus Reality in Concession Schools in Bogotá, Colombia. Privatization in Education Research Initiative Working Paper.
   Google Scholar
• Edwards Jr., D. B., and H. Hartley. 2015b. “Theory Versus Reality in Charter Schools in Colombia.” In National Center for the Study of Privatization in Education Working Paper 234. New York: Columbia University. https://ncspe.tc.columbia.edu/working-papers/WP234.pdf.
   Google Scholar
• Edwards, D. B. Jr., T. Okitsu, R. da Costa, and Y. Kitamura. 2018. “Organizational Legitimacy in the Global Education Policy Field: Learning from UNESCO and the Global Monitoring Report.” Comparative Education Review 61 (1): 31–63.
   Google Scholar
• Erickson, F., and K. Gutierrez. 2002. “Culture, Rigor, and Science in Educational Research.” Educational Researcher 31 (8): 21–24.
   Google Scholar
• Fendler, L., and I. Muzzafar. 2008. “The History of the Bell Curve: Sorting and the Idea of Normal.” Educational Theory 58 (1): 63–82.
   Google Scholar
• Fischer, F. 2007. “Policy Analysis in Critical Perspective: The Epistemics of Discursive Practices.” Critical Policy Studies 1 (1): 97–109.
   Google Scholar
• Gershberg, A. I., P. A. González, and B. Meade. 2012. “Understanding and Improving Accountability in Education: A Conceptual Framework and Guideposts from Three Decentralization Reform Experiences in Latin America.” World Development 40 (5): 1024–1041.
   Web of Science ®Google Scholar
• Gertler, P., S. Martinez, P. Premand, L. Rawlings, and C. Vermeersch. 2016. Impact Evaluation in Practice. 2nd ed. Washginton, DC: World Bank.
   Google Scholar
• Gigerenzer, G., Z. Swijtink, T. Porter, L. Datson, J. Beatty, and L. Kruger. 1989. The Empire of Chance: How Probability Changed Science and Everyday Life. New York: Cambridge University Press.
   Google Scholar
• Goldie, D., M. Linick, H. Jabbar, and C. Lubienski. 2014. “Using Bibliometric and Social Media Analyses to Explore the “Echo Chamber” Hypothesis.” Educational Policy 28 (2): 281–305.
   Web of Science ®Google Scholar
• Gómez Rodríguez, L., Niño Patiño, and M. Pérez Torres. 2011. Sostenibilidad Financiera de los Colegios en Concesión: Caso Fundación Social CALASANZ [Financial Sustainability of the Concession Schools: The Case of the CALASANZ Social Foundation]. Bogotá: Faculty of Economics, Catholic University of Colombia.
   Google Scholar
• Gorur, R. 2015. “Producing Calculable Worlds: Education at a Glance.” Discourse: Studies in the Cultural Politics of Education 36 (4): 578–595.
   Web of Science ®Google Scholar
• Gorur, R., M. Hamilton, C. Lundahl, and E. Sundström Sjödin. 2019. “Politics by Other Means? STS and Research in Education.” Discourse: Studies in the Cultural Politics of Education 40 (1): 1–15.
   Web of Science ®Google Scholar
• Grek, S. 2009. “Governing by Numbers: The PISA ‘Effect’ in Europe.” Journal of Education Policy 24 (1): 23–37.
   Web of Science ®Google Scholar
• Grosfoguel, R. 2013. “The Structure of Knowledge in Westernized Universities: Epistemic Racism/Sexism and the Four Genocides/Epistemicides of the Long 16th Century.” Human Architecture: Journal of the Sociology of Self-Knowledge XL (1): 73–90.
   Google Scholar
• Jessop, B. 2001. “Institutional Re(turns) and the Strategic – Relational Approach.” Environment and Planning A: Economy and Space 33: 1213–1235.
   Web of Science ®Google Scholar
• Jones, L. V., and D. Thissen. 2007. “A History and Overview of Psychometrics.” Handbook of Statistics 26: 1–27.
   Google Scholar
• Kaomea, J. 2015. “Qualitative Analysis as Ho’oku’iku’i or Bricolage: Teaching Emancipatory Indigenous Research in Postcolonial Hawaii.” Qualitative Inquiry 22 (2): 1–8.
   Web of Science ®Google Scholar
• Klees, S. 2016. “Inferences from Regression Analysis: Are They Valid?” Real-world Economics Review 74: 85–97. http://www.paecon.net/PAEReview/issue74/Klees74.pdf.
   Google Scholar
• Klees, S., and D. B. Edwards Jr. 2014. “Knowledge Production and Technologies of Governance.” In World Yearbook of Education 2014: Governing Knowledge: Comparison, Knowledge-based Technologies and Expertise in the Regulation of Education, edited by T. Fenwick, E. Mangez, and J. Ozga, 31–43. New York: Routledge.
   Google Scholar
• Larner, W., and N. Lauri. 2010. “Travelling Technocrats, Embodied Knowledges: Globalising Privatisation in Telecoms and Water.” Geoforum; Journal of Physical, Human, and Regional Geosciences 41 (2): 218–226.
   Web of Science ®Google Scholar
• Leamer, E. 1983. “Let’s Take the Con Out of Econometrics.” The American Economic Review 73 (1): 31–43.
   Web of Science ®Google Scholar
• Lingard, B., and S. Rawolle. 2011. “New Scalar Politics: Implications for Education Policy.” Comparative Education 47 (4): 489–502.
   Web of Science ®Google Scholar
• López, A., A. Virguez, J. Sarmiento, and A. Silva. 2015. “El efecto de la gerencia privada de escuelas públicas en el desempeño estudiantil en la educación media en Colombia.” Ecos de Economía: A Latin American Journal of Applied Economics 19 (41): 109–136.
   Google Scholar
• Lowden, P. S. 2004. “Education Reform in Colombia: The Elusive Quest for Effectiveness.” https://www.wilsoncenter.org/sites/default/files/Lowden_Paper.pdf.
   Google Scholar
• Lubienski, C., J. Scott, and E. DeBray. 2014. “The Politics of Research, Production, Promotion, and Utilization in Education Policy.” Educational Policy 28 (2): 131–144.
   Web of Science ®Google Scholar
• Lubienski, C., P. Weitzel, and S. T. Lubienski. 2009. “Is There a “Consensus” on School Choice and Achievement? Advocacy Research and the Emerging Political Economy of Knowledge Production.” Educational Policy 23 (1): 161–193.
   Web of Science ®Google Scholar
• Luecke, D., and N. McGinn. 1975. “Regression Analyses and Education Production Functions: Can They be Trusted?” Harvard Educational Review 45 (3): 325–350.
   Web of Science ®Google Scholar
• Malin, J., and C. Lubienski. 2015. “Educational Expertise, Advocacy, and Media Influence.” Education Policy Analysis Archives 23 (6): 1–32.
   Google Scholar
• McCormick, A. 2012. “Whose Education Policies in Aid-receiving Countries? A Critical-discourse Analysis of Quality and Normative Transfer Through Cambodia and Laos.” Comparative Education Review 56 (1): 18–47.
   Web of Science ®Google Scholar
• Menashy, F., and R. Read. 2016. “Knowledge Banking in Global Education Policy: A Bibliometric Analysis of World Bank Publications on Public-private Partnerships.” Education Policy Analysis Archives 24 (95): 1–28.
   Google Scholar
• Murariu, I., & Johannes, L. (2010). “Output-based Aid in Education: A Solution for Quality Education.” OBApproaches, March, Note Number 22. https://openknowledge.worldbank.org/bitstream/handle/10986/10938/548510BRI0OBAp10Box349431B01PUBLIC1.pdf?sequence=1&isAllowed=y.
   Google Scholar
• Patricia, M., and V. Ramirez. 2014. Análisis evaluativo de la política colegios en concesión y efectos colaterales [Evaluative Analysis of the Concession Schools Policy and Collateral Effects]. Bogotá: Trabajo de grado, Pontifica Universidad Javeriana.
   Google Scholar
• Patrinos, H., F. Barrera-Osorio, and J. Guáqueta. 2009. The Role and Impact of Public-private Partnerships in Education. Washington, DC: World Bank.
   Google Scholar
• Pérez, N. 2010. Educación para la Vida: Experiencia de Concesión Educativa de la Fundación Gimnasio Moderno—Caso de Estudio [Education for Life: The Experience of the Modern Gymnasium Foundation Educational Concession-Case Study]. Bogotá: School of Administration, Universidad del Rosario.
   Google Scholar
• Pérez Illera, N., and H. Rivera. 2010. Concesión Sabio Caldas—Gimnasio Moderno: Un Caso de Responsabilidad Social, Stakeholders y Bien Común. [The Sabio Caldas-Modern Gynmasium Concession: A Case of Social Responsibility, Stakeholders, and the Common Good]. Research Document No. 78. Bogotá: School of Administration, Universidad del Rosario.
   Google Scholar
• Pogrow, S. 2017. “The Failure of the U.S. Education Research Establishment to Identify Effective Practices: Beware Effective Practices Policies.” Education Policy Analysis Archives 25 (5): 1–19. https://epaa.asu.edu/ojs/article/view/2517.
   Google Scholar
• Porter, T. 1995. Trust in Numbers: The Pursuit of Objectivity in Science and Public Life. Princeton: Princeton University Press.
   Google Scholar
• Restrepo, P. P., and J. H. Florez. 2008. “La gobernabilidad: Conceptualización y una aplicación al sistema de educación básica en Colombia.” Cadernos de Economia 27 (49): 155–182.
   Google Scholar
• Rodríguez, A. 2005. Case Study: Public School Concession Model of Bogotá, Colombia. Washington, DC: World Bank.
   Google Scholar
• Sabatier, P. A., and D. A. Mazmanian. 1983. “Policy Implementation.” In Encyclopedia of Policy Sciences, edited by S. S. Nagel, 143–169. New York: Marcel Dekker.
   Google Scholar
• Samoff, J. 1999. “Education Sector Analysis in Africa: Limited National Control and Even Less National Ownership.” International Journal of Education Development 19: 249–272.
   Web of Science ®Google Scholar
• Sarmiento, A., C. Alonso, G. Duncan, and C. Garzon. 2005. “Evaluación de la Gestión de los Colegios en Concesión en Bogotá, 2000–2003.” Archivos de Economía, Documento 291, Departamento Nacional de Planeación, Bogotá.
   Google Scholar
• Schlotter, M., G. Schwerdt, and L. Woessmann. 2011. “Econometric Methods for Causal Evaluation of Education Policies and Practices: A Non-technical Guide.” Education Economics 19 (2): 109–137.
   Google Scholar
• Scott, J., and H. Jabbar. 2014. “The Hub and the Spokes: Foundations, Intermediary Organizations, Incentivist Reforms, and the Politics of Research Evidence.” Educational Policy 28 (2): 233–257.
   Web of Science ®Google Scholar
• Sellar, S., and B. Lingard. 2013. “Looking East: Shanghai, PISA 2009 and the Reconstitution of Reference Societies in the Global Education Policy Field.” Comparative Education 49 (4): 464–485.
   Web of Science ®Google Scholar
• Shahjahan, R. 2011. “Decolonizing the Evidence-based Education and Policy Movement: Revealing the Colonial Vestiges in Educational Policy, Research, and Neoliberal Reform.” Journal of Education Policy 26 (2): 181–206.
   Web of Science ®Google Scholar
• Shahjahan, R. A. 2016. “International Organizations (IOs), Epistemic Tools of Influence, and the Colonial Geopolitics of Knowledge Production in Higher Education Policy.” Journal of Education Policy 31 (6): 694–710.
   Web of Science ®Google Scholar
• Smith, L. T. 1999. Decolonizing Methodologies: Research and Indigenous Peoples. London, England: Zed Books.
   Google Scholar
• Sriprakash, A., and R. Mukhopadhyay. 2015. “Reflexivity and the Politics of Knowledge: Researchers as ‘Brokers’ and ‘Translators’ of Educational Development.” Comparative Education 51 (2): 231–246.
   Web of Science ®Google Scholar
• Takayama, K. 2008. “The Politics of International League Tables: PISA and Japan’s Achievement Crisis Debate.” Comparative Education 44 (4): 387–407.
   Web of Science ®Google Scholar
• Termes, A., X. Bonal, A. Veger, and A. Zancajo. 2015. “Public-Private Partnerships in Colombian Education: The Equity and Quality Implications of “Colegios en concesión”. PERI working paper. http://www.periglobal.org/role-state/document/public-private-partnerships-colombian-education-equity-and-quality-implications-.
   Google Scholar
• UNESCO. 2008. EFA Global Monitoring Report 2008: Education for All by 2015: Will We Make it? Paris: UNESCO.
   Google Scholar
• Vavrus, F. 2004. “The Referential Web: Externalization Beyond Education in Tanzania.” In The Global Politics of Educational Borrowing and Lending, edited by G. Steiner-Khamsi, 141–152. New York: Teachers College Press.
   Google Scholar
• Vavrus, F., and M. Seghers. 2010. “Critical Discourse Analysis in Comparative Education: A Discursive Study of “Partnership” in Tanzania’s Poverty Reduction Policies.” Comparative Education Review 54 (1): 77–103.
   Web of Science ®Google Scholar
• Verger, A. 2012. “Framing and Selling Global Education Policy: the Promotion of Public–Private Partnerships for Education in low-Income Contexts.” Journal of Education Policy 27 (1): 109–130.
   Web of Science ®Google Scholar
• Verger, A., D. B. Edwards Jr., and H. Kosar-Altinyelken. 2014. “Learning from All? The World Bank, Aid Agencies and the Construction of Hegemony in Education for Development.” Comparative Education 50 (4): 381–399.
   Web of Science ®Google Scholar
• Verger, A., C. Fontdevila, R. Rogan, and T. Gurney. 2019. “Manufacturing an Illusory Consensus? A Bibliometric Analysis of the International Debate on Education Privatisation.” International Journal of Educational Development 64: 81–95.
   Web of Science ®Google Scholar
• Villa, L., and J. Duarte. 2002. Los Colegios en Concesión de Bogotá, Colombia: Una experiencia innovadora de gestión escolar reformas o mejoramiento continuo. Documento de Trabajo. Washington, DC: BID.
   Google Scholar
• Villa, L., and J. Duarte. 2005. “Concessionary Public Schools in Bogotá: An Innovation in School Management in Colombia.” In Private Education and Public Policy in Latin America, edited by L. Wolff, J. Navarro, and P. Gonzalez, 95–130. Washington, DC: PREAL.
   Google Scholar
• Walters, P. 2009. “The Politics of Science: Battles for Seientific Authority in the Field of Education Research.” In Education Research on Trial: Policy Reform and the Call for Scientific Rigor, edited by P. Walters, A. Lareau, and S. Ranis, 17–50. New York: Routledge.
   Google Scholar
• Weiss, R., and M. Rein. 1970. “The Evaluation of Broad-aim Programs: Experimental Design, its Difficulties, and an Alternative.” Administrative Science Quarterly 15 (1): 97–109.
   Web of Science ®Google Scholar
• World Economic Forum. 2014. “Creating New Models: Innovative Public-private Partnerships for Inclusive Development in Latin America.” http://www3.weforum.org/docs/GAC/2014/WEF_GAC_LatinAmerica_InnovativePublicPrivatePartnerships_Report_2014.pdf.
   Google Scholar
• Zapp, M. 2017. “The World Bank and Education: Governing (Through) Knowledge.” International Journal of Education Development 53: 1–11.
   Web of Science ®Google Scholar