The promises and expectations of ILSAs regarding policymaking: lessons from Latin America

References

• Acosta, Felicitas. 2019. “OECD, PISA and the Educationalization of the World: The Case of the Southern Cone Countries.” In The OECD’s Historical Rise in Education: The Formation of a Global Governing Complex, edited by Christian Ydesen, 175–196. Cham: Springer International Publishing. https://doi.org/10.1007/978-3-030-33799-5_9.
   Google Scholar
• Addey, Camilla. 2015. “Participating in international literacy assessments in Lao PDR and Mongolia. A global ritual of belonging.” In Literacy as Numbers: Researching the Politics and Practices of International Literacy Assessment Regimes, edited by Mary Hamilton, Bryan Maddox, and Camilla Addey, 147–164. Cambridge: Cambridge University Press.
   Google Scholar
• Addey, Camilla, and Sam Sellar. 2019. “Is It Worth It? Rationales for (Non)Participation in International Large-Scale Learning Assessments.” In Education Research and Foresight Working Papers Series 24. Paris: UNESCO. https://unesdoc.unesco.org/ark:/48223/pf0000368421?posInSet=6&queryId=N-EXPLORE-e22734ba-cc0c-40bb-b997-1e0b49722cb6.
   Google Scholar
• Addey, Camilla, Sam Sellar, Gita Steiner-Khamsi, Bob Lingard, and Antoni Verger. 2017. “The Rise of International Large-Scale Assessments and Rationales for Participation.” Compare: A Journal of Comparative and International Education 47 (3): 434–452. https://doi.org/10.1080/03057925.2017.1301399.
   Web of Science ®Google Scholar
• Asil, Mustafa, and Gavin Brown. 2016. “Comparing OECD PISA Reading in English to Other Languages: Identifying Potential Sources of Non-Invariance.” International Journal of Testing 16 (1): 71–93. https://doi.org/10.1080/15305058.2015.1064431.
   Web of Science ®Google Scholar
• Auld, Euan, Jeremy Rappleye, and Paul Morris. 2018. “PISA for Development: How the OECD and World Bank Shaped Education Governance Post-2015.” Comparative Education, 1–23. https://doi.org/10.1080/03050068.2018.1538635.
   Web of Science ®Google Scholar
• Bacchi, Carol. 1999. Women, Policy and Politics. The Construction of Policy Problems. London, Thousand Oaks, New Delhi: SAGE.
   Google Scholar
• Bacchi, Carol. 2010. Foucault, Policy and Rule: Challenging the Problem-Solving Paradigm. Aalborg: Aalborg Universitet.
   Google Scholar
• Bacchi, Carol. 2012. “Why Study Problematizations? Making Politics Visible.” Open Journal of Political Science 2 (1): 1–8. https://doi.org/10.4236/ojps.2012.21001.
   Google Scholar
• Baek, Chanwoong. 2022. “Internalising Externalisation: Utilisation of International Knowledge in Education Policymaking.” British Journal of Sociology of Education 43 (1): 159–176. https://doi.org/10.1080/01425692.2021.2007357.
   Web of Science ®Google Scholar
• Bieber, Tonia, Kerstin Martens, Dennis Niemann, and Janna Teltemann. 2015. “Towards a Global Model in Education? International Student Literacy Assessments and Their Impact on Policies and Institutions.” In Literacy as Numbers: Researching the Politics and Practices of International Literacy Assessment Regimes, edited by Mary Hamilton, Bryan Maddox, and Camilla Addey, 165–186. Cambridge: Cambridge University Press.
   Google Scholar
• Board on International Comparative Studies in Education. 1995. Worldwide Education Statistics: Enhancing UNESCO’s Role. Washington, DC: National Academy Press.
   Google Scholar
• Bottani, Norberto. 1994. “The OECD International Education Indicators.” Assessment in Education: Principles, Policy & Practice 1 (3): 333–350. https://doi.org/10.1080/0969594940010308.
   Google Scholar
• Calderón, Margarita, César Guadalupe, and Virginie Thériault. 2023. “Taking Stock of Youth and Adult Educational Policies in Chile and Peru in a Changing Landscape.” Studies in the Education of Adults 56 (1): 66–83. https://doi.org/10.1080/02660830.2023.2257707.
   Google Scholar
• Campbell, Donald T. 1979. “Assessing the Impact of Planned Social Change.” Evaluation and Program Planning 2 (1): 67–90. https://doi.org/10.1016/0149-7189(79)90048-X.
   Google Scholar
• Cardoso, Manuel. 2022. “Policymaking to the Test? How International Large-Scale Assessments (ILSAs) Influence Repetition Rates.” International Studies in Sociology of Education, 1–26. https://doi.org/10.1080/09620214.2022.2090414.
   Web of Science ®Google Scholar
• Cardoso, Manuel, and Gita Steiner-Khamsi. 2017. “The Making of Comparability: Education Indicator Research from Jullien de Paris to the 2030 Sustainable Development Goals.” Compare 47 (3): 388–405. https://doi.org/10.1080/03057925.2017.1302318.
   Web of Science ®Google Scholar
• Carpentieri, J. D. 2015. “Adding New Numbers to the Literacy Narrative : Using PIAAC Data to Focus on Literacy Practices.” In Literacy as Numbers: Researching the Politics and Practices of International Literacy Assessment Regimes, edited by Mary Hamilton, Bryan Maddox, and Camilla Addey, 93–110. Cambridge: Cambridge University Press.
   Google Scholar
• Cueto, Santiago. 2013. Evaluaciones estandarizadas del rendimiento escolar. Lima: CNE.
   Google Scholar
• Cussó, Roser, and Sabrina D’Amico. 2005. “From Development Comparatism to Globalization Comparativism: Towards More Normative International Education Statistics.” Comparative Education 41 (1): 199–216. https://doi.org/10.1080/03050060500037012.
   Google Scholar
• Di Gropello, Emanuela, María José Vargas, and Yanez Pagans. 2019. “¿Qué lecciones nos dejan los últimos resultados de PISA 2018 para América Latina?” Blogs del Banco Mundial (blog). https://blogs.worldbank.org/es/latinamerica/que-lecciones-nos-dejan-los-ultimos-resultados-de-pisa-2018-para-america-latina.
   Google Scholar
• Elfert, Maren, and Christian Ydesen. 2023. Global Governance of Education. The Historical and Contemporary Entanglements of UNESCO, the OECD and the World Bank. Cham: Educational Governance Research 24. Springer. https://doi.org/10.1007/978-3-031-40411-5.
   Google Scholar
• Gajardo, Marcela. 1999. Reforma educativa en América Latina. Balance de una década (No. 15). . Santiago de Chile: PREAL.
   Google Scholar
• Gomez Caride, Ezequiel. 2018. “The Cinderella Concept in Educational Policy in Latin America.” In Testing and Inclusive Schooling. International Challenges and Opportunities, edited by Bjorn Hamre, Anne Morin, and Christian Ydesen, 182–197. London: Routledge.
   Google Scholar
• Gorur, Radhika. 2015. “Assembling a Sociology of Numbers.” In Literacy as Numbers: Researching the Politics and Practices of International Literacy Assessment Regimes, edited by Mary Hamilton, Bryan Maddox, and Camilla Addey, 1–16. Cambridge: Cambridge University Press.
   Google Scholar
• Grek, Sotiria. 2009. “Governing by Numbers: The PISA ‘Effect’ in Europe.” Journal of Education Policy 24 (1): 23–37. https://doi.org/10.1080/02680930802412669.
   Web of Science ®Google Scholar
• Grek, Sotiria. 2024. The New Production of Expert Knowledge: Education, Quantification and Utopia. Cham, Switzerland: Springer Nature. https://doi.org/10.1007/978-3-031-46606-9.
   Google Scholar
• Grey, Susan Caroline. 2020. PISA, the Media and the Governance of Education Policy in England and Sweden. Doctoral Thesis, London: University College London. https://discovery.ucl.ac.uk/id/eprint/10090263/.
   Google Scholar
• Grey, Sue, and Paul Morris. 2018. “PISA: Multiple “Truths” and Mediatised Global Governance.” Comparative Education 54 (2): 109–131. https://doi.org/10.1080/03050068.2018.1425243.
   Web of Science ®Google Scholar
• Grotlüschen, Anke, and Lisanne Heilmann. 2021. Between PIAAC and the New Literacy Studies. What Adult Education Can Learn from Large-Scale Assessments without Adopting the Neo-Liberal Paradigm. Münster; New York: Waxmann. https://www.pedocs.de/volltexte/2021/21944/pdf/Grotlueschen_Heilmann_2021_Between_PIAAC_and.pdf.
   Google Scholar
• Guadalupe, C. 2014. “Setting Conditions on Aid for Education: Is it an Acceptable Practice in the 21st Century?” In From Schooling to Learning, edited by N. V. Varghese, 119–126. Paris: UNESCO/IIEP. http://unesdoc.unesco.org/images/0022/002283/228323e.pdf.
   Google Scholar
• Guadalupe, César, and Alejandra Villanueva. 2013. “PISA 2009/2000 en América Latina: Una relectura de los cambios en el desempeño lector y su relación con las condiciones sociales.” Apuntes 40 (72), 157–192. https://repositorio.up.edu.pe/handle/11354/487?show=full.
   Google Scholar
• Hamilton, Mary. 2012. Literacy and the Politics of Representation. Oxon: Routledge.
   Google Scholar
• Hamilton, Mary. 2017. “How International Large-Scale Skills Assessments Engage with National Actors: Mobilising Networks through Policy, Media and Public Knowledge.” Critical Studies in Education 58 (3): 280–294. https://doi.org/10.1080/17508487.2017.1330761.
   Web of Science ®Google Scholar
• Heyneman, Stephen. P. 1999. “The Sad Story of UNESCO’s Education Statistics.” International Journal of Educational Development 19: 65–74. https://doi.org/10.1016/S0738-0593(98)00068-6.
   Web of Science ®Google Scholar
• IEA. n.d. IEA’s Rosetta Stone: Measuring global progress toward the UN Sustainable Development Goal for quality education by linking regional assessment results to TIMSS and PIRLS International Benchmarks of Achievement. Amsterdam: IEA. https://uis.unesco.org/sites/default/files/documents/Draft_proposal_for_linking_regional_assessments_to_TIMSS_and_PIRLS.pdf.
   Google Scholar
• Klemenčič, Eva, and Plamen Vladkov Mirazchiyski. 2018. “League Tables in Educational Evidence-Based Policy-Making: Can We Stop the Horse Race, Please?” Comparative Education 54 (3): 309–324. https://doi.org/10.1080/03050068.2017.1383082.
   Web of Science ®Google Scholar
• Lewis, Steven, and Bob Lingard. 2023. “Platforms, Profits and PISA for Schools: New Actors, by-Passes and Topological Spaces in Global Educational Governance.” Comparative Education 59 (1): 99–117. https://doi.org/10.1080/03050068.2022.2145006.
   Web of Science ®Google Scholar
• Lewis-Beck, Michael, Alan Bryman, and Tim Futing Liao, eds. 2004. The SAGE Encyclopedia of Social Science Research Methods. 3 vols. London, Thousand Oaks, New Delhi: SAGE Publications.
   Google Scholar
• Loveless, Tom. 2013. “International Tests Are Not All the Same.” The Brookings Institution (blog). 2013. http://www.brookings.edu/blogs/brown-center-chalkboard/posts/2013/01/09-timss-pisa-loveless.
   Google Scholar
• Martens, Kerstin. 2007. “How To Become an Influential Actor: The “Comparative Turn” in OECD Education Policy.” In New Arenas of Education Governance. The Impact of International Organizations and Markets on Educational Policy Making, edited by Kerstin Martens, Alessandra Rusconi, and Kathrin Leuze, 40–56. Basingstoke, New York: Palgrave Macmillan.
   Google Scholar
• Martens, Kerstin, and Dennis Niemann. 2013. “When Do Numbers Count? The Differential Impact of the PISA Rating and Ranking on Education Policy in Germany and the US.” German Politics 22 (3): 314–332. https://doi.org/10.1080/09644008.2013.794455.
   Web of Science ®Google Scholar
• Mello, Flavia de Campos. 2020. “The OECD Enlargement in Latin America and the Brazilian Candidacy.” Revista Brasileira de Política Internacional 63 (2), https://doi.org/10.1590/0034-7329202000211.
   Web of Science ®Google Scholar
• Meyer, Heinz-Dieter, and Aaron Benavot, eds. 2013. PISA, Power, and Policy: The Emergence of Global Educational Governance. Oxford: Symposium Books.
   Google Scholar
• Montoya, Silvia, and Brenda Tay-Lim. 2018. Options in Achieving Global Comparability for Reporting on SDG 4. Tempe, AZ: Center for Advance Studies in Global Education. https://doi.org/10.14507/casge3.2018.
   Google Scholar
• Moreno-Salto, Israel, and Susan Robertson. 2021. “On the ‘Life of Numbers’ in Governing Mexico’s Education System: A Multi-scalar Account of the OECD’s PISA.” Globalisation, Societies and Education 19 (2): 213–227. https://doi.org/10.1080/14767724.2021.1880882.
   Web of Science ®Google Scholar
• Niemann, Dennis., and Kerstin Martens. 2015. “Monitoring Standards of Education Worldwide: PISA and its Consequences.” In The SAGE Handbook of Research in International Education, edited by Mary Hayden, Jack Levy, and Jeff Thompson, (2nd edition), 487–497. London: SAGE.
   Google Scholar
• OECD. 1999. Measuring Student Knowledge and Skills. A New Framework for Assessment. Paris: OECD.
   Google Scholar
• OECD. 2004. OECD Handbook for Internationally Comparative Statistics. Concepts, Standards, Definitions and Classifications. Paris: OECD.
   Google Scholar
• OECD. 2010. PISA 2009 Results: Learning Trends. Paris: OECD. http://www.oecd-ilibrary.org/content/book/9789264091580-en.
   Google Scholar
• OECD. 2016. PISA 2015 Results (Volume I). Excellence and Equity in Education. Paris: OECD Publishing. https://doi.org/10.1787/9789264266490-en.
   Google Scholar
• OECD, and Statistics Canada. 2005. Learning a Living: First Results of the Adult Literacy and Life Skills Survey. Paris, Ottawa: OECD, Statistics Canada.
   Google Scholar
• Paúl, Fernanda. 2019. ““Es una tragedia”: los malos resultados de los países de América Latina en las pruebas PISA (y qué dicen sobre la educación en la región).” BBC News Mundo, 2019. https://www.bbc.com/mundo/noticias-america-latina-50685470.
   Google Scholar
• Pons, Xavier. 2012. “Going Beyond the ‘PISA Shock’ Discourse: An Analysis of the Cognitive Reception of PISA in Six European Countries, 2001–2008.” European Educational Research Journal 11 (2): 206–226. https://doi.org/10.2304/eerj.2012.11.2.206.
   Google Scholar
• Prais, Sig J. 2003. “Cautions on OECD’S Recent Educational Survey (PISA).” Oxford Review of Education 29 (2): 139–163. https://doi.org/10.1080/0305498032000080657.
   Web of Science ®Google Scholar
• Puryear, Jeffrey. M. 1995. “International Education Statistics and Research: Status and Problems.” International Journal of Educational Development 15 (1): 79–91. https://doi.org/10.1016/0738-0593(94)E0015-G.
   Web of Science ®Google Scholar
• Ravela, Pedro. 2011. ¿Qué hacer con los resultados de PISA en América Latina? Santiago de Chile: PREAL.
   Google Scholar
• Robertson, Susan. 2012. “Researching Global Education Policy: Angles In/On/Out … .” In Global Education Policy and International Development: New Agendas, Issues and Policies, edited by Antoni Verger, Mario Novelli, and Hulya Altinyelken, 33–51. London: Bloomsbury.
   Google Scholar
• Smith, Marshall. 2002. “Drawing Inferences for National Policy from Large-Scale Cross-National Education Surveys.” In Methodological Advances in Cross-National Surveys of Educational Achievement, edited by Andrew Porter, and Adam Gamoran, 295–317. Washington, DC: National Academy Press.
   Google Scholar
• Steiner-Khamsi, Gita. 2022. “What Is in a Reference? Theoretically Understanding the Uses of Evidence in Education Policy.” In Evidence and Expertise in Nordic Education Policy: A Comparative Network Analysis, edited by Berit Karseth, Kirsten Sivesind Berit, and Gita Steiner-Khamsi, 33–56. Cham, Switzerland: Palgrave Macmillan.
   Google Scholar
• Steiner-Khamsi, Gita, Kerstin Martens, and Christian Ydesen. 2024. “Governance by Numbers 2.0: Policy Brokerage as an Instrument of Global Governance in the Era of Information Overload.” Comparative Education, 1–18. https://doi.org/10.1080/03050068.2024.2308348.
   Web of Science ®Google Scholar
• Steiner-Khamsi, Gita, and Florian Waldow. 2018. “PISA for Scandalisation, PISA for Projection: The Use of International Large-scale Assessments in Education Policy Making – an Introduction.” Globalisation, Societies and Education 16 (5): 557–565. https://doi.org/10.1080/14767724.2018.1531234.
   Web of Science ®Google Scholar
• Suasnábar, Claudio. 2017. “Los ciclos de reforma educativa en América Latina: 1960, 1990 y 2000.” Revista Española de Educación Comparada 30: 112–135. https://doi.org/10.5944/reec.30.2017.19872.
   Google Scholar
• UNESCO. 2019. The Promise of Large-Scale Learning Assessments. Acknowledging Limits to Unlock Opportunities. Paris: UNESCO.
   Google Scholar
• UNESCO/UIS, and OECD. 2000. Investing in Education Analysis of the 1999 World Education Indicators. Paris, Montreal: UNESCO/UIS; OECD.
   Google Scholar
• United Nations. 2015. Transforming Our World: The 2030 Agenda for Sustainable Development (A/RES/70/1). New York: United Nations. http://www.un.org/ga/search/view_doc.asp?symbol=A/RES/70/1&Lang=E.
   Google Scholar
• Wolff, Lawrence. 2006. “Las evaluaciones educacionales en América Latina: Avance actual y futuros desafíos.” In Sobre estándares y evaluaciones en América Latina, edited by Patricia Arregui, 13–52. Santiago de Chile: PREAL.
   Google Scholar
• Ydesen, Christian, ed. 2019. The OECD’s Historical Rise in Education. The Formation of a Global Governing Complex. Global Histories of Education. Cham, Switzerland: Palgrave Macmillan.
   Google Scholar
• Ydesen, Christian, and Nanna Ramsing Enemark. 2023. “The OECD’s Boundary Work in Education in the United States and Brazil – a Historical Comparative Analysis of Two Federal States.” In The Oxford Handbook on Education and Globalization, edited by Paola Mattei, Eric Mangez Dumay, and Jacqueline Behrend, 498–517. Oxford: Oxford University Press.
   Google Scholar
• Ydesen, Christian, and Sotiria Grek. 2019. “Securing Organisational Survival: A Historical Inquiry into the OECD’s Work in Education during the 1960s.” Paedagogica Historica 56 (3): 412–427. https://doi.org/10.1080/00309230.2019.1604774.
   Web of Science ®Google Scholar