Assembled validity: rethinking Kane’s argument-based approach in the context of International Large-Scale Assessments (ILSAs)

References

• Addey, C. (2017). Golden relics & historical standards: How the OECD is expanding global education governance through PISA for Development. Critical Studies in Education, 58(3), 311–325, 600. https://doi.org/10.1080/17508487.2017.1352006
   Google Scholar
• Addey, C. 2019a. Researching inside the international testing machine: PISA parties, midnight emails & red shoes. In B. Maddox (Ed.), International large-scale assessments in education. Insider research perspectives (pp. 13–29). London: Bloomsbury.
   Google Scholar
• Addey, C. 2019b. The appeal of PISA for development in Ecuador and Paraguay: Theorising and applying the global ritual of belonging. Compare: A Journal of Comparative and International Education. https://doi.org/10.1080/03057925.2019.1623653
   Google Scholar
• Addey, C., & Sellar. S. E. (2019). Is it worth it? Rationales for (Non)participation in international large-scale learning assessments [Education Research and Foresight Working Papers Series, No. 24]. Paris: UNESCO. 268820. https://en.unesco.org/node/.268820
   Google Scholar
• Addey, C., Sellar, S., Steiner-Khamsi, G., Lingard, B., & Verger, A. (2017). The rise of international large-scale assessments and rationales for participation. Compare: A Journal of Comparative and International Education,47(3), 434–452.https://doi.org/10.1080/03057925.2017.1301399
   Google Scholar
• Auld, E., Rappleye, J., & Morris, P. (2019). PISA for development: How the OECD and World Bank shaped education governance post-2015. Comparative Education, 55(2), 197–219. https://doi.org/10.1080/03050068.2018.1538635
   Web of Science ®Google Scholar
• Bachman, L. F. (2005). Building and supporting a case for test use. Language Assessment Quarterly, 2(1), 1–34.
   Google Scholar
• Bloem, S. (2013). PISA in low and middle income countries. Paris: OECD Publishing.
   Google Scholar
• Bloem, S. (2015). PISA for low- and middle-income countries. Compare: A Journal of Comparative and International Education 45(3), 481–486.
   Web of Science ®Google Scholar
• Callon, M. (1986). Some elements of a sociology of translation: Domestication of the scallops and the Fishermen of Saint Brieuc Bay. In J. Law (Ed.), Power, action and belief: A new sociology of knowledge? Sociological Review Monograph, 32 (pp. 196–233). London: Routledge and Kegan Paul.
   Google Scholar
• Callon, M., Lascoumes, P., & Barthe, Y. (2009). Acting in an uncertain world: An essay on technical democracy. Cambridge, MA: MIT Press.
   Google Scholar
• Camilla, A., & Gorur, R. (2020). Translating PISA, translating the world. Comparative Education. https://doi.org/10.1080/03050068.2020.1771873
   Google Scholar
• Chakraborty, S., Elde Mølstad, C., Feng, J., & Pettersson, D. (2019). The reception of large-scale assessments in China and India. In New practices of comparison, quantification and expertise in education: Conducting empirically based research. London & New York: Routledge.
   Google Scholar
• Chapelle, C. A., Enright, M. K., & Jamieson, J. (2010). Does an argument-based approach to validity make a difference? Educational Measurement: Issues and Practice, 29(1), 3–13. https://doi.org/10.1111/j.1745-3992.2009.00165.x
   Google Scholar
• Cronbach, L. J. (1988). Five perspectives on validity argument. In H. Wainer & H. Braun (Eds.), Test validity (pp. 3–17). Lawrence Erlbaum.
   Google Scholar
• Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52(4), 281–302. https://doi.org/10.1037/h0040957
   PubMed Web of Science ®Google Scholar
• Deleuze, G., & Guattari, F. (1983). Anti‐Oedipus ( Brian Massumi, Trans.). University of Minnesota Press.
   Google Scholar
• Goffman, E. (1959). The presentation of self in everyday life. New York: Doubleday, Anchor Books.
   Google Scholar
• Gorur, R. (2011). ANT on the PISA Trail: Following the statistical pursuit of certainty.Educational Philosophy and Theory 43(S1), 76–93.
   Web of Science ®Google Scholar
• Gorur, R., Sorensen, E., & Maddox, B. (2019). Standardizing the context and contextualizing the standard: Translating PISA into PISA-D). In M. Prutsch (Ed.), Working numbers: Science and contemporary politics. Basingstoke: Palgrave-Macmillan.
   Google Scholar
• House, E. (1980). Evaluating with validity. Sage.
   Google Scholar
• House, E. R. (1990). Trends in Evaluation. Educational Researcher, 19(3), 24–28.
   Google Scholar
• Hubley, A. M., & Zumbo, B. D. (2011). Validity and the consequences of test interpretation and use. Social Indicators Research: An International Interdisciplinary Journal for Quality of Life Measurement, 103, 219–230. http://dx.doi.org/10.1007/s11205-011-9843-4
   Google Scholar
• Kane, M. T. (1992). An argument-based approach to validity. Psychological Bulletin, 112(3), 272–235. https://doi.org/10.1037/0033-2909.112.3.527
   Web of Science ®Google Scholar
• Kane, M. T. (2001). Current concerns in validity theory. Journal of Educational Measurement, 38(4), 319–342. https://doi.org/10.1111/j.1745-3984.2001.tb01130.x
   Web of Science ®Google Scholar
• Kane, M. T. (2004). Certification testing as an illustration of argument-based validation. Measurement: Interdisciplinary Research and Perspectives, 2(1), 135–170. https://doi.org/10.1111/jedm.12000
   Google Scholar
• Kane, M. T. (2013, Spring). Validating the interpretations and uses of test scores’. Journal of Educational Measurement, 50(1), [ Special issue on validity], 1–73. https://doi.org/10.1111/jedm.12000
   Web of Science ®Google Scholar
• Kane, M. T. (2016). Explicating validity. Assessment in Education:Principles,Policy & Practice, 23(2), 198–211. https://doi.org/10.1080/0969594X.2015.1060192
   Web of Science ®Google Scholar
• Latour, B. (1987). Science in action. Open University Press.
   Google Scholar
• Latour,B. (1992). Where are the missing masses: The sociology of a few mundane artefacts. In W. E. Bijker & J. Law (Eds.), Shaping technology/building society: studies in sociotechnical change (pp. 225–258). MIT Press.
   Google Scholar
• Latour, B. (1993). The pasteurization of France. Harvard University Press.
   Google Scholar
• Latour, B. (2005). Reassembling the social: An introduction to actor-network-theory. Oxford University Press.
   Google Scholar
• Law, J. (Ed.). (1991). A sociology of monsters: Essays on power, technology, and domination. London: Routledge.
   Google Scholar
• Messick, S. (1980). Test validity and the ethics of assessment. American Psychologist, 35(11), 1012–1027. https://doi.org/10.1037/0003-066X.35.11.1012
   Google Scholar
• Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 13–103). Macmillan.
   Google Scholar
• Messick, S. (1995). Validity of psychological assessment. Validation of inferences from persons' responses and performance as scientific Inquiry into score meaning.. American Psychologist, 50(9), 474–479. https://doi.org/10.1037/0003-066X.50.9.741
   Web of Science ®Google Scholar
• Moll, A. (2002). The body multiple. Duke University Press.
   Google Scholar
• Newton, P. E. (2012). Clarifying the consensus definition of validity. Measurement, 10, 1–29.
   Google Scholar
• Newton, P. E., &Shaw, S. D. (2014). Validity in educational and psychological assessment. London: Cambridge Assessment and Sage.
   Google Scholar
• OECD. (2013). The OECD’s contribution on education to the post-2015 framework: Pisa for development. OECD and post-2015reflection series. Paris.
   Google Scholar
• OECD. (2014). The OECD’s contribution on education to the post-2015 framework: PISA for development.
   Google Scholar
• OECD. (2016). PISA for development (Brochure).
   Google Scholar
• OECD (2018, August). ‘PISA for development construct validity’, (PISA-D Policy Brief, number 24).
   Google Scholar
• OECD. (2019). PISA 2021 national project manager manual. Paris: OECD Publishing.
   Google Scholar
• OECD (2020). PISA Technical Report.
   Google Scholar
• Rawls, J. (1971). A theory of justice. Harvard University Press.
   Google Scholar
• Schaffner, K. F. (2020). A comparison of two neurobiological models of fear and anxiety: A “construct validity” application? Perspectives on Psychological Science, 15(5), 1214–1227. https://doi.org/10.1177/1745691620920860
   Web of Science ®Google Scholar
• Scot, J. (1990). Domination and the arts of resistance. Yale University Press.
   Google Scholar
• Steiner-Khamsi, G. (2014). Cross-national policy borrowing: Understanding reception and translation. Asia Pacific Journal of Education, 34(2), 153–167. https://doi.org/10.1080/02188791.2013.875649
   Web of Science ®Google Scholar
• Steiner-Khamsi, G., & Waldow, F. (2018). PISA for scandalisation, PISA for projection: The use of international large-scale assessments in education policy making – An introduction. Globalisation, Societies and Education, 16(5), 557–565. https://doi.org/10.1080/14767724.2018.1531234
   Web of Science ®Google Scholar
• Stone, J., & Zumbo, B. D. (2016). Validity as a pragmatist project: A global concern with local application. In Aryadoust V., &Fox J. (Eds.), Trends in language assessment research and practice (pp. 555–573). Newcastle: Cambridge Scholars Publishing.
   Google Scholar
• Toulmin, S. (1958). The uses of argument. Cambridge University Press.
   Google Scholar
• Toulmin, S. (1972). Human understanding. Princeton University Press.
   Google Scholar
• Toulmin, S. (1990). Cosmopolis: The hidden agenda of modernity. The University of Chicago Press.
   Google Scholar
• Zumbo, B. D. (2009). Validity as contextualized and pragmatic explanation, and its implications for validation practice. In Lissitz R. W. (Ed.), The concept of validity: Revisions, new directions and applications (pp. 65–82). Charlotte, NC: IAP – Information Age Publishing, Inc.
   Google Scholar
• Zumbo, B. D. (2017). Trending away from routine procedures, towards an ecologically informed ‘in vivo’ view of validation practices. Measurement: Interdisciplinary Research and Perspectives, 15(3–4), 137–139. https://doi.org/10.1080/15366367.2017.1404367
   Google Scholar
• Zumbo, B. D., & Hubley, A. M. (2016). Bringing consequences and side effects of testing and assessment to the foreground. Assessment in Education: Principles, Policy & Practice, 23, 299–303. https://doi.org/10.1080/0969594X.2016.1141169
   Web of Science ®Google Scholar