A Framework for Developing Comparable Multilingual Assessments for Minority Populations: Why Context Matters

REFERENCES

• Allen, M., & Cartwright, F. (2004). Systèmes scolaires pour les minorités linguistiques: Profil des élèves, des écoles et des collectivités (81-003-XIF). Ottawa, Canada: Statistique Canada. Retrieved from http://www.statcan.gc.ca/pub/81-003-x/81-003-x2002004-fra.pdf
   Google Scholar
• American Educational Research Association, American Psychological Association, & National Council of Measurement in Education. (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
   Google Scholar
• Baxter, G.P., & Glaser, R. (1998). Investigating the cognitive complexity of science assessments. Educational Measurement: Issues and Practices, 17(3), 37–45.
   Google Scholar
• Educational Testing Service. (2009a). ETS guidelines for the assessment of English-language learners. Princeton, NJ: ETS.
   Google Scholar
• Educational Testing Service. (2009b). ETS international principles for fairness review of assessments. Princeton, NJ: ETS.
   Google Scholar
• Ercikan, K., Arim, R.G., Law, D.M., Lacroix, S., Gagnon, F., & Domene, J.F. (2010). Application of think-aloud protocols in examining sources of differential item functioning. Educational Measurement: Issues and Practice, 29, 24–35.
   Google Scholar
• Ercikan, K., & Barclay-McKeown, S. (2007). Design and development issues in large-scale assessments: Designing assessments to provide useful information to guide policy and practice. Canadian Journal of Program Evaluation, 22, 53–71.
   Google Scholar
• Ercikan, K., & Lyons-Thomas, J. (2013). Adapting tests for use in other languages and cultures. In K. Geisinger (Ed.), APA handbook of testing and assessment in psychology (Vol. 15, pp. 545–569). Washington, DC: American Psychological Association.
   Google Scholar
• Ercikan, K., & McCreith, T. (2002). Effects of adaptations on comparability of test items and test scores. In D. Robitaille & A. Beaton (Eds.), Secondary analysis of the TIMSS results: A synthesis of current research (pp. 391–405). Dordrecht, The Netherlands: Kluwer Academic Publishers.
   Google Scholar
• Ercikan, K., Oliveri, M.E., & Sandilands, D. (2013). Large scale assessments of achievement in Canada. In J.A. C. Hattie & E.M. Anderman (Eds.), The international handbook of student achievement (pp. 456–459). New York, NY: Routledge.
   Google Scholar
• Ercikan, K., Simon, M., & Oliveri, M.E. (2012). Score comparability of multiple language versions of assessments within jurisdictions. In M. Simon, K. Ercikan, & M. Rousseau (Eds.), Improving large-scale assessment in education: Theory, issues and practice (pp. 110–124). New York, NY: Routledge/Taylor & Francis.
   Google Scholar
• Grisay, A., de Jong, J.H. A. L., Gebhardt, E., Berezner, A., & Halleux-Monseur, B. (2007). Translation equivalence across PISA countries. Journal of Applied Measurement, 8(3), 249–266.
   PubMedGoogle Scholar
• Hambleton, R.K. (2005). Issues, designs and technical guidelines for adapting tests into multiple languages and cultures. In R.K. Hambleton, P.F. Merenda, & C.D. Spielberger (Eds.), Adapting psychological and educational tests for cross-cultural assessment (pp. 3–28). Hillsdale, NJ: Lawrence Erlbaum.
   Google Scholar
• Hambleton, R.K., Merenda, P., & Spielberger, C. (Eds.). (2005). Adapting educational and psychological tests for cross-cultural assessment. Hillsdale, NJ: Lawrence Erlbaum.
   Google Scholar
• Hambleton, R.K., & Patsula, L. (1999). Increasing the validity of adapted tests: Myths to be avoided and guidelines for improving test adaptation practices. Journal of Applied Testing Technology, 1(1), 1–30.
   Google Scholar
• International Test Commission. (2010). International test commission guidelines for translating and adapting tests. Retrieved from http://www.intestcom.org/guidelines
   Google Scholar
• Kane, M.T. (2013). Validating the interpretations and uses of test scores. Journal of Educational Measurement, 50(1), 1–73. doi: 10.1111/jedm.12000
   Web of Science ®Google Scholar
• Klinger, D.A., & Rogers, W.T. (2011). Teachers' perceptions of large-scale assessment programs within low-stakes accountability frameworks. International Journal of Testing, 11(2), 122–143.
   Google Scholar
• Lin, J., & Rogers, W.T. (2005). Validity of the simultaneous approach to the development of equivalent achievement tests in English and French (stage II). Poster presentation at the Annual Conference for Measurement in Education, Montreal, Canada.
   Google Scholar
• Mislevy, R.J., & Yin, C. (2009). If language is a complex adaptive system, what is language testing? Language Learning, 59, 249–267.
   Web of Science ®Google Scholar
• Oliveri, M.E., & Ercikan, K. (2011). Do different approaches to examining construct comparability lead to similar conclusions? Applied Measurement in Education, 24, 349–366.
   Web of Science ®Google Scholar
• Oliveri, M.E., Ercikan, K., Lyons-Thomas, J., & Holtzman, S. (in press). Heterogeneity in linguistic groups and measurement comparability research. Applied Measurement in Education.
   Google Scholar
• Performance of Canada's youth in science, reading and mathematics. (2007). Retrieved from http://www.statcan.gc.ca/daily-quotidien/071205/dq071205b-eng.htm
   Google Scholar
• Rogers, W.T., Gierl, M.J., Tardif, C., Lin, J., & Rinaldi, C.M. (2003). Differential validity and utility of successive and simultaneous approaches to the development of equivalent achievement tests in French and English. Alberta Journal of Educational Research, 49(3), 290–304.
   Google Scholar
• Rogers, W.T., Lin, J., & Rinaldi, C.M. (2011). Validity of the simultaneous approach to the development of equivalent achievement tests in English and French. Applied Measurement in Education, 24, 39–70.
   Web of Science ®Google Scholar
• Simon, M., van Barneveld, C., King, S., & Nadon, C. (May, 2011). Having large-scale assessment results ‘count’ for students’ final grades: A matter of policy. Paper presented at the annual meeting of the Canadian Society for the Study of Education, Fredericton, New Brunswick, Canada.
   Google Scholar
• Solano-Flores, G. (2008). Who is given tests in what language by whom, when, and where? The need for probabilistic views of language in the testing of English language learners. Educational Researcher, 37(4), 189–199.
   Web of Science ®Google Scholar
• Solano-Flores, G., Backhoff, E., & Contreras-Nino, L.A. (2009). Theory of test translation error. International Journal of Testing, 9(2), 78–91.
   Google Scholar
• Solano-Flores, G., Trumbull, E., & Nelson-Barber, S. (2002). Concurrent development of dual language assessments: An alternative to translating test for linguistic minorities. International Journal of Testing, 2(2), 107–129.
   Google Scholar
• Spielberger, C.D., Moscoso, M.S., & Brunner, T.M. (2005). Cross-cultural assessment of emotional states and personality traits. In R.K. Hambleton, C.D. Spielberger, & P.F. Merenda (Eds.), Adapting educational and psychological tests for crosscultural assessment (pp. 343–368). Hillsdale, NJ: Lawrence Erlbaum.
   Google Scholar
• Tanzer, N.K. (2005). Developing tests for use in multiple languages and cultures: A plea for simultaneous development. In R.K. Hambleton, P.F. Merenda, & C.D. Spielberger (Eds.). Adapting psychological and educational tests for cross-cultural assessment (pp. 235–263). Mahwah, NJ: Lawrence Erlbaum.
   Google Scholar