Validity Issues in Assessing Linguistic Minorities

REFERENCES

• Allalouf, A., & Abramzon, A. (2008). Constructing better second language assessments based on differential item functioning analysis. Language Assessment Quarterly, 5(2), 120–141. doi: 10.1080/15434300801934710
   Web of Science ®Google Scholar
• Allalouf, A., Rapp, J., & Stoller, R. (2009). What item types are best suited to the linking of verbal adapted tests? International Journal of Testing, 9, 92–107.
   Google Scholar
• American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
   Google Scholar
• American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
   Google Scholar
• Australian Government, Department of Immigration and Citizenship. (2011). Settler arrivals, 2000-01 to 2010-11: Australia states and territories. Retrieved from http://www.immi.gov.au/media/publications/statistics/settler-arrivals/settler-arrivals-2010-11.pdf
   Google Scholar
• Clauser, B. E., & Mazor, K. M.
   Google Scholar
• Faulkner-Bond, M., Shin, M., Wang, X., Zenisky, A.L., & Moyer, E. (2013). Score reports for English proficiency assessments: Current practices and future directions. Presented at the National Council on Measurement in Education, San Francisco, CA.
   Google Scholar
• Haladyna, T.M., & Rodriguez, M.C. (2014). Developing and validating test items. New York, NY: Routledge.
   Google Scholar
• Hambleton, R.K. (2005). Issues, designs, and technical guidelines for adapting tests into multiple languages and cultures. In R.K. Hambleton, P.F. Merenda, & C.D. Spielberger (Eds.), Adapting educational and psychological tests for cross-cultural assessment (pp. 3–39). Mahwah, NJ: L. Erlbaum Associates.
   Google Scholar
• Hambleton, R. K., Merenda, P. F., & Spielberger, C. D. (2005). Adapting educational and psychological tests for cross-cultural assessment. Mahwah, NJ: L. Erlbaum Associates.
   Google Scholar
• Hambleton, R.K., & Zenisky, A.L. (2011). Translating and adapting tests for cross-cultural assessments. In D. Matsumoto & F.J. R. van de Vijver (Eds.), Cross-cultural research methods in psychology (pp. 46–75). Cambridge, UK: Cambridge University Press.
   Google Scholar
• Holland, P.W., Wainer, H., & Educational Testing Service. (1993). Differential item functioning. Hillsdale, NJ: Lawrence Erlbaum Associates.
   Google Scholar
• Kane, M.T. (2013). Validating the interpretations and uses of test scores. Journal of Educational Measurement, 50(1), 1–73. doi: 10.1111/jedm.12000
   Web of Science ®Google Scholar
• Kane, M.T., & Mroch, A.A. (2010). Modeling group differences in OLS and orthogonal regression: Implications for differential validity studies. Applied Measurement in Education, 23(3), 215–241. doi: 10.1080/08957347.2010.485990
   Web of Science ®Google Scholar
• Kieffer, M.J., Lesaux, N.K., Rivera, M., & Francis, D.J. (2009). Accommodations for English language learners taking large-scale assessments: A meta-analysis on effectiveness and validity. Review of Educational Research, 79(3), 1168–1201.
   Web of Science ®Google Scholar
• Kim, M. (2001). Detecting DIF across the different language groups in a speaking test. Language Testing, 18(1), 89–114.
   Google Scholar
• Kopriva, R.J. (2011, April). The promise of demonstration-based interactive test task environments for struggling readers and English learners. Paper presented at the Annual Meeting of the National Council of Measurement in Education, New Orleans, LA.
   Google Scholar
• Kopriva, R.J., Emick, J.E., Hipolito-Delgado, C.P., & Cameron, C.A. (2007). Do proper accommodation assignments make a difference? Examining the impact of improved decision making on scores for English language learners. Educational Measurement: Issues and Practice, 26(3), 11–20.
   Google Scholar
• Linn, R.L. (1984). Selection bias: Multiple meanings. Journal of Educational Measurement, 21, 33–47.
   Web of Science ®Google Scholar
• Messick, S. (1989). Validity. In R. Linn (Ed.), Educational measurement (3rd ed., pp. 13–100). Washington, DC: American Council on Education.
   Google Scholar
• National Center for Education Statistics. (2011). Documentation to the NCES Common Core Data Local Education Agency Universe Survey: School year 2009–2010. Washington, DC: Institute of Education Sciences, US Department of Education.
   Google Scholar
• Parker, C., Louie, J., & O’Dwyer, L. (2009). New measures of English language proficiency and their relationship to performance on large-scale content assessments (Issues & Answers Report No. REL 2009–No. 066). Washington, DC: US Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance, Regional Educational Laboratory Northeast and Islands. Retrieved from http://ies.ed.gov/ncee/edlabs
   Google Scholar
• Pearson. (n.d.). About us: Education. Retrieved from http://www.pearson.com/about-us/education/
   Google Scholar
• Pennock-Roman, M. (2002). Relative effects of English proficiency on general admissions tests versus subject tests. Research in Higher Education, 43, 601–623.
   Web of Science ®Google Scholar
• Pennock-Roman, M., & Rivera, C. (2011). Mean effects of test accommodations for ELLs and non-ELLs: A meta-analysis of experimental studies. Educational Measurement: Issues and Practice, 30(3), 10–28.
   Google Scholar
• Ramos, R. A. (1992). Testing and assessment of Hispanics for occupational and management positions: A developmental needs analysis. In K. F. Geisinger (Ed.), Psychological testing of Hispanics (pp. 173–194). Washington, DC: American Psychological Association.
   Google Scholar
• Ramsey, P.A. (1993). Sensitivity review: The ETS experience as a case study. In P.W. Holland & H. Wainer (Eds.), Differential item functioning (pp. 367–388). Hillsdale, NJ: Erlbaum.
   Google Scholar
• Schmitt, A.P., & Dorans, N.J. (1990). Differential item functioning for minority examinees on the SAT. Journal of Educational Measurement, 27(1), 67–81.
   Web of Science ®Google Scholar
• Sireci, S.G. (2011). Evaluating test and survey items for bias across languages and cultures. In D. Matsumoto and F. van de Vijver (Eds.), Cross-cultural research methods in psychology (pp. 216–240). Oxford, UK: Oxford University Press.
   Google Scholar
• Sireci, S.G., & Faulkner-Bond, M. (in press). Promoting validity in the assessment of English learners. Review of Research in Education.
   Google Scholar
• Sireci, S.G., Han, K.T., & Wells, C.S. (2008). Methods for evaluating the validity of test scores for English language learners. Educational Assessment, 13, 108–131.
   Google Scholar
• Sireci, S.G., & Mullane, L.A. (1994). Evaluating test fairness in licensure testing: The sensitivity review process. CLEAR Exam Review, 5(2), 22–28.
   Google Scholar
• Sireci, S.G., & Wells., C.S. (2010). Evaluating the comparability of English and Spanish video accommodations for English language learners. In P. Winter (Ed.), Evaluating the comparability of scores from achievement test variations (pp. 33–68). Washington, DC: Council of Chief State School Officers.
   Google Scholar
• Swanson, C.B. (2009). Perspectives on a population: English-language learners in American schools. Bethesda, MD: Editorial Projects in Education Research Center.
   Google Scholar
• Tilburg University. (n.d.). About Tilburg University. Retrieved from http://www.tilburguniversity.edu/about-tilburg-university/
   Google Scholar
• van der Vijver, F., & Hambleton, R.K. (1996). Translating tests: Some practical guidelines. European Psychologist, 1(2), 89–99.
   Web of Science ®Google Scholar
• Wainer, H., & Sireci, S.G. (2005). Item and test bias. In K. Kempf-Leonard (Ed.), Encyclopedia of social measurement (Vol. 15, pp. 365–371). San Diego, CA: Elsevier.
   Google Scholar
• Winke, P., Gass, S., & Myford, C. (2011). The relationship between raters’ prior language study and the evaluation of foreign language speech samples (ETS Research Report No. RR-11-30, TOEFL iBT-16). Princeton, NJ: Educational Testing Service.
   Google Scholar
• Wolf, M.K., & Leon, S. (2009). An investigation of the language demands in content assessments for English language learners. Educational Assessment, 14(3–4), 139–159. doi: 10.1080/10627190903425883
   Google Scholar
• Yu, A., & Ebbs, D. (2012). Translation and translation verification of the PIRLS reading assessment and questionnaires. In M.O. Martin & I.V. S. Mullis (Eds.), Methods and procedures in TIMSS and PIRLS 2011. Chestnut Hill, MA: TIMSS & PIRLS International Study Center, Boston College. Retrieved from http://timssandpirls.bc.edu/methods/index.html
   Google Scholar
• Zwick, R., & Schlemer, L. (2004). SAT validity for linguistic minorities at the University of California, Santa Barbara. Educational Measurement: Issues and Practice, 23(1), 6–16.
   Google Scholar