Assessment of English Learners and Their Peers in the Content Areas: Expanding What “Counts” as Evidence of Content Learning

References

• Abedi, J., Hofstetter, C., & Lord, C. (2004). Assessment accommodations for English language learners. Implications for policy-based empirical research. Review of Educational Research, 74(1), 1–28. https://doi.org/10.3102/00346543074001001
   Web of Science ®Google Scholar
• Alim, H. S., & Paris, D. (2017). Culturally sustaining pedagogies: Teaching and learning for justice in a changing world. Teachers College Press.
   Google Scholar
• Altherr Flores, J. (2021). The interplay of text and image on the meaning-making processes of adult L2 learners with emerging literacy: Implications for test design and evaluation frameworks. Language Assessment Quarterly, 18(5), 508–529. https://doi.org/10.1080/15434303.2021.1984491
   Web of Science ®Google Scholar
• Anderson, K., & Kachorsky, D. (2019). Assessing students’ multimodal compositions: An analysis of the literature. English Teaching: Practice & Critique, 18(3), 312–334. https://doi.org/10.1108/ETPC-11-2018-0092
   Web of Science ®Google Scholar
• Ascenzi-Moreno, L. (2018). Translanguaging and responsive assessment adaptations: Emergent bilingual readers through the lens of possibility. Language Arts, 95(6), 355–369. https://www.jstor.org/stable/26779020
   Google Scholar
• Ascenzi-Moreno, L., & Seltzer, K. (2021). Always at the bottom: Ideologies in assessment of emergent bilinguals. Journal of Literacy Research, 53(4), 468–490. https://doi.org/10.1177/1086296X211052255
   Web of Science ®Google Scholar
• Bailey, A. L., & Heritage, M. (2014). The role of language learning progressions in improved instruction and assessment of English language learners. TESOL Quarterly, 48(3), 480–506. https://doi.org/10.1002/tesq.176
   Web of Science ®Google Scholar
• Beltrán-Planques, V., & Querol-Julián, M. (2018). English language learners’ spoken interaction: What a multimodal perspective reveals about pragmatic competence. System, 77, 80–90. https://doi.org/10.1016/j.system.2018.01.008
   Web of Science ®Google Scholar
• Buxton, C., Harman, R., Cardozo-Gaibisso, L., Jiang, L., Bui, K., & Allexsaht-Snider, M. (2019). Understanding science and language connections: New approaches to assessment with bilingual learners. Research in Science Education, 49(4), 977–988. https://doi.org/10.1007/s11165-019-9846-8
   Web of Science ®Google Scholar
• Choi, I., Wolf, M., Pooler, E., Sova, L., & Faulkner-Bond, M. (2019). Investigating the benefits of scaffolding in assessments of young English learners: A case for scaffolded retell tasks. Language Assessment Quarterly, 16(2), 161–179. https://doi.org/10.1080/15434303.2019.1619180
   Web of Science ®Google Scholar
• Clark-Gareca, B. (2016). Classroom assessment and English language learners: Teachers’ accommodations implementation on routine math and science tests. Teaching and Teacher Education, 54, 139–148. https://doi.org/10.1016/j.tate.2015.11.003
   Web of Science ®Google Scholar
• Cobb, P., Confrey, J., diSessa, A., Lehrer, R., & Schauble, L. (2003). Design experiments in educational research. Educational Researcher, 32(1), 9–13. https://doi.org/10.3102/0013189X032001009
   Google Scholar
• De Backer, F., Baele, J., van Avermaet, P., & Slembrouck, S. (2019). Pupils’ perceptions on accommodations in multilingual assessment of science. Language Assessment Quarterly, 16(4–5), 426–446. https://doi.org/10.1080/15434303.2019.1666847
   Web of Science ®Google Scholar
• DeBarger, A. H., Penuel, W. R., Harris, C. J., & Kennedy, C. A. (2016). Building an assessment argument to design and use next generation science assessments in efficacy studies of curriculum interventions. American Journal of Evaluation, 37(2), 174–192. https://doi.org/10.1177/1098214015581707
   Web of Science ®Google Scholar
• Fernandes, A., Kahn, L. H., & Civil, M. (2017). A closer look at bilingual students’ use of multimodality in the context of an area comparison problem from a large-scale assessment. Educational Studies in Mathematics, 95(3), 263–282. https://doi.org/10.1007/s10649-017-9748-5
   Web of Science ®Google Scholar
• Fine, C. (2022). Translanguaging interpretive power in formative assessment co-design: A catalyst for science teacher agentive shifts. Journal of Language, Identity and Education, 21(3), 191–211. https://doi.org/10.1080/15348458.2022.2058858
   Web of Science ®Google Scholar
• Fine, C., & Furtak, E. (2020). A framework for science classroom assessment task design for emergent bilingual learners. Science Education, 104(3), 393–420. https://doi.org/10.1002/sce.21565
   Web of Science ®Google Scholar
• Gordon, E. (2020). Toward assessment in the service of learning. Educational Measurement: Issues and Practice, 39(3), 72–78. https://doi.org/10.1111/emip.12370
   Web of Science ®Google Scholar
• Gordon Commission. (2013). To assess, to teach, to learn: A vision for the future of assessment. Educational Testing Service. https://www.ets.org/Media/Research/pdf/gordon_commission_technical_report.pdf
   Google Scholar
• Gorin, J. S., & Mislevy, R. J. (2013). Inherent measurement challenges in the next generation science standards for both formative and summative assessment. Educational Testing Service. https://www.ets.org/Media/Research/pdf/gorin-mislevy.pdf
   Google Scholar
• Grapin, S. E. (2019). Multimodality in the new content standards era: Implications for English learners. TESOL Quarterly, 53(1), 30–55. https://doi.org/10.1002/tesq.443
   Web of Science ®Google Scholar
• Grapin, S. E. (2022). Are we missing part of the picture? Assessing English learners in science from a multimodal perspective. In M. A. Christison, J. Crandall, & D. Christian (Eds.), Research on integrating language and content in diverse contexts (pp. 38–52). Routledge.
   Google Scholar
• Grapin, S. E., & Llosa, L. (2022a). Dynamic assessment of English learners in the content areas: An exploratory study in fifth-grade science. TESOL Quarterly, 56(1), 201–229. https://doi.org/10.1002/tesq.3059
   Web of Science ®Google Scholar
• Grapin, S. E., & Llosa, L. (2022b). Multimodal tasks to assess English learners and their peers in science. Educational Assessment, 27(1), 46–70. https://doi.org/10.1080/10627197.2022.2028139
   Web of Science ®Google Scholar
• Grapin, S. E., Llosa, L., & Lee, O. (2022b). Disciplinary practices with multilingual learners in the content areas: Investigating grasp of practice in fifth-grade science. Journal of Language, Identity and Education, 1–16. https://doi.org/10.1080/15348458.2021.2008253
   Google Scholar
• Hafner, C., & Ho, W. Y. (2020). Assessing digital multimodal composing in second language writing: Toward a process-based model. Journal of Second Language Writing, 47, 1–14. https://doi.org/10.1016/j.jslw.2020.100710
   Web of Science ®Google Scholar
• Hakuta, K. (2013). Assessment of content and language in light of the new standards: Challenges and opportunities for English language learners. Educational Testing Service. https://www.ets.org/Media/Research/pdf/hakuta_assessment_content_language_standards_challenges_opportunities.pdf
   Google Scholar
• Harman, R., Buxton, C., Cardozo-Gaibisso, L., Jiang, L., & Bui, K. (2021). Culturally sustaining systemic functional linguistics praxis in science classrooms. Language and Education, 35(2), 106–122. https://doi.org/10.1080/09500782.2020.1782425
   Web of Science ®Google Scholar
• Harris, C., Krajcik, J., Pellegrino, J., & DeBarger, A. (2019). Designing knowledge-in-use assessments to promote deeper learning. Educational Measurement: Issues and Practice, 38(2), 53–67. https://doi.org/10.1111/emip.12253
   Web of Science ®Google Scholar
• Heller, R., Wolfe, R., & Steinberg, A. (Eds.). (2014). Rethinking readiness: Deeper learning for college, work, and life. Harvard University Press.
   Google Scholar
• Heritage, M., Walqui, A., & Linquanti, R. (2015). English language learners and the new standards: Developing language, content knowledge, and analytical practices in the classroom. Harvard Education Press.
   Google Scholar
• Heritage, M., & Wylie, E. C. (2020). Formative assessment in the disciplines: Framing a continuum of professional learning. Harvard Education Press.
   Google Scholar
• Kieffer, M. J., Lesaux, N., Rivera, M., & Francis, D. J. (2009). Accommodations for English language learners taking large-scale assessments: A meta-analysis on effectiveness and validity. Review of Educational Research, 79(3), 1168–1201. https://doi.org/10.3102/0034654309332490
   Web of Science ®Google Scholar
• Kress, G., Jewitt, C., Ogborn, J., & Tsatsarelis, C. (2014). Multimodal teaching and learning: The rhetorics of the science classroom (2nd ed.). Bloomsbury Academic.
   Google Scholar
• Lee, O., Llosa, L., Grapin, S. E., Haas, A., & Goggins, M. (2019). Science and language integration with English learners: A conceptual framework guiding instructional materials development. Science Education, 103(2), 317–337. https://doi.org/10.1002/sce.21498
   Web of Science ®Google Scholar
• Leung, C. (2007). Dynamic assessment: Assessment for and as teaching? Language Assessment Quarterly, 4(3), 257–278. https://doi.org/10.1080/15434300701481127
   Google Scholar
• Li, W. (2022). Translanguaging as method. Research Methods in Applied Linguistics, 1(3), 1–4. https://doi.org/10.1016/j.rmal.2022.100026
   Google Scholar
• Li, W., & García, O. (2022). Not a first language but one repertoire: Translanguaging as a decolonizing project. RELC Journal, 53(2), 313–324. https://doi.org/10.1177/00336882221092841
   Web of Science ®Google Scholar
• Lim, J., & Polio, C. (2020). Multimodal assignments in higher education: Implications for multimodal writing tasks for L2 writers. Journal of Second Language Writing, 47, 1–8. https://doi.org/10.1016/j.jslw.2020.100713
   Web of Science ®Google Scholar
• Lopez, A., Guzman-Orth, D., Zapata-Rivera, D., Forsyth, C., & Luce, C. (2021). Examining the accuracy of a conversation-based assessment in interpreting English learners’ written responses (Research Report No. RR-21-03). Educational Testing Service. https://doi.org/10.1002/ets2.12315
   Google Scholar
• Lopez, A., Turkan, S., & Guzman-Orth, D. (2017). Conceptualizing the use of translanguaging in initial content assessments for newly arrived emergent bilingual students (Research Report No. RR-17-07). Educational Testing Service. https://doi.org/10.1002/ets2.12140
   Google Scholar
• Martiniello, M. (2009). Linguistic complexity, schematic representations, and differential item functioning for English language learners in math tests. Educational Assessment, 14(3–4), 160–179. https://doi.org/10.1080/10627190903422906
   Google Scholar
• Moll, L., Amanti, C., Neff, D., & González, N. (1992). Funds of knowledge for teaching: Using a qualitative approach to connect homes and classrooms. Theory Into Practice, 31(2), 132–141. https://doi.org/10.1080/00405849209543534
   Google Scholar
• National Academies of Sciences, Engineering, and Medicine. (2018). English learners in STEM subjects. Transforming classrooms, schools, and lives. National Academies Press. https://www.nap.edu/catalog/25182/english-learners-in-stem-subjects-transforming-classrooms-schools-and-lives
   Google Scholar
• National Center for Education Statistics. (2021). The condition of education 2021 ( NCES 2021-144). U.S. Department of Education. https://nces.ed.gov/programs/coe/indicator/cgf
   Google Scholar
• National Governors Association Center for Best Practices & Council of Chief State School Officers. (2010a). Common core state standards for English language arts and literacy in history/social studies, science, and technical subjects. http://www.corestandards.org/ELA-Literacy/
   Google Scholar
• National Governors Association Center for Best Practices & Council of Chief State School Officers. (2010b). Common core state standards for mathematics. http://www.corestandards.org/Math/
   Google Scholar
• National Research Council. (2014). Developing assessments for the next generation science standards. National Academies Press. https://nap.nationalacademies.org/catalog/18409/developing-assessments-for-the-next-generation-science-standards
   Google Scholar
• Next Generation Science Standards Lead States. (2013). Next generation science standards: For states, by states. National Academies Press. https://www.nextgenscience.org
   Google Scholar
• Noble, T., Sireci, S., Wells, C., Kachchaf, R., Rosebery, A., & Wang, Y. (2020). Targeted linguistic simplification of science test items for English learners. American Educational Research Journal, 57(5), 2175–2209. https://doi.org/10.3102/0002831220905562
   Web of Science ®Google Scholar
• Otheguy, R., García, O., & Reid, W. (2015). Clarifying translanguaging and deconstructing named languages: A perspective from linguistics. Applied Linguistics Review, 6(3), 281–307. https://doi.org/10.1515/applirev-2015-0014
   Web of Science ®Google Scholar
• Park, Y., Lee, S., & Shin, S. Y. (2022). Developing a local academic English listening test using authentic unscripted audio-visual texts. Language Testing, 39(3), 401–424. https://doi.org/10.1177/02655322221076024
   Web of Science ®Google Scholar
• Pellegrino, J. (2020). Important considerations for assessment to function in the service of education. Educational Measurement: Issues and Practice, 39(3), 81–85. https://doi.org/10.1111/emip.12372
   Web of Science ®Google Scholar
• Poehner, M. E. (2008). Dynamic assessment: A Vygotskian approach to understanding and promoting second language development. Springer.
   Google Scholar
• Randall, J. (2021). “Color-neutral” is not a thing: Redefining construct definition and representation through a justice-oriented critical antiracist lens. Educational Measurement: Issues and Practice, 40(4), 82–90. https://doi.org/10.1111/emip.12429
   Web of Science ®Google Scholar
• Rea-Dickens, P., & Gardner, S. (2000). Snares and silver bullets: Disentangling the construct of formative assessment. Language Testing, 17(2), 215–243. https://doi.org/10.1177/026553220001700206
   Google Scholar
• Schissel, J. (2014). Classroom use of test accommodations: Issues of access, equity, and conflation. Current Issues in Language Planning, 15(3), 282–295. https://doi.org/10.1080/14664208.2014.915458
   Google Scholar
• Schissel, J., Leung, C., & Chalhoub-Deville, M. (2019). The construct of multilingualism in language testing. Language Assessment Quarterly, 16(4–5), 373–378. https://doi.org/10.1080/15434303.2019.1680679
   Web of Science ®Google Scholar
• Schwarz, C. V., Reiser, B. J., Davis, E. A., Kenyon, L., Achér, A., Fortus, D., Shwartz, Y., Hug, B., & Krajcik, J. (2009). Developing a learning progression for scientific modeling: Making scientific modeling accessible and meaningful for learners. Journal of Research in Science Teaching, 46(6), 632–654. https://doi.org/10.1002/tea.20311
   Web of Science ®Google Scholar
• Shohamy, E. (2011). Assessing multilingual competencies: Adopting construct valid assessment policies. The Modern Language Journal, 95(3), 418–429. https://doi.org/10.1111/j.1540-4781.2011.01210.x
   Web of Science ®Google Scholar
• Sireci, S. (2020). Standardization and UNDERSTAND ardization in educational assessment. Educational Measurement: Issues and Practice, 39(3), 100–105. https://doi.org/10.1111/emip.12377
   Web of Science ®Google Scholar
• Sireci, S., & Faulkner-Bond, M. (2015). Promoting validity in the assessment of English learners. Review of Research in Education, 39(1), 215–252. https://doi.org/10.3102/0091732X14557003
   Google Scholar
• Smith, B., Pacheco, M., & Khorosheva, M. (2021). Emergent bilingual students and digital multimodal composition: A systematic review of research in secondary classrooms. Reading Research Quarterly, 56(1), 33–52. https://doi.org/10.1002/rrq.298
   Web of Science ®Google Scholar
• Solano-Flores, G., & Nelson-Barber, S. (2001). On the cultural validity of science assessments. Journal of Research in Science Teaching, 38(5), 553–573. https://doi.org/10.1002/tea.1018
   Web of Science ®Google Scholar
• Thompson, K., Umansky, I., & Rew, W. J. (2022). Improving understanding of English learner education through an expanded analytic framework. Educational Policy, 089590482210872. Advance online publication. https://doi.org/10.1177/08959048221087214
   Google Scholar
• Thurlow, M. L., & Kopriva, R. J. (2015). Advancing accessibility and accommodations in content assessments for students with disabilities and English learners. Review of Research in Education, 39(1), 331–369. https://doi.org/10.3102/0091732X14556076
   Web of Science ®Google Scholar
• Timpe Laughlin, V., Wain, J., & Schmidgall, J. (2015). Defining and operationalizing the construct of pragmatic competence: Review and recommendations (Research Report No. RR-15-06). Educational Testing Service. https://doi.org/10.1002/ets2.12053
   Google Scholar
• U.S. Department of Education. (2015). Every student succeeds act. https://www.gpo.gov/fdsys/pkg/BILLS-114s1177enr/pdf/BILLS-114s1177enr.pdf
   Google Scholar
• Vygotsky, L. S. (1986). Thought and language. MIT Press.
   Google Scholar
• WIDA Consortium. (2020). WIDA English language development standards framework (2020 ed.). Board of Regents of the University of Wisconsin System. https://wida.wisc.edu/sites/default/files/resource/WIDA-ELD-Standards-Framework-2020.pdf
   Google Scholar
• Wilson, M. (2018). Making measurement important for education: The crucial role of classroom assessment. Educational Measurement: Issues and Practice, 37(1), 5–20. https://doi.org/10.1111/emip.12188
   Web of Science ®Google Scholar
• Wolf, M. K. (Ed.). (2020). Assessing English language proficiency in U.S. K-12 schools. Routledge. https://doi.org/10.4324/9780429491689
   Google Scholar
• Wolf, M. K., Guzman-Orth, D., Lopez, A., Castellano, K., Himelfarb, I., & Tsutagawa, F. (2016). Integrating scaffolding strategies into technology-enhanced assessments of English learners: Task types and measurement models. Educational Assessment, 21(3), 157–175. https://doi.org/10.1080/10627197.2016.1202107
   Web of Science ®Google Scholar
• Zhai, X., He, P., & Krajcik, J. (2022). Applying machine learning to automatically assess scientific models. Journal of Research in Science Teaching(), 1765–1794. Advance online publication. https://doi.org/10.1002/tea.21773
   Google Scholar