Predicting Interim Assessment Outcomes Among Elementary-Aged English Learners Using Mathematics Computation, Oral Reading Fluency, and English Proficiency Levels

REFERENCES

• Abedi, J., & Gándara, P. (2007). Performance of English language learners as a subgroup in large-scale assessment: Interaction of research and policy. Educational Measurement: Issues and Practice, 25(4), 36–46. https://doi.org/10.1111/j.1745-3992.2006.00077.x
   Google Scholar
• Abedi, J., & Lord, C. (2001). The language factor in mathematics tests. Applied Measurement in Education, 14(3), 219–234. https://doi.org/10.1207/s15324818ame1403_2
   Google Scholar
• Albers, C. A., Kenyon, D. M., & Boals, T. J. (2009). Measures for determining English language proficiency and the resulting implications for instructional provision and intervention. Assessment for Effective Intervention, 34(2), 74–85. https://doi.org/10.1177/1534508408314175
   Google Scholar
• Albers, C. A., & Martinez, R. (2015). Promoting success with English language learners: Best practices for RTI. Guilford.
   Google Scholar
• Albers, C. A., Mission, P. L., & Bice-Urbach, B. (2013). Considering diverse learner characteristics in problem-solving assessment. In R. Brown-Chidsey & K. J. Andren (Eds.), Assessment for intervention: A problem-solving approach (2nd ed., pp. 101–122). Guilford.
   Google Scholar
• Allsopp, D. H., Farmer, J. L., & Hoppey, D., (2016). Preservice teacher education and response to intervention within multi-tiered systems of support: What can we learn from research and practice?. In S. R. Jimerson, M. K., Burns, A. M. & VanDerHeyden (Eds.), Handbook of response to intervention: The science and practice of multi-tiered systems of support (2nd ed., pp. 143–158). Springer.
   Google Scholar
• Baker, S. K., & Good, R. (1995). Curriculum-based measurement of English reading with bilingual Hispanic students: A validation study with second-grade students. School Psychology Review, 24(4), 561–578. https://doi.org/10.1080/02796015.1995.12085788
   Google Scholar
• Ballard & Tighe Publishers. (1991). IDEA Language Proficiency Tests (IPT) – English. Author.
   Google Scholar
• Balu, R., Zhu, P., Doolittle, F., Schiller, E., Jenkins, J., Gersten, R. (2015). Evaluation of response to intervention practices for elementary school reading. National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences, U. S. Department of Education. https://files.eric.ed.gov/fulltext/ED560820.pdf
   Google Scholar
• Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society, Series B, 57(1), 289–300.
   Google Scholar
• Bowes, S. M., Ammirati, R. J., Costello, T. H., Basterfield, C., & Lilienfeld, S. O. (2020). Cognitive biases, heuristics, and logical fallacies in clinical practice: A brief field guide for practicing clinicians and supervisors. Professional Psychology: Research and Practice, 51(5), 435–445. https://doi.org/10.1037/pro0000309
   Google Scholar
• Burns, M. K., Appleton, J. J., & Stehouwer, J. D. (2005). Meta-analytic review of responsiveness-to-intervention research: Examining field-based and research-implemented models. Journal of Psychoeducational Assessment, 23(4), 381–394. https://doi.org/10.1177/073428290502300406
   Google Scholar
• Canivez, G. L. (2013). Incremental criterion validity of WAIS-IV factor index scores: Relationships with WIAT-II and WIAT-III subtest and composite scores. Psychological Assessment, 25(2), 484–495. doi: 1.1037/h0088996
   Google Scholar
• Center for Applied Linguistics. (2014). Annual technical report for ACCESS for ELLs English language proficiency test, Series 301, 2012-2013 administration (WIDA Consortium Annual Technical Report No. 9). Author.
   Google Scholar
• Center for Applied Linguistics. (2015). Annual technical report for ACCESS for ELLs 2.0 online English language proficiency test, Series 400, 2015-2016 administration (WIDA Consortium Annual Technical Report No. 12A).
   Google Scholar
• Chen, F., & Chalhoub-Deville, M. (2016). Differential and long-term language impact on math. Language Testing, 33(4), 577–605. https://doi.org/10.1177/0265532215594641
   Google Scholar
• Chow, J. C., & Ekholm, E. (2019). Language domains differentially predict mathematics performance in young children. Early Childhood Research Quarterly, 46, 179–186. https://doi.org/10.1016/j.ecresq.2018.02.011
   Google Scholar
• Christ, T. J., Scullin, S., Tolbize, A., & Jiban, C. L. (2008). Implications of recent research: Curriculum-based measurement of math computation. Assessment for Effective Intervention, 33(4), 198–205. https://doi.org/10.1177/1534508407313480
   Google Scholar
• Clemens, N. H., Keller-Margulis, M. A., Scholten, T. S., & Yoon, M. (2016). Screening assessment within a multi-tiered system of support: Current practices, advances, and next steps. In S. R. Jimerson, M. K. Burns, & A. M. VanDerHeyden (Eds.), Handbook of response to intervention: The science and practice of multi-tiered systems of support (2nd ed., pp. 187–214). Springer.
   Google Scholar
• Core Team, R. (2021). R: A language and environment for statistical computing. R Foundation for Statistical Computing.
   Google Scholar
• CRESST. (n.d.). English language proficiency assessment for the 21st century (ELPA21). CREST. https://cresst.org/elpa21/
   Google Scholar
• Data Recognition Corporation. (n.d.). Language assessment scales (LAS). Author. https://laslinks.com/
   Google Scholar
• Dehaene, S. (1992). Varieties of numerical abilities. Cognition, 44(1–2), 1–42. https://doi.org/10.1016/0010-0277(92)90049-n
   Google Scholar
• Deno, S. L. (2003). Developments in curriculum-based measurement. The Journal of Special Education, 37(3), 184–192. https://doi.org/10.1177/00224669030370030801
   Google Scholar
• Enders, C. A. (2010). Applied missing data analysis. Guilford.
   Google Scholar
• Every Student Succeeds Act. (2015–2016). (ESSA) Pub. L. No. 114-95 § 114 Stat. 1177 (2015–2016).
   Google Scholar
• Fien, H., Nelson, N. J., Smolkowski, K., Kosty, D., Pilger, M., Baker, S. K., & Smith, J. L. M. (2021). A conceptual replication study of the enhanced core reading instruction MTSS-reading model. Exceptional Children, 87(3), 265–288. https://doi.org/10.1177/0014402920953763
   Google Scholar
• Fletcher, J., & Vaughn, S. (2009). Response to intervention: Preventing and remediating academic difficulties. Child Development Perspectives, 3(1), 30–37. https://doi.org/10.1111/j.1750-8606.2008.00072.x
   Google Scholar
• Fuchs, L. S., Wang, A. Y., Preacher, K. J., Malone, A. S., Fuchs, D., & Pachmayr, R. (2021). Addressing challenging mathematics standards with at-risk learners: A randomized controlled trial on the effects of fractions intervention at third grade. Exceptional Children, 87(2), 163–182. https://doi.org/10.1177/0014402920924846
   Google Scholar
• Galloway, E. P., & Uccelli, P. (2019). Examining developmental relations between core academic language skills and reading comprehension for English learners and their peers. Journal of Educational Psychology, 111(1), 15–31. https://doi.org/10.1037/edu0000276
   Google Scholar
• Geary, D. C. (2010). Missouri longitudinal study of mathematical development and disability. Understanding Number Development and Difficulties: BJEP Monograph Series, 7(7), 31–49. https://doi.org/10.1348/97818543370009X12583699332410
   Google Scholar
• Gersten, R., Jordan, N. C., & Flojo, J. R. (2005). Early identification and interventions for students with mathematics difficulties. Journal of Learning Disabilities, 38(4), 293–304. https://doi.org/10.1177/00222194050380040301
   Google Scholar
• Glover, T. A., & Albers, C. A. (2007). Considerations for evaluating universal screening assessments. Journal of School Psychology, 45(2), 117–135. https://doi.org/10.1016/j.jsp.2006.05.005
   Google Scholar
• Gottardo, A., & Mueller, J. (2009). Are first- and second-language factors related in predicting second-language reading comprehension? A study of Spanish-speaking children acquiring English as a second language from first to second grade. Journal of Educational Psychology, 101(2), 330–344. https://doi.org/10.1037/a0014320
   Google Scholar
• Gottlieb, M., Cranley, M. E., & Cammilleri, A. (2007). Understanding the WIDA English language proficiency standards.
   Google Scholar
• Grimm, K. J. (2008). Longitudinal associations between reading and mathematics achievement. Developmental Neuropsychology, 33(3), 410–426. https://doi.org/10.1080/87565640801982486
   Google Scholar
• Harry, B., Klingner, J., Delpit, L., & Artiles, A. (2014). Why are so many minority students in special education? Understanding race and disability in schools. Teachers College Press.
   Google Scholar
• Hosp, J. L., Huddle, S., Ford, J. W., & Hensley, K., (2016). Learning disabilities/special education. In S. R., Jimerson, M., K., Burns, A. M. & VanDerHeyden, (Eds.), Handbook of response to intervention: The science and practice of multi-tiered systems of support (2nd ed., pp. 43–58). Springer.
   Google Scholar
• Hussar, B., Zhang, J., Wang, X., Wang, K., Hein, S., Diliberti, M.,…Purcell, S. (2020). The condition of education 2020 (NCES 2020-144). U.S. Department of Education. National Center for Education Statistics. https://nces.ed.gov/pubs2020/2020144.pdf
   Google Scholar
• Individuals with Disabilities Education Improvement Act [IDEA]. (2004). 20 U.S.C. § 140.
   Google Scholar
• January, S. A., Van Norman, E. R., Christ, T. J., Ardoin, S. P., Eckert, T. L., & White, M. J. (2018). Progress monitoring in reading: Comparison of weekly, bimonthly, and monthly assessments for students at risk for reading difficulties in grades 2–4. School Psychology Review, 47(1), 83–94. https://doi.org/10.17105/SPR-2017-0009.V47-1
   Google Scholar
• Keller-Margulis, M. A., Shapiro, E. S., & Hintz, J. M. (2008). Long-term diagnostic accuracy of curriculum-based measures in reading and mathematics. School Psychology Review, 37(3), 339–374. https://doi.org/10.1080/02796015.2008.12087884
   Google Scholar
• Kieffer, M. J., & Thompson, K. D. (2018). Hidden progress of multilingual students on. Educational Researcher, 47(6), 391–398. https://doi.org/10.3102/0013189X1877777740
   Google Scholar
• Kilgus, S. P., Methe, S. A., Maggin, D. M., & Tomasula, J. L. (2014). Curriculum-based measurement of oral reading (R-CBM): A diagnostic test accuracy meta-analysis of evidence supporting use in universal screening. Journal of School Psychology, 52(4), 377–405. https://doi.org/10.1016/j.jsp.2014.06.002
   Google Scholar
• Kim, Y.-S. (2012). The relations among L1 (Spanish) literacy skills, L2 (English) language, L2 text reading fluency, and L2 reading comprehension for Spanish-Speaking ELL first grade students. Learning and Individual Differences, 22(6), 690–700. https://doi.org/10.1016/j.lindif.2012.06.009
   Google Scholar
• Kim, Y.-S G., Quinn, J. M., & Petscher, Y. (2021). Reading prosody unpacked: A longitudinal investigation of its dimensionality and relation with word reading and listening comprehension for children in primary grades. Journal of Educational Psychology, 113(3), 423–445. https://doi.org/10.1037/edu0000480
   Google Scholar
• Kim, J. S., Vanderwood, M. L., & Lee, C. Y. (2016). Predictive validity of curriculum-based measures for English language learners at varying English proficiency levels. Educational Assessment, 21(1), 1–18. https://doi.org/10.1080/10627197.2015.1127750
   Google Scholar
• Kim, Y.-S., & Wagner, R. K. (2015). Text (oral) reading fluency as a construct in reading development: An investigation of its mediating role for children from grades 1 to 4. Scientific Studies of Reading : The Official Journal of the Society for the Scientific Study of Reading, 19(3), 224–242. https://doi.org/10.1080/10888438.2015.1007375
   Google Scholar
• Kim, Y.-S., Wagner, R. K., & Foster, L. (2011). Relations among oral reading fluency, silent reading fluency, and reading comprehension: A latent variable study of first-grade readers. Scientific Studies of Reading, 15(4), 338–362. https://doi.org/10.1080/10888438.2010.493964
   Google Scholar
• Kleinke, K. (2017). Multiple imputation under violated distributional assumptions: A systematic evaluation of the assumed robustness of predictive mean matching. Journal of Educational and Behavioral Statistics, 42(4), 371–404. https://doi.org/10.3102/1076998616687084
   Google Scholar
• LeFevre, J., Fast, L., Skwarchuk, S.-L., Smith-Chant, B. L., Bisanz, J., Kamawar, D., & Penner-Wilger, M. (2010). Pathways to mathematics: longitudinal predictors of performance. Child Development, 81(6), 1753–1767. https://doi.org/10.1111/j.1467-8624.201.01508.x
   Google Scholar
• Lesaux, N. K., Crosson, A. C., Kieffer, M. J., & Pierce, M. (2010). Uneven profiles: Language minority Learners’ Word Reading, Vocabulary, and Reading Comprehension Skills. Journal of Applied Developmental Psychology, 31(6), 475–483. https://doi.org/10.1016/j.appdev.2010.09.004
   Google Scholar
• Maculaitis, J. D. (n.d.). Maculaitis Assessment of Competencies Test of English Language Proficiency. Questar. http://www.questarai.com/assessments/english-language-proficiency-assessments/
   Google Scholar
• Maechler, M., Rousseeuw, P., Croux, C., Todorov, V., Ruckstuhl, A., Salibian-Barrera, M., Verbeke, T…d., Palma, M. A. (2020). robustbase: Basic robust statistics R package version. 0.93–6. http://CRAN.R-project.org/package=robustbase.
   Google Scholar
• Maronna, R. A., Martin, R. D., Yohai, V. J., & Salibián-Barrera, M. (2019). Robust statistics: Theory and methods (with R) (2nd ed.). John Wiley & Sons, Inc.
   Google Scholar
• Martiniello, M. (2008). Language and the performance of English language learners in math word problems. Harvard Educational Review, 78(2), 333–368. https://doi.org/10.17763/haer.78.2.70783570r1111t32
   Google Scholar
• Méndez, L. I., Hammer, C. S., Lopez, L. M., & Blair, C. (2019). Examining language and early numeracy skills in young Latino dual language learners. Early Childhood Research Quarterly, 46, 252–261. https://doi.org/10.1016/j.ecresq.2018.02.004
   Google Scholar
• MetriTech, Inc. (n.d.). Language proficiency test series. Author.
   Google Scholar
• Morgan, P. L., Farkas, G., Cook, M., Strassfeld, N. M., Hillemeier, M. M., Pun, W. H., Wang, Y., & Schussler, D. L. (2018). Are Hispanic, Asian, Native American, or language-minority children overrepresented in special education? Exceptional Children, 84(3), 261–279. https://doi.org/10.1177/0014402917748303
   Google Scholar
• Muyskens, P., Betts, J., Lau, M. Y., & Marston, D. (2009). Predictive validity of curriculum-based measures in the reading assessment of students who are English language learners. The California School Psychologist, 14(1), 11–21. https://doi.org/10.1007/BF03340947
   Google Scholar
• National Association of School Psychologists. (2020). The professional standards of the National Association of School Psychologists. Author.
   Google Scholar
• Nelson, G., & Powell, S. R. (2018). A systematic review of longitudinal studies of mathematics difficulty. Journal of Learning Disabilities, 51(6), 523–539. https://doi.org/10.1177/0022219417714773
   Google Scholar
• Northwest Evaluation Association. (2004). Reliability and validity estimates: NWEA achievement level tests and measures of academic progress. Author.
   Google Scholar
• Northwest Evaluation Association. (2011). Technical manual: For measures of academic progress (MAP) and measures of academic progress for primary grades (MPG). Author.
   Google Scholar
• Northwest Evaluation Association. (2015). Measures of academic progress normative data. Author.
   Google Scholar
• O’Bryon, E., & Rogers, M. (2010). Bilingual school psychologists’ assessment practices with English language learners. Psychology in the Schools, 47(10), 1018–1034. https://doi.org/10.1002/pits.20521
   Google Scholar
• Pearson Education, Inc. (2012). AIMSweb technical manual. Author.
   Google Scholar
• Peng, P., Lin, X., Ünal, Z. E., Lee, K., Namkung, J., Chow, J., & Sales, A. (2020). Examining the mutual relations between language and mathematics: A meta-analysis. Psychological Bulletin, 146(7), 595–634. https://doi.org/10.1037/bul0000231
   Google Scholar
• Poncy, B. C., Skinner, C. H., & Axtell, P. K. (2005). An investigation of the reliability and standard error of measurement of words read correctly per minute using curriculum-based measurement. Journal of Psychoeducational Assessment, 23(4), 326–338. https://doi.org/10.1177/073428290502300403
   Google Scholar
• Quirk, M., & Beem, S. (2012). Examining the relations between reading fluency and reading comprehension for English language learners. Psychology in the Schools, 49(6), 539–553. https://doi.org/10.1002/pits.21616
   Google Scholar
• Richardson, R. D., Rocconi, L. M., & Crewdson, M. A. (2020). Evaluating English learner progress in reading: How much growth can we expect? School Psychology Review, 49(4), 480–492. https://doi.org/10.1080/2372966X.2020.1787080
   Google Scholar
• Rittle-Johnson, B., Schneider, M., & Star, J. R. (2015). Not a one-way street: Bidirectional relations between procedural and conceptual knowledge of mathematics. Educational Psychology Review, 27, 587–597. https://doi.org/10.1007/s10648-015-9302-x
   Google Scholar
• Roberts, G., & Bryant, D. (2011). Early mathematics achievement trajectories: English-language learner and native English-speaker estimates, using the Early Childhood Longitudinal Survey. Developmental Psychology, 47(4), 916–930. https://doi.org/10.1037/a0023865
   Google Scholar
• Roberts, G., Mohammed, S. S., & Vaughn, S. (2010). Reading achievement across three language groups: Growth estimates for overall reading and reading subskills obtained with the Early Childhood Longitudinal Survey. Journal of Educational Psychology, 102(3), 668–686. https://doi.org/10.1037/a0018983
   Google Scholar
• Robin, X., Turck, N., Hainard, A., Tiberti, N., Lisacek, F., Sanchez, J.-C., & Müller, M. (2011). pROC: An open-source package for R and S + to analyze and compare ROC curves. BMC Bioinformatics, 12(1), 77–85. https://doi.org/10.1186/1471-2105-12-77
   Google Scholar
• Robinson-Cimpian, J. P., Thompson, K. D., & Umansky, I. M. (2016). Research and policy considerations for English learner equity. Policy Insights from the Behavioral and Brain Sciences, 3(1), 129–137. https://doi.org/10.1177/2372732215623553
   Google Scholar
• Rubin, D. B. (1987). Multiple imputation for nonresponse in surveys. John Wiley & Sons, Inc.
   Google Scholar
• Samson, J. F., & Lesaux, N. K. (2009). Language-minority learners in special education: Rates and predictors of identification for services. Journal of Learning Disabilities, 42(2), 148–162. https://doi.org/10.1177/0022219408326221
   Google Scholar
• Shapiro, E. S., Dennis, M. S., & Fu, Q. (2015). Comparing computer adaptive and curriculum-based measures of math in progress monitoring. School Psychology Quarterly: The Official Journal of the Division of School Psychology, American Psychological Association, 30(4), 470–487. https://doi.org/10.1037/spq0000116
   Google Scholar
• Sireci, S. G., Han, K. T., & Wells, C. S. (2008). Methods for evaluating the validity of test scores for English language learners. Educational Assessment, 13(2–3), 108–131. https://doi.org/10.1080/10627190802394255
   Google Scholar
• Sullivan, A. L. (2011). Disproportionality in special education identification and placement of English language learners. Exceptional Children, 77(3), 317–334. https://doi.org/10.1177/001440291107700304
   Google Scholar
• Sullivan, A. L., & Bal, A. (2013). Disproportionality in special education: Effects of individual and school variables on disability risk. Exceptional Children, 79(4), 475–494. https://doi.org/10.1177/001440291307900406
   Google Scholar
• Thurber, R. S., Shinn, M. R., & Smolkowski, K. (2002). What is measured in mathematics tests? Construct validity of curriculum-based mathematics measures. School Psychology Review, 31(4), 498–513. https://doi.org/10.1080/02796015.2002.12086170
   Google Scholar
• Umansky, I. M., Thompson, K. D., & Diaz, G. (2017). Using an ever-English learner framework to examine disproportionality in special education. Exceptional Children, 84(1), 76–96. https://doi.org/10.1177/0014402917707470
   Google Scholar
• van Buuren, S. (2018). Flexible imputation of missing data (2nd ed.). CRC Press.
   Google Scholar
• Van Norman, E. R., & Nelson, P. M. (2021). The importance of growth in oral reading fluency to predict performance on high-stakes assessments among students receiving supplemental instruction. Journal of Applied School Psychology, 37(1), 1–15. https://doi.org/10.1080/15377903.202.1772432
   Google Scholar
• Vanderheyden, A., & Burns, M. (2005). Using curriculum-based assessment and curriculum-based measurement to guide elementary mathematics instruction: Effect on individual and group accountability scores. Assessment for Effective Intervention, 30(3), 15–31. https://doi.org/10.1177/073724770503000302
   Google Scholar
• Vanderwood, M. L., Tung, C. T., & Checca, C. J. (2014). Predictive validity and accuracy of oral reading fluency for English learners. Journal of Psychoeducational Assessment, 32(3), 249–258. https://doi.org/10.1177/0734282913502937
   Google Scholar
• Vink, G., Frank, L. E., Pannekoek, J., & van Buuren, S. (2014). Predictive mean matching imputation of semicontinuous variables. Statistica Neerlandica, 68(1), 61–90. https://doi.org/10.1111/stan.12023
   Google Scholar
• Vukovic, R. K., & Lesaux, N. K. (2013a). The relationships between linguistic skills and arithmetic knowledge. Learning and Individual Differences, 23, 87–91. https://doi.org/10.1016/j.lindif.2012.1.007
   Google Scholar
• Vukovic, R. K., & Lesaux, N. K. (2013b). The language of mathematics: Investigating the ways language counts for children’s mathematical development. Journal of Experimental Child Psychology, 115(2), 224–227. https://doi.org/10.1016/j.jecp.2013.02.002
   Google Scholar
• Walker, H. M., Small, J. W., Severson, H. H., Seeley, J. R., & Feil, E. G. (2014). Multiple-gating apprpoaches in universal screening within school and community settings. In R. J. Kettler, T. A. Glover, C. A. Albers, & K. A. Feeney-Kettler (Eds.), Universal screening in educational settings: Evidence-based decision making for schools (pp. 47–76). American Psychological Association.
   Google Scholar
• What Works Clearinghouse. (2020). What Works Clearinghouse procedures handbook, version 4.1. Institute of Education Sciences, National Center for Educational Evaluation and Regional Assistance, U.S. Department of Education. https://ies.ed.gov/ncee/wwc/Docs/referenceresources/WWC-Procedures-Handbook-v4-1-508.pdf
   Google Scholar
• Wickham, H. (2016). ggplot2: Elegant graphics for data analysis. Springer-Verlag.
   Google Scholar
• WIDA. (2020). WIDA Consortium member states and territories. https://wida.wisc.edu/memberships/consortium
   Google Scholar
• Wiley, H. I., & Deno, S. L. (2005). Oral reading and maze measures as predictors of success for English learners on a state standards assessment. Remedial and Special Education, 26(4), 207–214. https://doi.org/10.1177/07419325050260040301
   Google Scholar
• Wolf, M. K., & Faulkner-Bond, M. (2016). Validating English language proficiency assessment uses for English Learners: Academic language proficiency and content assessment performance. Educational Measurement: Issues and Practice, 35(2), 6–18. https://doi.org/10.1111/emip.12105
   Google Scholar
• Wolf, M. K., & Leon, S. (2009). An investigation of the language demands in content assessments for English language learners. Educational Assessment, 14(3–4), 139–159. https://doi.org/10.1080/10627190903425883
   Google Scholar