Conducting a Cost-Effectiveness Analysis of an Early Numeracy Intervention

REFERENCES

• Agrawal, J., & Morin, L. L. (2016). Evidence-based practices: Applications of concrete representational abstract framework across math concepts for students with mathematics disabilities. Learning Disabilities Research & Practice, 31(1), 34–44. https://doi/org/10.1111/ldrp.12093
   Web of Science ®Google Scholar
• Archer, A. L., & Hughes, C. A. (2011). Exploring the foundations of explicit instruction. In A. L. Archer & C. A. Hughes (Eds.), Explicit instruction: Effective and efficient teaching. (pp. 1–22). The Guilford Press.
   Google Scholar
• Baldwin, S. A., Bauer, D. J., Stice, E., & Rohde, P. (2011). Evaluating models for partially clustered designs. Psychological Methods, 16(2), 149–165. https://doi/org/10.1037/a0023464
   PubMed Web of Science ®Google Scholar
• Balu, R., Zhu, P., Doolittle, F., Schiller, E., Jenkins, J., Gersten, R. M. (2015). Evaluation of response to intervention practices for elementary school reading (NCEE No. 2016-4000). Washington, DC: National Center for Education Evaluation and Regional Assistance (NCEE), Institute of Education Sciences, U.S. Department of Education. Retrieved from http://files.eric.ed.gov/fulltext/ED560820.pdf
   Google Scholar
• Bauer, D. J., Sterba, S. K., & Hallfors, D. D. (2008). Evaluating group-based interventions when control participants are ungrouped. Multivariate Behavioral Research, 43(2), 210–236. https://doi/org/10.1080/00273170802034810
   PubMed Web of Science ®Google Scholar
• Begeny, J. C., Hawkins, A. L., Krouse, H. E., & Laugle, K. M. (2011). Altering instructional delivery options to improve intervention outcomes: Does increased instructional intensity also increase instructional effectiveness?Psychology in the Schools, 48(8), 769–785. https://doi/org/10.1002/pits.20591
   Web of Science ®Google Scholar
• Begeny, J. C., Levy, R. A., & Field, S. A. (2018). Using small-group instruction to improve students’ reading fluency: An evaluation of the existing research. Journal of Applied School Psychology, 34(1), 36–64. https://doi/org/10.1080/15377903.2017.1328628
   Web of Science ®Google Scholar
• Begeny, J. C., Yeager, A., & Martínez, R. S. (2012). Effects of small-group and one-on-one reading fluency interventions with second grade, low-performing spanish readers. Journal of Behavioral Education, 21(1), 58–79. https://doi/org/10.1007/s10864-011-9141-x
   Web of Science ®Google Scholar
• Blonigen, B. A., Harbaugh, W. T., Singell, L. D., Horner, R. H., Irvin, L. K., & Smolkowski, K. S. (2008). Application of economic analysis to school-wide positive behavior support (swpbs) programs. Journal of Positive Behavior Interventions, 10(1), 5–19. https://doi/org/10.1177/1098300707311366
   Web of Science ®Google Scholar
• Borman, G., Hewes, G., Overman, L., & Brown, S. (2002). Comprehensive school reform and student achievement: A ­meta-analysis (Report No. CRESPAR-R-59). : CRESPAR/Johns Hopkins University. Retrieved from http://files.eric.ed.gov/fulltext/ED472569.pdf
   Google Scholar
• Clarke, B., Doabler, C. T., Fien, H., Baker, S. K., & Smolkowski, K. (2012). A randomized control trial of a tier 2 kindergarten mathematics intervention (Project ROOTS). (USDE; Institute of Education Sciences; Special Education Research, CFDA Num: 84.324A, 2012-2016, Funding Number: R324A120304, awarded $3,338,552).
   Google Scholar
• Clarke, B., Doabler, C. T., Kosty, D., Kurtz Nelson, E., Smolkowski, K., Fien, H., & Turtura, J. (2017). Testing the efficacy of a kindergarten mathematics intervention by small group size. AERA Open, 3(2), 233285841770689–233285841770616. https://doi/org/10.1177/2332858417706899
   Web of Science ®Google Scholar
• Clarke, B., Doabler, C. T., Smolkowski, K., Baker, S. K., Fien, H., & Strand Cary, M. (2016). Examining the efficacy of a tier 2 kindergarten mathematics intervention. Journal of Learning Disabilities, 49(2), 152–165. https://doi/org/10.1177/0022219414538514
   PubMed Web of Science ®Google Scholar
• Clarke, B., Doabler, C., Smolkowski, K., Kurtz Nelson, E., Fien, H., Baker, S. K., & Kosty, D. (2016). Testing the immediate and long-term efficacy of a tier 2 kindergarten mathematics intervention. Journal of Research on Educational Effectiveness, 9(4), 607–634. https://doi/org/10.1080/19345747.2015.1116034
   Web of Science ®Google Scholar
• Clarke, B., Doabler, C. T., Smolkowski, K., Turtura, J., Kosty, D., Kurtz-Nelson, E., Fien, H., & Baker, S. K. (2019). Exploring the relationship between initial mathematics skill and a kindergarten mathematics intervention. Exceptional Children, 85(2), 129–146. https://doi/org/10.1177/0014402918799503
   Web of Science ®Google Scholar
• Clarke, B., Doabler, C. T., Strand Cary, M., Kosty, D. B., Baker, S. K., Fien, H., & Smolkowski, K. (2014). Preliminary evaluation of a tier-2 mathematics intervention for first grade students: Utilizing a theory of change to guide formative evaluation activities. School Psychology Review, 43, 160–177.
   Web of Science ®Google Scholar
• Clarke, B., Doabler, C., Turtura, J., Smolkowski, K., Kosty, D., Sutherland, M., … Baker, S. K. (in press). Examining the efficacy of a kindergarten mathematics intervention by group size and initial skill: Implications for practice and policy. Elementary School Journal.
   Web of Science ®Google Scholar
• Clarke, B., Gersten, R. M., Dimino, J., & Rolfhus, E. (2011). Assessing student proficiency of number sense (ASPENS). Cambium Learning Group, Sopris Learning.
   Google Scholar
• Clarke, B., Nelson, N. J., & Shanley, L. (2016). Mathematics fluency—more than the weekly timed test. In K. Cummings & Y. Petscher (Eds.), The fluency construct. (pp. 67–89). Springer Science + Business Media. https://doi/org/10.1007/978-1-4939-2803-3_3
   Google Scholar
• Codding, R. S., & Lane, K. L. (2015). A spotlight on treatment intensity: An important and often overlooked component of intervention inquiry. Journal of Behavioral Education, 24(1), 1–10. https://doi/org/10.1007/s10864-014-9210-z
   Web of Science ®Google Scholar
• Codding, R. S., VanDerHeyden, A. M., Martin, R. J., Desai, S., Allard, N., & Perrault, L. (2016). Manipulating treatment dose: Evaluating the frequency of a small group intervention targeting whole number operations. Learning Disabilities Research & Practice, 31(4), 208–220. https://doi/org/10.1111/ldrp.12120
   Web of Science ®Google Scholar
• Cook, B. G., & Odom, S. L. (2013). Evidence-based practices and implementation science in special education. Exceptional Children, 79(3), 135–144. https://doi/org/10.1177/001440291307900201
   Web of Science ®Google Scholar
• Coyne, M. D., Cook, B. G., & Therrien, W. J. (2016). Recommendations for replication research in special education: A framework of systematic, conceptual replications. Remedial and Special Education, 37(4), 244–253. https://doi/org/10.1177/0741932516648463
   Web of Science ®Google Scholar
• Coyne, M. D., Kame’enui, E. J., & Carnine, D. (2011). Effective teaching strategies that accommodate diverse learners. (4th ed.). Pearson Education.
   Google Scholar
• Doabler, C. T., Clarke, B., & Fien, H. (2012). Roots assessment of early numeracy skills (raens). Unpublished measurement instrument. Center on Teaching and Learning, University of Oregon.
   Google Scholar
• Doabler, C. T., Clarke, B., Kosty, D. B., Kurtz-Nelson, E., Fien, H., Smolkowski, K., & Baker, S. K. (2016). Testing the efficacy of a tier 2 mathematics intervention: A conceptual replication study. Exceptional Children, 83(1), 92–110. https://doi/org/10.1177/0014402916660084
   Web of Science ®Google Scholar
• Doabler, C. T., Clarke, B., Kosty, D., Kurtz-Nelson, E., Fien, H., Smolkowski, K., & Baker, S. K. (2019a). Examining the impact of group size on the treatment intensity of a tier 2 mathematics intervention within a systematic framework of replication. Journal of Learning Disabilities, 52(2), 168–180. https://doi/org/10.1177/0022219418789376
   PubMed Web of Science ®Google Scholar
• Doabler, C. T., Clarke, B., Kosty, D., Smolkowski, K., Kurtz Nelson, E., Fien, H., & Baker, S. K. (2019b). Building number sense among English learners: A multisite randomized controlled trial of a tier 2 kindergarten mathematics intervention. Early Childhood Research Quarterly, 47, 432–444. https://doi/org/10.1016/j.ecresq.2018.08.004
   Web of Science ®Google Scholar
• Duncan, G. J., Dowsett, C. J., Claessens, A., Magnuson, K., Huston, A. C., Klebanov, P., Pagani, L. S., Feinstein, L., Engel, M., Brooks-Gunn, J., Sexton, H., Duckworth, K., & Japel, C. (2007). School readiness and later achievement. Developmental Psychology, 43(6), 1428–1446. https://doi/org/10.1037/0012-1649.43.6.1428
   PubMed Web of Science ®Google Scholar
• Dyson, N. I., Jordan, N. C., & Glutting, J. (2013). A number sense intervention for low-income kindergartners at risk for mathematics difficulties. Journal of Learning Disabilities, 46(2), 166–181. https://doi/org/10.1177/0022219411410233
   PubMed Web of Science ®Google Scholar
• Elbaum, B., Vaughn, S., Hughes, M. T., Moody, S. W., & Schumm, J. S. (2000). How reading outcomes of students with disabilities are related to instructional grouping formats: A meta-analytic review. In R. M. Gersten, E. P. Schiller & S. Vaughn (Eds.), Contemporary special education research: Syntheses of the knowledge base on critical instructional issues. (pp. 105–136). Lawrence Erlbaum Associates.
   Google Scholar
• Frye, D., Baroody, A. J., Burchinal, M., Carver, S. M., Jordan, N. C., McDowell, J. (2013). Teaching math to young children: A practice guide (Practice Guide No. NCEE 2014-4005). Washington, DC: National Center for Education and Regional Assistance (NCEE), Institute of Education Sciences, US Department of Education. Retrieved from https://ies.ed.gov/ncee/wwc/Docs/PracticeGuide/early_math_pg_111313.pdf
   Google Scholar
• Fuchs, L. S., Compton, D. L., Fuchs, D., Paulsen, K., Bryant, J. D., & Hamlett, C. L. (2005). The prevention, identification, and cognitive determinants of math difficulty. Journal of Educational Psychology, 97(3), 493–513. https://doi/org/10.1037/0022-0663.97.3.493
   Web of Science ®Google Scholar
• Gersten, R. M., Beckmann, S., Clarke, B., Foegen, A., March, L., Star, J. R., & Witzel, B. (2009). Assisting students struggling with mathematics: Response to intervention (rti) for elementary and middle schools (Practice Guide Report No. NCEE 2009-4060). : National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences, US Department of Education. Retrieved from https://ies.ed.gov/ncee/wwc/Docs/PracticeGuide/rti_math_pg_042109.pdf
   Google Scholar
• Gersten, R. M., & Chard, D. J. (1999). Number sense: Rethinking arithmetic instruction for students with mathematical disabilities. The Journal of Special Education, 33(1), 18–28. https://doi/org/10.1177/002246699903300102
   Web of Science ®Google Scholar
• Gersten, R. M., Clarke, B., Jordan, N., Newman-Gonchar, R., Haymond, K., & Wilkins, C. (2012). Universal screening in mathematics for the primary grades: Beginnings of a research base. Exceptional Children, 78(4), 423–445. Retrieved from. http://cec.metapress.com/content/B75U2072576416T7. https://doi/org/10.1177/001440291207800403
   Web of Science ®Google Scholar
• Ginsburg, H. P., & Baroody, A. J. (2003). Test of early mathematics ability- third edition (tema-3). ProEd.
   Google Scholar
• Hollands, F. M., Kieffer, M. J., Shand, R., Pan, Y., Cheng, H., & Levin, H. M. (2016). Cost-effectiveness analysis of early reading programs: A demonstration with recommendations for future research. Journal of Research on Educational Effectiveness, 9(1), 30–53. https://doi/org/10.1080/19345747.2015.1055639
   Web of Science ®Google Scholar
• Hunter, L. J., DiPerna, J. C., Hart, S. C., & Crowley, M. (2018). At what cost? Examining the cost effectiveness of a universal social–emotional learning program. School Psychology Quarterly, 33(1), 147–154. https://doi/org/10.1037/spq0000232
   PubMed Web of Science ®Google Scholar
• Jordan, N. C., Glutting, J., & Ramineni, C. (2010). The importance of number sense to mathematics achievement in first and third grades. Learning and Individual Differences, 20(2), 82–88. https://doi/org/10.1016/j.lindif.2009.07.004
   PubMed Web of Science ®Google Scholar
• Knight, D. S., Landry, S., Zucker, T. A., Williams, J. M., Merz, E. C., Taylor, H. B. (2016). Cost-effectiveness of early childhood interventions to enhance preschool: Evidence from a randomized experiment in head start centers enrolling historically underserved populations (CERPS Working Paper No. 2016-3). EL Paso, TX: Center for Education Research and Policy Studies, University of Texas at El Paso DigitalCommons@UTEP. Retrieved from https://digitalcommons.utep.edu/cgi/viewcontent.cgi?article=1002&context=cerps_wp
   Google Scholar
• Levin, H. M., & Belfield, C. (2015). Guiding the development and use of cost-effectiveness analysis in education. Journal of Research on Educational Effectiveness, 8(3), 400–418. https://doi/org/10.1080/19345747.2014.915604
   Web of Science ®Google Scholar
• Levin, H. M., & McEwan, P. J. (2002). Cost-effectiveness analysis: Methods and applications. Sage Publications. Retrieved from http://catalog.hathitrust.org/api/volumes/oclc/44066885.html
   Google Scholar
• Levin, H. M., McEwan, P. J., Belfield, C., Bowden, A. B., Shand, R. (2017). Economic evaluation in education: Cost-effectiveness and benefit-cost analysis: SAGE Publications. Retrieved from https://books.google.com/books?id=CRgnDwAAQBAJ
   Google Scholar
• Miller, B., Vaughn, S., & Freund, L. (2014). Learning disabilities research studies: Findings from nichd funded projects. Journal of Research on Educational Effectiveness, 7(3), 225–231. https://doi/org/10.1080/19345747.2014.927251
   PubMed Web of Science ®Google Scholar
• Morgan, P. L., Farkas, G., Wang, Y., Hillemeier, M. M., Oh, Y., & Maczuga, S. (2019). Executive function deficits in kindergarten predict repeated academic difficulties across elementary school. Early Childhood Research Quarterly, 46, 20–32. https://doi/org/10.1016/j.ecresq.2018.06.009
   Web of Science ®Google Scholar
• Morgan, P. L., Farkas, G., & Wu, Q. (2009). Five-year growth trajectories of kindergarten children with learning difficulties in mathematics. Journal of Learning Disabilities, 42, 306–321. https://doi/org/10.1177/0022219408331037
   PubMed Web of Science ®Google Scholar
• Morgan, P. L., Hillemeier, M. M., Farkas, G., & Maczuga, S. (2014). Racial/ethnic disparities in adhd diagnosis by kindergarten entry. Journal of Child Psychology and Psychiatry, 55(8), 905–913. https://doi/org/10.1111/jcpp.12204
   PubMed Web of Science ®Google Scholar
• National Assessment of Educational Progress (2019). Results from the 2019 mathematics and reading assessments (NCES No. 2020012). Washington, DC: National Center for Education Statistics, U.S. Department of Education, Institute of Education Sciences. Retrieved from https://www.nationsreportcard.gov/mathematics?grade=4
   Google Scholar
• National Association of State Directors of Special Education, & Council of Administrators of Special Education (2006). Response to intervention. A joint paper by the national association of state directors of special education and the council of administrators of special education (Joint paper. Washington, DC: National Association of State Directors of Special Education, Council of Adminsitrators of Special Education.
   Google Scholar
• National Research Council (2001). Adding it up: Helping children learn mathematics. Mathematics Learning Study Committee.
   Google Scholar
• Ochsendorf, R. (2016). Advancing understanding of mathematics development and intervention: Findings from ncser-funded efficacy studies. Journal of Research on Educational Effectiveness, 9(4), 570–576. https://doi/org/10.1080/19345747.2016.1222144
   Web of Science ®Google Scholar
• Odden, A., & Archibald, S. (2000). Reallocation of resources: How to boost student achievement without asking for more. Corwin.
   Google Scholar
• Onken, L. S., Carroll, K. M., Shoham, V., Cuthbert, B. N., & Riddle, M. (2014). Reenvisioning clinical science: Unifying the discipline to improve the public health. Clinical Psychological Science, 2(1), 22–34. https://doi/org/10.1177/2167702613497932
   PubMedGoogle Scholar
• Ross, S. G., & Begeny, J. C. (2015). An examination of treatment intensity with an oral reading fluency intervention: Do intervention duration and student–teacher instructional ratios impact intervention effectiveness? Journal of Behavioral Education, 24(1), 11–32. https://doi/org/10.1007/s10864-014-9202-z
   Web of Science ®Google Scholar
• Sood, S., & Jitendra, A. K. (2013). An exploratory study of a number sense program to develop kindergarten students’ number proficiency. Journal of Learning Disabilities, 46(4), 328–346. https://doi/org/10.1177/0022219411422380
   PubMed Web of Science ®Google Scholar
• U.S. Bureau of Labor Statistics (2019a). Employer costs for employee compensation (News Release USDL No. 19-1649). Washington, DC: US Bureau of Labor Statistics. Retrieved from https://www.bls.gov/news.release/pdf/ecec.pdf
   Google Scholar
• U.S. Bureau of Labor Statistics (2019b). Occupation outlook handbook. Washington, DC US Bureau of Labor Statistics. Retrieved from https://www.bls.gov/ooh/home.htm?view_full
   Google Scholar
• U.S. Department of Education (2018). Rfa: Special education research grants (CFDA No. 84.324A). : Institute of Education Sciences. Retrieved from https://ies.ed.gov/funding/pdf/2019_84324A.pdf
   Google Scholar
• Vaughn, S., & Fuchs, L. S. (2003). Redefining learning disabilities as inadequate response to instruction: The promise and potential problems. Learning Disabilities Research and Practice, 18(3), 137–146. https://doi/org/10.1111/1540-5826.00070
   Google Scholar
• Vaughn, S., Klingner, J. K., Swanson, E. A., Boardman, A. G., Roberts, G., Mohammed, S. S., & Stillman-Spisak, S. J. (2011). Efficacy of collaborative strategic reading with middle school students. American Educational Research Journal, 48(4), 938–964. https://doi/org/10.3102/0002831211410305
   Web of Science ®Google Scholar
• Watts, T. W., Duncan, G. J., Siegler, R. S., & Davis-Kean, P. E. (2014). What’s past is prologue:Relations between early mathematics knowledge and high school achievement. Educational Researcher, 43(7), 352–360. https://doi/org/10.3102/0013189X14553660
   PubMed Web of Science ®Google Scholar
• What Works Clearinghouse (2017). Procedures handbook version 4.0. Institute of Education Science, U.S. Department of Education. Retrieved from https://ies.ed.gov/ncee/wwc/Docs/referenceresources/wwc_standards_handbook_v4.pdf
   Google Scholar
• Witzel, B. S., Mercer, C. D., & Miller, M. D. (2003). Teaching algebra to students with learning difficulties: An investigation of an explicit instruction model. Learning Disabilities Research and Practice, 18(2), 121–131. https://doi/org/10.1111/1540-5826.00068
   Google Scholar