Using Regression Discontinuity to Test the Impact of a Tier 2 Reading Intervention in First Grade

REFERENCES

• Al Otaiba, S., Connor, C.M., Folsom, J.S., Greulich, L., Meadows, J., & Li, Z. (2011). Assessment data–informed guidance to individualize kindergarten reading instruction: Findings from a cluster-randomized control field trial. The Elementary School Journal, 111, 535–560.
   PubMed Web of Science ®Google Scholar
• Al Otaiba, S., Connor, C.M., Folsom, J.S., Wanzek, J., Greulich, L., Schatschneider, C., & Wagner, R.K. (2014). To wait in Tier 1 or intervene immediately: A randomized experiment examining first-grade response to intervention in reading. Exceptional Children, 81, 11–27. doi: 10.1177/0014402914532234
   PubMed Web of Science ®Google Scholar
• Ashlock Consulting. (2006). Lesson maps. Petaluma, CA: Author.
   Google Scholar
• Baker, S.K., Fien, H., & Baker, D.L. (2010). Robust reading instruction in the early grades: Conceptual and practical issues in the integration and evaluation of Tier 1 and Tier 2 instructional supports. Focus on Exceptional Children, 42, 1–20.
   Web of Science ®Google Scholar
• Baker, S.K., Smolkowski, K., Katz, R., Fien, H., Seeley, J., Kame’enui, E., & Thomas Beck, C. (2008). Reading fluency as a predictor of reading proficiency in low-performing high poverty schools. School Psychology Review, 37, 18–37.
   Web of Science ®Google Scholar
• Bloom, H.S. (2012). Modern regression discontinuity analysis. Journal of Research on Educational Effectiveness, 5, 43–82. doi: 10.1080/19345747.2011.578707
   Web of Science ®Google Scholar
• Burnham, K.P., & Anderson, D.R. (2002). Model selection and multimodel inference: A practical information-theoretic approach (2nd ed.). New York, NY: Springer-Verlag.
   Google Scholar
• Burns, M.K., & Gibbons, K.A. (2012). Implementing Response-to-Intervention in elementary and secondary schools: Procedures to assure scientific-based practices (2nd ed.). New York, NY: Routledge.
   Google Scholar
• Chambers, B., Slavin, R.E., Madden, N.A., Abrami, P., Logan, M.K., & Gifford, R. (2011). Small-group, computer-assisted tutoring to improve reading outcomes for struggling first and second graders. The Elementary School Journal, 111, 625–640. doi: 10.1086/659035
   Web of Science ®Google Scholar
• Chard, D.J., Harn, B., Sugai, G., Horner, R., Simmons, D.C., & Kame’enui, E.J. (2008). Core features of multi-tiered systems of reading and behavioral support. In C.R. Greenwood, T.R. Kratochwill, & M. Clements (Eds.), Schoolwide prevention models: Lessons learned in elementary schools (pp. 31–58). New York, NY: Guilford.
   Google Scholar
• Compton, D.L., Fuchs, D., Fuchs, L.S., Bouton, B., Gilbert, J.K., Barquero, L.A., … Crouch, R.C. (2010). Selecting at-risk first-grade readers for early intervention: Eliminating false positives and exploring the promise of a two-stage gated screening process. Journal of Educational Psychology, 102, 327–340. doi: 10.1037/a0018448
   PubMed Web of Science ®Google Scholar
• Connor, C.M., Morrison, F.J., Fishman, B., Giuliani, S., Luck, M., Underwood, P.S., … Schatschneider, C. (2011). Testing the impact of child characteristics × instruction interactions on third graders’ reading comprehension by differentiating literacy instruction. Reading Research Quarterly, 46, 189–221. doi: 10.2307/41228651
   PubMed Web of Science ®Google Scholar
• Connor, C.M., Piasta, S.B., Fishman, B., Glasney, S., Schatschneider, C., Crowe, E., … Morrison, F.J. (2009). Individualizing student instruction precisely: Effects of Child × Instruction interactions on first graders’ literacy development. Child Development, 80, 77–100. doi: 10.1111/j.1467-8624.2008.01247.x
   PubMed Web of Science ®Google Scholar
• Coyne, M.D., Kame’enui, E.J., & Carnine, D.W. (2011). Effective teaching strategies that accommodate diverse learners. Upper Saddle River, NJ: Merrill.
   Google Scholar
• Denton, C.A. (2012). Response to Intervention for reading difficulties in the primary grades. Journal of Learning Disabilities, 45, 232–243. doi: 10.1177/0022219412442155
   PubMed Web of Science ®Google Scholar
• Elbaum, B., Vaughn, S., Hughes, M.T., & Moody, S.W. (1999). Grouping practices and reading outcomes for students with disabilities. Exceptional Children, 65, 399–415.
   Web of Science ®Google Scholar
• Elbaum, B., Vaughn, S., Hughes, M.T., & Moody, S.W. (2000). How effective are one-to-one tutoring programs in reading for elementary students at risk for reading failure? A meta-analysis of the intervention research. Journal of Educational Psychology, 92, 605–619. doi: 10.1037/0022-0663.92.4.605
   Web of Science ®Google Scholar
• Evans, M.A. (1996). Reticent primary grade children and their more talkative peers: Verbal, nonverbal, and self-concept characteristics. Journal of Educational Psychology, 88, 739–749.
   Web of Science ®Google Scholar
• Fien, H., Smith, J.L. M., Smolkowski, K., Baker, S.K., Nelson-Walker, N.J., & Chaparro, E.A. (2014). An examination of the efficacy of a multi-tiered intervention on early reading outcomes for first grade students at risk for reading difficulties. Journal of Learning Disabilities. doi: Advance online publication. 10.1177/0022219414521664
   Google Scholar
• Fuchs, D., Fuchs, L.S., & Stecker, P.M. (2010). The “blurring” of special education in a new continuum of general education placements and services. Exceptional Children, 76, 301–323.
   Web of Science ®Google Scholar
• Gersten, R.M., Compton, D., Connor, C.M., Dimino, J., Santoro, L., Linan-Thompson, S., & Tilly, W.D. (2009). Assisting students struggling with reading: Response to Intervention and multi-tier intervention for reading in the primary grades: A practice guide (No. NCE 2009-4045). Washington, DC: National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences, US Department of Education. Retrieved from http:/ies.ed.gov/ncee/wwc/publications/practiceguides/
   Google Scholar
• Good, R.H., & Kaminski, R. (2002). Dynamic indicators of basic early literacy skills (6th ed.). Eugene, OR: Institute for the Development of Education Achievement.
   Google Scholar
• Greenwood, C.R. (1991). Longitudinal analysis of time, engagement, and achievement in at-risk versus non-risk students. Exceptional Children, 57, 521–535.
   PubMed Web of Science ®Google Scholar
• Gunn, B., Smolkowski, K., Biglan, A., Black, C., & Blair, J. (2005). Fostering the development of reading skill through supplemental instruction: Results for Hispanic and non-Hispanic students. Journal of Special Education, 39, 66–85. doi: 10.1177/00224669050390020301
   PubMed Web of Science ®Google Scholar
• Gunn, B., Smolkowski, K., & Vadasy, P. (2011). Evaluating the effectiveness of Read Well kindergarten. Journal of Research on Educational Effectiveness, 4, 53–86. doi: 10.1080/19345747.2010.488716
   Google Scholar
• Haager, D., Klingner, J.K., & Vaughn, S. (2007a). Evidence-based reading practices for response to intervention. Baltimore, MD: Brookes.
   Google Scholar
• Haager, D., Klingner, J.K., & Vaughn, S. (2007b). Validated reading practices for three tiers of intervention. Baltimore, MD: Brookes.
   Google Scholar
• Harcourt Educational Measurement. (2002). Stanford Achievement Test [SAT-10]. San Antonio, TX: Author.
   Google Scholar
• Harn, B., Kame’enui, E.J., & Simmons, D. (2007). The nature and role of the third tier in a prevention model for kindergarten students. In D. Haager, S. Vaughn, & J. Klingner (Eds.), Evidence-based reading practices for response to intervention (pp. 161–184). New York, NY:Brookes.
   Google Scholar
• Hill, D.R., King, S.A., Lemons, C.J., & Partanen, J.N. (2012). Fidelity of implementation and instructional alignment in response to intervention research. Learning Disabilities Research & Practice, 27, 116–124. doi: 10.1111/j.1540-5826.2012.00357.x
   Web of Science ®Google Scholar
• IDEA. (2004). Individuals with Disabilities Education Act of 2004, Public Law 108-446 Subpart 614(6)(b).
   Google Scholar
• Imbens, G., & Lemieux, T. (2008). Regression discontinuity designs: A guide to practice. Journal of Econometrics, 142, 615–635.
   Web of Science ®Google Scholar
• Judd, C.M., & Kenny, D.A. (1981). Process analysis: Estimating mediation in treatment evaluations. Evaluation Review, 5, 602–619.
   Web of Science ®Google Scholar
• Kame’enui, E.J., Simmons, D., Coyne, M., & Harn, B. (2003). Institute on beginning reading: Day 1. Eugene, OR: IDEA.
   Google Scholar
• Kirschner, P.A., Sweller, J., & Clark, R.E. (2006). Why minimal guidance during instruction does not work: An analysis of the failure of constructivist, discovery, problem-based, experiential, and inquiry-based teaching. Educational Psychologist, 41, 75–86. doi: 10.1207/s15326985ep4102_1
   Web of Science ®Google Scholar
• Mathes, P.G., Denton, C.A., Fletcher, J.M., Anthony, J.L., Francis, D.J., & Schatschneider, C. (2005). The effects of theoretically different instruction and student characteristics on the skills of struggling readers. Reading Research Quarterly, 40, 148–182. doi: 10.1598/rrq.40.2.2
   Web of Science ®Google Scholar
• McMaster, K.L., Kung, S.-H., Han, I., & Cao, M. (2008). Peer-assisted learning strategies: A “Tier 1” approach promoting English Learners’ response to intervention. Exceptional Children, 74, 194–214.
   Web of Science ®Google Scholar
• National Association of State Directors of Special Education. (2006). Response to Intervention: Policy considerations and implementation. Alexandria, VA: Author.
   Google Scholar
• O’Connor, R.E., Fulmer, D., Harty, K.R., & Bell, K.M. (2005). Layers of reading intervention in kindergarten through third grade: Changes in teaching and student outcomes. Journal of Learning Disabilities, 38, 440–455.
   PubMed Web of Science ®Google Scholar
• Oslund, E.L., Hagan-Burke, S., Taylor, A.B., Simmons, D.C., Simmons, L., Kwok, O.-M., … Coyne, M.D. (2012). Predicting kindergarteners’ response to early reading intervention: an examination of progress-monitoring measures. Reading Psychology, 33, 78–103. doi: 10.1080/02702711.2012.630611
   Google Scholar
• Perfetti, C.A. (2007). Reading ability: Lexical quality to comprehension. Scientific Studies of Reading, 11, 357–383. doi: 10.1080/10888430701530730
   Web of Science ®Google Scholar
• Raudenbush, S.W., & Sadoff, S. (2008). Statistical inference when classroom quality is measured with error. Journal of Research on Educational Effectiveness, 1, 138–154. doi: 10.1080/19345740801982104
   Google Scholar
• Reardon, S.F., & Robinson, J.P. (2012). Regression discontinuity designs with multiple rating-score variables. Journal of Research on Educational Effectiveness, 5, 83–104.
   Web of Science ®Google Scholar
• Rodden-Nord, K., Shinn, M.R., & Good, R.H. (1992). Effects of classroom performance data on general education teachers’ willingness to reintegrate mildly handicapped students. School Psychology Review, 21, 138–154.
   Web of Science ®Google Scholar
• Rubin, D.B. (1974). Estimating causal effects of treatments in randomized and nonrandomized studies. Journal of Educational Psychology, 66, 688–701. doi: 10.1037/h0037350
   Web of Science ®Google Scholar
• Rubin, D.B. (1977). Assignment to treatment group on the basis of a covariate. Journal of Educational Statistics, 2, 1–26. doi: 10.2307/1164933
   Google Scholar
• SAS Institute Inc. (2009). SAS/STAT 9.2 user's guide. Cary, NC: Author. Accessed from SAS Product Documentation website: http://support.sas.com/documentation/index.htmldoi:
   Google Scholar
• Shadish, W.R., Cook, T.D., & Campbell, D.T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston, MA: Houghton-Mifflin.
   Google Scholar
• Shinn, M.R., Baker, S.K., Habedank, L., & Good, R.H. (1993). The effects of classroom reading performance data on general education teachers’ and parents’ attitudes about reintegration. Exceptionality, 4, 205–228. doi: 10.1207/s15327035ex0404_1
   Google Scholar
• Shinn, M.R., Habedank, L., & Baker, S.K. (1993). Reintegration as part of a problem-solving delivery service. Exceptionality, 4, 245–251. doi: 10.1207/s15327035ex0404_3
   Google Scholar
• Smith, J.L. M., Fien, H., Nelson-Walker, N.J., Smolkowski, K., & Baker, S.K. (2013). Examining the impact of a multi-tiered reading intervention in first grade: A clustered-randomized controlled trial. Manuscript in preparation.
   Google Scholar
• Smolkowski, K., & Gunn, B. (2012). Reliability and validity of the Classroom Observations of Student-Teacher Interactions (COSTI) for kindergarten reading instruction. Early Childhood Research Quarterly, 27, 316–328. doi: 10.1016/j.ecresq.2011.09.004
   Web of Science ®Google Scholar
• Smolkowski, K., Strycker, L., & Seeley, J.R. (2013). The role of research evaluation for interventions on school-related behavior disorders. In H.M. Walker & F. M. Gresham (Eds.), Handbook of evidence-based practices for students having emotional and behavioral disorders (pp. 552--566). New York: Guilford.
   Google Scholar
• Spectrum K12 School Solutions. (2010). Response to Intervention adoption survey 2010. Towson, MD: Author.
   Google Scholar
• Sutherland, K.S., Alder, N., & Gunter, P.L. (2003). The effect of varying rates of opportunities to respond to academic requests on the classroom behavior of students with EBD. Journal of Emotional and Behavioral Disorders, 11, 239–248. doi: 10.1177/10634266030110040501
   Web of Science ®Google Scholar
• Taylor, B.M., Pearson, P.D., Clark, K.F., & Walpole, S. (1999). Beating the odds in teaching all children to read (Report No. 2-006). Ann Arbor, MI: Center for the Improvement of Early Reading Achievement, University of Michigan. Retrieved from http://www.eric.ed.gov/ERICWebPortal/detail?accno=ED436723
   Google Scholar
• Thurlow, M.L., Ysseldyke, J.E., Wotruba, J.W., & Algozzine, B. (1993). Instruction in special education classrooms under varying student-teacher ratios. The Elementary School Journal, 93, 305–320. doi: 10.2307/1001897
   Web of Science ®Google Scholar
• Vadasy, P.F., Sanders, E.A., & Peyton, J.A. (2005). Relative effectiveness of reading practice or word-level instruction in supplemental tutoring. Journal of Learning Disabilities, 38, 364–380. doi: 10.1177/00222194050380041401
   PubMed Web of Science ®Google Scholar
• Vaughn, S., Linan-Thompson, S., & Hickman, P. (2003). Response to instruction as a means of identifying students with reading/learning disabilities Exceptional Children, 69, 391–411.
   Web of Science ®Google Scholar
• Vaughn, S., Linan-Thompson, S., Kouzekanani, K., Pedrotty Bryant, D., Dickson, S., & Blozis, S.A. (2003). Reading instruction grouping for students with reading difficulties. Remedial and Special Education, 24, 301–315. doi: 10.1177/07419325030240050501
   Web of Science ®Google Scholar
• Vellutino, F., Scanlon, D.M., Sipay, E.R., Small, S.G., Pratt, A., Chen, R., & Denckla, M.B. (1996). Cognitive profiles of difficult-to-remediate and readily remediated poor readers: Intervention as a vehicle for distinguishing between cognitive and experimental deficits as basic cause of specific reading disability. Journal of Educational Psychology, 88, 601–638. doi: 10.1037/0022-0663.88.4.601
   Web of Science ®Google Scholar
• Walker, H.M., & Shinn, M.R. (2002). Structuring school-based interventions to achieve integrated primary, secondary, and tertiary prevention goals for safe and effective schools. In H.M. Walker & G. Stoner (Eds.), Interventions for academic and behavior problems II: Preventive and remedial approaches (pp. 1–26). Washington, DC: National Association of School Psychologists.
   Google Scholar
• Wanzek, J., & Cavanaugh, C. (2012). Characteristics of general education reading interventions implemented in elementary schools for students with reading difficulties. Remedial and Special Education, 33, 192–202. doi: 10.1177/0741932510383162
   PubMed Web of Science ®Google Scholar
• Warren, S.F., Fey, M.E., & Yoder, P.J. (2007). Differential treatment intensity research: A missing link to creating optimally effective communication interventions. Mental Retardation and Developmental Disabilities Research Reviews, 13, 70–77. doi: 10.1002/mrdd.20139
   PubMedGoogle Scholar
• Watts-Taffe, S., Laster, B.P., Broach, L., Marinak, B., McDonald Connor, C., & Walker-Dalhouse, D. (2012). Differentiated instruction: Making informed teacher decisions. The Reading Teacher, 66, 303–314. doi: 10.1002/trtr.01126
   Web of Science ®Google Scholar
• Western Regional Reading First Technical Assistance Center. (2005). Instructional routine templates 1-17. Eugene, OR: Author.
   Google Scholar
• Wing, C., & Cook, T. D. (2013). Strengthening the regression discontinuity design using additional design elements: A within-study comparison. Journal of Policy Analysis and Management, 32, 853–877.
   Web of Science ®Google Scholar