Examining the variation of fidelity across an intervention: Implications for measuring and evaluating student learning

References

• Abry, T., Hulleman, C. S., & Rimm-Kaufman, S. E. (2015). Using indices of fidelity to intervention core components to identify program active ingredients. American Journal of Evaluation, 36, 320–338.
   Web of Science ®Google Scholar
• Adams, M. J., Bereiter, C., Brown, A., Campione, J., Caruthers, I., Case, R., Hirshberg, J., ... Treadway, J. (2000). Open court reading. Columbus, OH: SRA.
   Google Scholar
• Al Otaiba, S., & Fuchs, D. (2006). Who are the young children for whom best practices in reading are ineffective? An experimental and longitudinal study. Journal of Learning Disabilities, 39, 414–431.
   PubMed Web of Science ®Google Scholar
• Benner, G. J., Nelson, J. R., Stage, S. A., & Ralston, N. C. (2011). The influence of fidelity of implementation on the reading outcomes of middle school students experiencing reading difficulties. Remedial and Special Education, 32(1), 79–88.
   Web of Science ®Google Scholar
• Bishop, D., Pankratz, M., Hansen, W. B., Albritton, J., Albritton, L., & Strack, J. (2014). Measuring fidelity and adaptation: Reliability of a instrument for school-based prevention programs. Evaluation and the Health Professions, 37(2), 231–257.
   PubMed Web of Science ®Google Scholar
• Boardman, A. G., Buckley, P., Vaughn, S., Roberts, G., Scornavacco, K., & Klingner, J. (2016). Relationship between implementation of Collaborative Strategic Reading and student outcomes for adolescents with disabilities. Journal of Learning Disabilities, 49, 644–657.
   PubMed Web of Science ®Google Scholar
• Carroll, C., Patterson, M., Wood, S., Booth, A., Rick, J., & Balain, S. (2007). A conceptual framework for implementation fidelity. Implementation Science, 2(40). doi:10.1186/1748-5908-2-40
   PubMed Web of Science ®Google Scholar
• Castro, F. G., Barrera, M., & Martinez, C. R. (2004). The cultural adaptation of prevention interventions: Resolving tensions between fidelity and fit. Prevention Science, 5(1), 41–45.
   PubMed Web of Science ®Google Scholar
• Chard, D. J., & Harn, B. A. (2008). Project CIRCUITS. In C. Greenwood, T. Kratochwill, & M. Clements (Eds.), Schoolwide prevention models: Lessons learned in elementary schools (pp. 143–172). New York, NY: Guilford.
   Google Scholar
• Cordray, D. S. (2007). Fidelity of intervention implementation. Retrieved from https://ies.ed.gov/ncer/whatsnew/conferences/rct_traininginstitute/index.asp
   Google Scholar
• Dearing, J. W. (2008). Evolution of diffusion and dissemination theory. Journal of Public Health Management and Practice, 14(2), 99–108.
   PubMed Web of Science ®Google Scholar
• Dunn, L., & Dunn, L. (1981). Peabody Picture Vocabulary Test—Revised. Circle Pines, MN: American Guidance Service.
   Google Scholar
• Durlak, J. A., & DuPre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41, 327–350.
   PubMed Web of Science ®Google Scholar
• Fixsen, D. L., Blase, K., Metz, A., & Van Dyke, M. (2013). Statewide implementation of evidence-based programs. Exceptional Children, 79(2), 213–230.
   Web of Science ®Google Scholar
• Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network.
   Google Scholar
• Gersten, R. M., Carnine, D. W., & Williams, P. B. (1982). Measuring implementation of a structured educational model in an urban school district: An observational approach. Educational Evaluation and Policy Analysis, 4, 67–79.
   Google Scholar
• Gersten, R., Fuchs, L. S., Compton, D., Coyne, M., Greenwood, C., & Innocenti, M. S. (2005). Quality indicators for group experimental and quasi-experimental research in special education. Exceptional Children, 71(2), 149–164.
   Google Scholar
• Good, R. H., Gruba, J., & Kaminski, R. A. (2002). Best practices in using Dynamic Indicators of Basic Early Literacy Skills (DIBELS) in an outcomes-driven model. In A. Thomas & J. Grimes (Eds.), Best practices in school psychology IV (pp. 699–720). Bethesda, MD: National Association of School Psychologists.
   Google Scholar
• Green, L. W. (2001). From research to “best practices” in other settings and populations. American Journal of Health Behavior, 25(3), 165–178.
   PubMed Web of Science ®Google Scholar
• Gresham, F. M. (1989). Assessment of treatment integrity in school consultation and prereferral intervention. School Psychology Review, 18, 37–50.
   Web of Science ®Google Scholar
• Gresham, F. M., Gansle, K. A., Noell, G. H., Cohen, S., & Rosenblum, S. (1993). Treatment integrity of school-based behavioral intervention studies: 1980–1990. School Psychology Review, 22, 254–272.
   Google Scholar
• Gresham, F. M., MacMillan, D. L., Beebe-Frankenberger, M. E., & Bocian, K. M. (2000). Treatment integrity in learning disabilities intervention research: Do we really know how treatments are implemented? Learning Disabilities Research & Practice, 15, 198–205.
   Google Scholar
• Harn, B. A., Parisi, D., & Stoolmiller, M. (2013). Balancing fit and flexibility with fidelity: What do we really know about “fidelity of implementation” in schools? Exceptional Children, 79, 181–194.
   Web of Science ®Google Scholar
• Hayes, S. C., Nelson, R. O., & Jarret, R. B. (1986). Evaluating the quality of behavioral assessment. In R. Nelson & S. Hayes (Eds.), Conceptual foundations of behavioral assessment (pp. 461–503). New York, NY: Guilford.
   Google Scholar
• Justice, L. M., Mashburn, A. J., Hamre, B. K., & Pianta, R. C. (2008). Quality of language and literacy instruction in preschool classrooms serving at-risk pupils. Early Childhood Research Quarterly, 23(1), 51–68.
   PubMed Web of Science ®Google Scholar
• Kaderavek, J. N., & Justice, L. M. (2010). Fidelity: An essential component of evidence-based practice in speech-language pathology. American Journal of Speech-Language Pathology, 19, 369–379.
   PubMed Web of Science ®Google Scholar
• Kaminski, R. A., & Good, R. H. (1996). Toward a technology for assessing basic early literacy skills. School Psychology Review, 25(2), 215–227.
   Web of Science ®Google Scholar
• Kovaleski, J. F., Gickling, E. E., Morrow, H., & Swank, P. R. (1999). High versus low implementation of instructional support teams: A case for maintaining program fidelity. Remedial and Special Education, 20, 170–183.
   Web of Science ®Google Scholar
• McHugo, G. J., Drake, R. E., Whitley, R., Bond, G. R., Campbell, K., Rapp, C. A., . . . Finnerty, M.T. (2007). Fidelity outcomes in the national implementing evidence-based practices project. Psychiatric Services, 58, 1279–1284.
   PubMed Web of Science ®Google Scholar
• Moncher, F. J., & Prinz, R. J. (1991). Treatment fidelity in outcome studies. Clinical Psychology Review, 11, 247–266.
   Web of Science ®Google Scholar
• Mowbray, C. T., Holter, M. C., Teague, G. B., & Bybee, D. B. (2003). Fidelity criteria: Development, measurement, and validation. American Journal of Evaluation, 24, 315–340.
   Web of Science ®Google Scholar
• Odom, S. (2008). The tie that binds: Evidence-based practice, implementation science, and outcomes for children. Topics in Early Childhood Special Education, 29, 53–61.
   Google Scholar
• Odom, S. L., Fleming, K., Diamond, K., Lieber, J., Hanson, M., Butera, G., . . . Children's School Success Project. (2010). Examining different forms of implementation and in early childhood curriculum research. Early Childhood Research Quarterly, 25, 314–328.
   PubMed Web of Science ®Google Scholar
• O'Donnell, C. L. (2008). Defining, conceptualizing, and measuring fidelity of implementation and its relationship to outcomes in K–12 curriculum intervention research. Review of Educational Research, 78(1), 33–84.
   Web of Science ®Google Scholar
• Power, T. J., Blom-Hoffman, J., Clarke, A. T., Riley-Tillman, T. C., Kelleher, C., & Manz, P. H. (2005). Reconceptualizing intervention integrity: A partnership-based framework for linking research with practice. Psychology in the Schools, 42. doi:10.1002/pits.20087
   Web of Science ®Google Scholar
• Simmons, D., & Kame'enui, E. (2005). Scott Foresman early reading intervention. New York, NY: Pearson.
   Google Scholar
• Simmons, D. C., Kame'enui, E. J., Harn, B., Coyne, M. D., Stoolmiller, M., Santoro, L. E., . . . Kaufman, N. K. (2007). Attributes of effective and efficient kindergarten intervention: An examination of instructional time and design specificity. Journal of Learning Disabilities, 40(4), 331–347.
   PubMed Web of Science ®Google Scholar
• Stoolmiller, M., Eddy, J. M., & Reid, J. B. (2000). Detecting and describing preventive intervention effects in a universal school-based randomized trial targeting delinquent and violent behavior. Journal of Consulting and Clinical Psychology, 68(2), 296–306.
   PubMed Web of Science ®Google Scholar
• Swain, K., Whitley, R., McHugo, G. J., & Drake, R. E. (2010). The sustainability of evidence-based practices in routine mental health agencies. Community Mental Health Journal, 46(2), 119–129.
   PubMed Web of Science ®Google Scholar
• Torres, C., Farley, C. A., & Cook, B. G. (2012). A special educator's guide to successfully implementing evidence-based practices. Teaching Exceptional Children, 45(1), 64–73.
   Google Scholar
• van Otterloo, S. G., van der Leij, A., & Veldkamp, E. (2006). Treatment integrity in a home-based pre-reading intervention programme. Dyslexia, 12, 155–176.
   PubMed Web of Science ®Google Scholar
• Woodcock, R. (1987). Woodcock Reading Mastery Test—Revised. Circle Pines, MN: American Guidance Service.
   Google Scholar
• Yeaton, W. H., & Sechrest, L. (1981). Critical dimensions in the choice and maintenance of successful treatments: Strength, integrity, and effectiveness. Journal of Consulting and Clinical Psychology, 49(2), 156–167.
   PubMed Web of Science ®Google Scholar
• Zvoch, K. (2009). Treatment fidelity in multisite evaluation: A multilevel longitudinal examination of provider adherence status and change. American Journal of Evaluation, 30(1), 44–61.
   Web of Science ®Google Scholar
• Zvoch, K., Letourneau, L. E., & Parker, R. P. (2007). A multilevel multisite outcomes-by-implementation evaluation of an early childhood literacy model. American Journal of Evaluation, 28, 132–150.
   Web of Science ®Google Scholar