Generalizability of Multiple Measures of Treatment Integrity: Comparisons Among Direct Observation, Permanent Products, and Self-Report

References

• Barnett, D., Hawkins, R., & Lentz, F. E., Jr. (2011). Intervention adherence for research and practice: Necessity or triage outcome? Journal of Educational and Psychological Consultation, 21, 175–190. doi:10.1080/10474412.2011.595162
   Web of Science ®Google Scholar
• Barrish, H. H., Saunders, M., & Wolf, M. M. (1969). Good behavior game: Effects of individual contingencies for group consequences on disruptive behavior in a classroom. Journal of Applied Behavior Analysis, 2(2), 119–124. doi:10.1901/jaba.1969.2-119
   PubMed Web of Science ®Google Scholar
• Briesch, A. M., Swaminathan, H., Welsh, M., & Chafouleas, S. M. (2014). Generalizability theory: A practical guide to study design, implementation, and interpretation. Journal of School Psychology, 52, 13–35. doi:10.1016/j.jsp.2013.11.008
   PubMed Web of Science ®Google Scholar
• Chafouleas, S. M., Christ, T. J., Riley-Tillman, T. C., Briesch, A. M., & Chanese, J. A. M. (2007). Generalizability and dependability of direct behavior ratings to assess social behavior of preschoolers. School Psychology Review, 36(1), 63–79.
   Web of Science ®Google Scholar
• Codding, R. S., Livanis, A., Pace, G. M., & Vaca, L. (2008). Using performance feedback to improve treatment integrity of classwide behavior plans: An investigation of observer reactivity. Journal of Applied Behavior Analysis, 41(3), 417–422. doi:10.1901/jaba.2008.41-417
   PubMed Web of Science ®Google Scholar
• Cone, J. D. (1988). Psychometric considerations and the multiple models of behavioral assessment. In A. S. Bellack & M. Hersen (Eds.), Behavioral assessment: A practical approach (3rd ed., pp. 42–66). New York, NY: Pergamon.
   Google Scholar
• Cronbach, L. J., Gleser, G. C., Nanda, H., & Rajaratnam, N. (1972). The dependability of behavioral measurements: Theory of generalizability for scores and profiles. New York, NY: John Wiley & Sons. doi:10.1086/225651
   Google Scholar
• Dart, E. H., Cook, C. R., Collins, T. A., Gresham, F. M., & Chenier, J. S. (2012). Test driving interventions to increase treatment integrity and student outcomes. School Psychology Review, 41(4), 467–481.
   Web of Science ®Google Scholar
• Donaldson, J. M., Vollmer, T. R., Krous, T., Downs, S., & Berard, K. P. (2011). An evaluation of the good behavior game in kindergarten classrooms. Journal of Applied Behavior Analysis, 44(3), 605–609. doi:10.1901/jaba.2011.44-605
   PubMed Web of Science ®Google Scholar
• Embry, D. D. (2002). The good behavior game: A best practice candidate as a universal behavioral vaccine. Clinical Child and Family Psychology Review, 5(4), 273–297. doi:10.1023/A:1020977107086
   PubMed Web of Science ®Google Scholar
• Fallon, L. M., Collier-Meek, M. A., Sanetti, L. M., Feinberg, A. B., & Kratochwill, T. R. (2016). Implementation planning to promote parents' treatment integrity of behavioral interventions for children with autism. Journal of Educational and Psychological Consultation, 26, 87–109. doi:10.1080/10474412.2015.1039124
   Web of Science ®Google Scholar
• Flower, A., McKenna, J. W., Bunuan, R. L., Muething, C. S., & Vega, R., Jr. (2014). Effects of the good behavior game on challenging behaviors in school settings. Review of Educational Research, 84(4), 546–571. doi:10.3102/0034654314536781
   Web of Science ®Google Scholar
• Frank, J. L., & Kratochwill, T. R. (2014). School-based problem-solving consultation. In W. P. Erchul & S. M. Sheridan (Eds.), Handbook of Research in School Consultation, 19–39. New York, NY: Routledge.
   Google Scholar
• Harris, V. W., & Sherman, J. A. (1973). Use and analysis of the “good behavior game” to reduce disruptive classroom behavior. Journal of Applied Behavior Analysis, 6(3), 405–417. doi:10.1901/jaba.1973.6-405
   PubMed Web of Science ®Google Scholar
• Hintze, J. M., & Matthews, W. J. (2004). The generalizability of systematic direct observations across time and setting: A preliminary investigation of the psychometrics of behavioral observation. School Psychology Review, 33(2), 258–270.
   Web of Science ®Google Scholar
• Kazdin, A. E. (1977). Artifact, bias, and complexity of assessment: The ABCs of reliability. Journal of Applied Behavior Analysis, 10(1), 141–150. doi:10.1901/jaba.1977.10-141
   PubMed Web of Science ®Google Scholar
• Lane, K. L., Bocian, K. M., MacMillan, D. L., & Gresham, F. M. (2004). Treatment integrity: An essential—but often forgotten—component of school-based interventions. Preventing School Failure: Alternative Education for Children and Youth, 48, 36–43. doi:10.3200/PSFL.48.3.36-43
   Google Scholar
• Mushquash, C., & O'Connor, B. P. (2006). SPSS, SAS, and MATLAB programs for generalizability theory analyses. Behavior Research Methods, 38, 542–547.
   PubMed Web of Science ®Google Scholar
• Noell, G. H. (2008). Research examining the relationships among consultation process, treatment integrity, and outcomes. In W. P. Erchul & S. M. Sheridan (Eds.), Handbook of research in school consultation (pp. 323–341). New York, NY: Routledge.
   Google Scholar
• Noell, G. H., Witt, J. C., Gilbertson, D. N., Ranier, D. D., & Freeland, J. T. (1997). Increasing teacher intervention implementation in general education settings through consultation and performance feedback. School Psychology Quarterly, 12(1), 77–88. doi:10.1037/h0088949
   Web of Science ®Google Scholar
• Peterson, L., Homer, A. L., & Wonderlich, S. A. (1982). The integrity of independent variables in behavior analysis. Journal of Applied Behavior Analysis, 15(4), 477–492. doi:10.1901/jaba.1982.15-477
   PubMed Web of Science ®Google Scholar
• Pipkin, C. S. P., Vollmer, T. R., & Sloman, K. N. (2010). Effects of treatment integrity failures during differential reinforcement of alternative behavior: A translational model. Journal of Applied Behavior Analysis, 43(1), 47–70. doi:10.1901/jaba.2010.43-47
   PubMed Web of Science ®Google Scholar
• Salvia, J., & Ysseldyke, J. E. (2004). Assessment (9th ed.). Princeton, NJ: Houghton Mifflin.
   Google Scholar
• Sanetti, L. M. H., & Kratochwill, T. R. (2007). Treatment integrity in behavioral consultation: Measurement, promotion, and outcomes. International Journal of Behavioral Consultation and Therapy, 4(1), 95–114. doi:10.1037/h0100835
   Google Scholar
• Sanetti, L. M. H., & Kratochwill, T. R. (2009). Toward developing a science of treatment integrity: Introduction to the special series. School Psychology Review, 38(4), 445–459.
   Web of Science ®Google Scholar
• Sheridan, S. M., Swanger-Gagne, M., Welch, G. W., Kwon, K., & Garbacz, S. A. (2009). Fidelity measurement in consultation: Psychometric issues and preliminary examination. School Psychology Review, 38(4), 476–495.
   Web of Science ®Google Scholar
• Sterling-Turner, H. E., Watson, T. S., & Moore, J. W. (2002). The effects of direct training and treatment integrity on treatment outcomes in school consultation. School Psychology Quarterly, 17, 47–77. doi:10.1521/scpq.17.1.47.19906
   Web of Science ®Google Scholar
• Tanol, G., Johnson, L., McComas, J., & Cote, E. (2010). Responding to rule violations or rule following: A comparison of two versions of the good behavior game with kindergarten students. Journal of School Psychology, 48(5), 337–355. doi:10.1016/j.jsp.2010.06.001
   PubMed Web of Science ®Google Scholar
• Tingstrom, D. H., Sterling-Turner, H. E., & Wilczynski, S. M. (2006). The good behavior game: 1969-2002. Behavior Modification, 30, 225–253. doi:10.1177/0145445503261165
   PubMed Web of Science ®Google Scholar
• U.S. Department of Education (2009). Institute of Education Sciences Education Research Request for Applications. Retrieved from http://ies.ed.gov/funding/10rfas.asp
   Google Scholar
• Volpe, R. J., & Briesch, A. M. (2012). Generalizability and dependability of single-item and multiple-item direct behavior rating scales for engagement and disruptive behavior. School Psychology Review, 41(3), 246–261.
   Web of Science ®Google Scholar
• Yeaton, W. H., & Sechrest, L. (1981). Critical dimensions in the choice and maintenance of successful treatments: Strength, integrity, and effectiveness. Journal of Consulting and Clinical Psychology, 49(2), 156–167. doi:10.1037/0022-006X.49.2.156
   PubMed Web of Science ®Google Scholar