Psychometric Properties of the Classroom Observation of Engagement, Disrespectful and Disruptive Behaviors

REFERENCES

• Abikoff, H., & Gittelman, R. (1985). Classroom observation code: A modification of the Stony Brook Code. Psychopharmacology Bulletin, 21, 901–909.
   Google Scholar
• Abikoff, H. B., Jensen, P. S., Arnold, L. L. E., Hoza, B., Hechtman, L., Pollack, S., Martin, D., Alvir, J., March, J. S., Hinshaw, S., Vitiello, B., Newcorn, J., Greiner, A., Cantwell, D. P., Conners, C. K., Elliott, G., Greenhill, L. L., Kraemer, H., Pelham, W. E., Jr., … Wigal, T. (2002). Observed classroom behavior of children with ADHD: Relationship to gender and comorbidity. Journal of Abnormal Child Psychology, 4, 349–359. https://doi.org/10.1023/A:1015713807297
   Google Scholar
• Achenbach, T. M. (1991a). Manual for the child behavior checklist/4-18 and 1991 profile. University of Vermont, Department of Psychiatry.
   Google Scholar
• Achenbach, T. M. (1991b). Manual for the teachers report form and 1991 profile. University of Vermont, Department of Psychiatry.
   Google Scholar
• American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). https://doi.org/10.1176/appi.books.9780890425596
   Google Scholar
• Arceneaux, M. C., & Murdock, J. Y. (1997). Peer prompting reduces disruptive vocalizations of a student with developmental disabilities in a general eighth-grade classroom. Focus on Autism and Other Developmental Disabilities, 12(3), 182–186. https://doi.org/10.1177/108835769701200307
   Google Scholar
• Bagner, D. M., Boggs, S. R., & Eyberg, S. M. (2010). Evidence-based school behavior assessment of externalizing behavior in young children. Education & Treatment of Children, 33(1), 65–83. https://doi.org/10.1353/etc.0.0084
   PubMedGoogle Scholar
• Benson, N., Floyd, R., Kranzler, J., Eckert, T., Fefer, S., & Morgan, G. (2019). Test use and assessment practices of school psychologists in the United States: Findings from the 2017 National Survey. Journal of School Psychology, 72, 29–48. https://doi.org/10.1016/j.jsp.2018.12.004
   PubMed Web of Science ®Google Scholar
• Briesch, A. M., Volpe, R. J., & Floyd, R. G. (2018). School-based observation: A practical guide to assessing student behavior. Guilford Press.
   Google Scholar
• Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56(2), 81–105. https://doi.org/10.1037/h0046016
   PubMed Web of Science ®Google Scholar
• Chafouleas, S. M. (2011). Direct behavior rating: A review of the issues and research in its development. Education and Treatment of Children, 34(4), 575–591. https://doi.org/10.1353/etc.2011.0034
   Google Scholar
• Chafouleas, S. M., & Miller, F. G. (2015). Respect. In W. George Scarlett (Ed.), Encyclopedia of classroom management (pp. 670–672). SAGE Publications.
   Google Scholar
• Christ, T. J., Riley-Tillman, T. C., Chafouleas, S., & Jaffery, R. (2011). Direct behavior rating: An evaluation of alternate definitions to assess classroom behaviors. School Psychology Review, 40(2), 181–199. https://doi.org/10.1080/02796015.2011.12087712
   Web of Science ®Google Scholar
• Claessens, A., & Dowsett, C. (2014). Growth and change in attention problems, disruptive behavior, and achievement from kindergarten to fifth grade. Psychological Science, 25(12), 2241–2251. https://doi.org/10.1177/0956797614554265
   PubMed Web of Science ®Google Scholar
• Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Routledge Academic.
   Google Scholar
• Conners, C. K. (2008). Conners manual (3rd ed.). Multi-Health Systems.
   Google Scholar
• Cunningham, J. M., & Suldo, S. M. (2014). Accuracy of teachers in identifying elementary school students who report at-risk levels of anxiety and depression. School Mental Health, 6(4), 237–250. https://doi.org/10.1007/s12310-014-9125-9
   Web of Science ®Google Scholar
• Daniels, B., Volpe, R. J., Fabiano, G. A., & Briesch, A. M. (2017). Classification accuracy and acceptability of the Integrated Screening and Intervention System Teacher Rating Form. School Psychology Quarterly, 32(2), 212–225. https://doi.org/10.1037/spq0000147
   PubMed Web of Science ®Google Scholar
• Delis, D. (2012). Delis-Rating of Executive Function (D-REF). Pearson.
   Google Scholar
• Didaskalou, E., Briesch, A. M., Volpe, R. J., & Roussi-Vergou, C. (2020). Psychometric properties of the classroom observation of engagement, disruptive, and disrespectful behavior (COEDD) in Greek school children. International Journal of School & Educational Psychology. https://doi.org/10.1080/21683603.2020.1776180
   PubMedGoogle Scholar
• DiPerna, J. C., Volpe, R. J., & Elliott, S. N. (2002). A model of academic enablers and elementary reading/language arts achievement. School Psychology Review, 31(3), 298–312. https://doi.org/10.1080/02796015.2002.12086157
   Web of Science ®Google Scholar
• DuPaul, G. J., & Stoner, G. (2014). ADHD in the schools: Assessment and intervention strategies. Guilford Publications.
   Google Scholar
• DuPaul, G. J., Volpe, R. J., Jitendra, A. K., Lutz, J. G., Lorah, K. S., & Gruber, R. (2004). Elementary school students with attention-deficit/hyperactivity disorder: Predictors of academic achievement. Journal of School Psychology, 42(4), 285–301. https://doi.org/10.1016/j.jsp.2004.05.001
   Web of Science ®Google Scholar
• Evertson, C. M., & Weinstein, C. S. (2006). Handbook of classroom management: Research, practice, and contemporary issues. Routledge.
   Google Scholar
• Faul, A., Stepensky, K., & Simonsen, B. (2012). The effects of prompting appropriate behavior on the off-task behavior of two middle school students. Journal of Positive Behavior Interventions, 14(1), 47–55. https://doi.org/10.1177/1098300711410702
   Web of Science ®Google Scholar
• Ferguson, T. D., Briesch, A. M., Volpe, R. J., & Daniels, B. (2012). The influence of observation length on the dependability of data. School Psychology Quarterly, 27(4), 187–197. https://doi.org/10.1037/spq0000005
   PubMed Web of Science ®Google Scholar
• Flood, W. A., & Wilder, D. A. (2002). Antecedent assessment and assessment-based treatment of off-task behavior in a child diagnosed with Attention Deficit-Hyperactivity Disorder. Education and Treatment of Children, 25(3), 331–338.
   Google Scholar
• Gadow, K. D., Paolicelli, L. M., Nolan, E., Schwartz, J., Sprafkin, J., & Sverd, J. (1992). Methylphenidate in aggressive hyperactive boys: II. Indirect Effects of Medication Treatment on Peer Behavior. Journal of Child and Adolescent Psychopharmacology, 2(1), 49–61. https://doi.org/10.1089/cap.1992.2.49
   PubMedGoogle Scholar
• Gadow, K., Sprafkin, J., & Nolan, E. (1996). ADHD school observation code. Checkmate Plus.
   Google Scholar
• Glover, T. A., & Albers, C. A. (2007). Considerations for evaluating universal screening assessments. Journal of School Psychology, 45(2), 117–135. https://doi.org/10.1016/j.jsp.2006.05.005
   Web of Science ®Google Scholar
• Greene, R. W., Beszterczey, S. K., Katzenstein, T., Park, K., & Goring, J. (2002). Are students with ADHD more stressful to teach?: Patterns of teacher stress in an elementary school sample. Journal of Emotional and Behavioral Disorders, 10(2), 79–89. https://doi.org/10.1177/10634266020100020201
   Web of Science ®Google Scholar
• Greenwood, C. R., Terry, B., Marquis, J., & Walker, D. (1994). Confirming a performance-based instructional model. School Psychology Review, 23(4), 652–668. https://doi.org/10.1080/02796015.1994.12085740
   Web of Science ®Google Scholar
• Guerra, N. G., & Smith, E. P. E. (2006). Preventing youth violence in a multicultural society. American Psychological Association.
   Google Scholar
• Harty, S. C., Miller, C. J., Newcorn, J. H., & Halperin, J. M. (2009). Adolescents with childhood ADHD and comorbid disruptive behavior disorders: Aggression, anger, and hostility. Child Psychiatry and Human Development, 40(1), 85–97. https://doi.org/10.1007/s10578-008-0110-0
   PubMed Web of Science ®Google Scholar
• Hawkins, R., & Dobes, R. (1977). Behavioral definitions in applied behavior analysis: Explicit or implicit?. In D. Baer, J. LeBlanc, & B. Etzel (Eds.), New developments in behavioral research: Theory, method and application (pp. 167–188). Routledge. https://doi.org/10.1201/9781003046110-14
   Google Scholar
• Headley, C., & Campbell, M. (2013). Teachers’ knowledge of anxiety and identification of excessive anxiety in children. Australian Journal of Teacher Education, 38(5), 48–66. https://doi.org/10.14221/ajte.2013v38n5.2
   Google Scholar
• Hinshaw, S. P., & Lee, S. S. (2003). Conduct and oppositional defiant disorders. In Child psychopathology (2nd ed., pp. 144–198). Guilford Press.
   Google Scholar
• Hintze, J. (2005). Psychometrics of direct observation. School Psychology Review, 34(4), 507–519. https://doi.org/10.1080/02796015.2005.12088012
   Web of Science ®Google Scholar
• Hintze, J. M., Volpe, R. J., & Shapiro, E. S. (2002). Best practices in the systematic direct observation of student behavior. In A. Thomas & J. Grimes (Eds.), Best practices in school psychology (5th ed., pp. 993–1006). National Association of School Psychologists.
   Google Scholar
• Kelly, M. B. (1977). A review of the observational data-collection and reliability procedures reported in The Journal of Applied Behavior Analysis. Journal of Applied Behavior Analysis, 10(1), 97–101. https://doi.org/10.1901/jaba.1977.10-97
   PubMed Web of Science ®Google Scholar
• Kranzler, J. H., & Floyd, R. G. (2013). Assessing intelligence in children and adolescents: A practical guide. Guilford Press.
   Google Scholar
• Loney, J., & Milich, R. (1982). Hyperactivity, inattention, and aggression in clinical practice: The IOWA Conners’ Teachers Rating scale. In M. Wolraich & D. K. Routh (Eds.), Advances in developmental and behavioral pediatrics (Vol. 3, pp. 113–147). JAI Press.
   Google Scholar
• McClowry, S. G., Snow, D. L., Tamis-Lemonda, C. S., & Rodriguez, E. T. (2010). Testing the efficacy of INSIGHTS on student disruptive behavior, classroom management, and student competence in inner city primary grades. School Mental Health, 2(1), 23–35. https://doi.org/10.1007/s12310-009-9023-8
   PubMedGoogle Scholar
• Miller, F. G., Johnson, A. H., Yu, H., Chafouleas, S. M., McCoach, D. B., Riley-Tillman, T. C., Fabiano, G. A., & Welsh, M. E. (2018). Methods matter: A multi-trait multi-method analysis of student behavior. Journal of School Psychology, 68, 53–72. https://doi.org/10.1016/j.jsp.2018.01.002
   PubMed Web of Science ®Google Scholar
• Noyes, R. (2001). Comorbidity in generalized anxiety disorder. Psychiatric Clinics of North America, 24(1), 41–55. https://doi.org/10.1016/S0193-953X(05)70205-7
   PubMed Web of Science ®Google Scholar
• Owens, J. S., Holdaway, A. S., Smith, J., Evans, S. W., Himawan, L. K., Coles, E. K., Girio-Herrera, E., Mixon, C. S., Egan, T. E., & Dawson, A. E. (2018). Rates of common classroom behavior management strategies and their associations with challenging student behavior in elementary school. Journal of Emotional and Behavioral Disorders, 26(3), 156–169. https://doi.org/10.1177/1063426617712501
   Web of Science ®Google Scholar
• Rabiner, D., & Coie, J. D. (2000). Early attention problems and children’s reading achievement: A longitudinal investigation. The Conduct Problems Prevention Research Group. Journal of the American Academy of Child and Adolescent Psychiatry, 39(7), 859–867. https://doi.org/10.1097/00004583-200007000-00014
   PubMed Web of Science ®Google Scholar
• Reynolds, C. R., & Kamphaus, R. W. (2004). Behavior assessment system for children (2nd ed.). Pearson.
   Google Scholar
• Reynolds, C. R., & Kamphaus, R. W. (2015). Behavior assessment system for children (3rd ed.). Pearson.
   Google Scholar
• Schaeffer, C. M., Petras, H., Ialongo, N., Masyn, K. E., Hubbard, S., Poduska, J., & Kellam, S. (2006). A comparison of girls’ and boys’ aggressive-disruptive behavior trajectories across elementary school: Prediction to young adult antisocial outcomes. Journal of Consulting and Clinical Psychology, 74(3), 500–510. https://doi.org/10.1037/0022-006X.74.3.500
   PubMed Web of Science ®Google Scholar
• Shapiro, E. S. (2004). Academic skills problems workbook (rev). Guilford Press.
   Google Scholar
• Shapiro, E. S., & Heick, P. F. (2004). School psychologist assessment practices in the evaluation of students referred for social/behavioral/emotional problems. Psychology in the Schools, 41(5), 551–561. https://doi.org/10.1002/pits.10176
   Web of Science ®Google Scholar
• Snyder, J., & Stoolmiller, M. (2002). Reinforcement and coercion mechanisms in the development of antisocial behavior: The family. In J. B. Reid, G. R. Patterson, & J. Snyder (Eds.), Antisocial behavior in children and adolescents: A developmental analysis and model for intervention (pp. 65–100). American Psychological Association. https://doi.org/10.1037/10468-004
   Google Scholar
• Sprafkin, J., Gadow, K. D., & Nolan, E. E. (2001). The utility of a DSM-IV-referenced screening instrument for attention-deficit/hyperactivity disorder. Journal of Emotional and Behavioral Disorders, 9(3), 182–191. https://doi.org/10.1177/106342660100900304
   Web of Science ®Google Scholar
• Tremblay, R. E., Pagani-Kurtz, L., Mâsse, L. C., Vitaro, F., & Pihl, R. O. (1995). A bimodal preventive intervention for disruptive kindergarten boys: Its impact through mid-adolescence. Journal of Consulting and Clinical Psychology, 63(4), 560–568. https://doi.org/10.1037/0022-006X.63.4.560
   PubMed Web of Science ®Google Scholar
• Volpe, R. J., Briesch, A. M., & Floyd, R. G. (2016). Classroom observation of engagement, disrespectful and disruptive behaviors. In A. M. Briesch, R. J. Volpe, & R. G. Floyd (eds.), School-based observation: A practical guide to assessing student behavior. Guilford Press.
   Google Scholar
• Volpe, R. J., DiPerna, J. C., Hintze, J. M., & Shapiro, E. S. (2005). Observing students in classroom settings: A review of seven coding schemes. School Psychology Review, 34(4), 454–474. https://doi.org/10.1080/02796015.2005.12088009
   Web of Science ®Google Scholar
• Volpe, R. J., & Gadow, K. D. (2010). Creating abbreviated rating scales to monitor classroom inattention-overactivity, aggression, and peer conflict: Reliability, validity, and treatment sensitivity. School Psychology Review, 39(3), 350–363. https://doi.org/10.1080/02796015.2010.12087757
   Web of Science ®Google Scholar
• Volpe, R. J., Hill, E., Briesch, A. M., & Leiwant, I. (2021). Classroom observation of student behavior: A review of five coding schemes. Manuscript in preparation.
   Google Scholar
• Volpe, R. J., & McConaughy, S. H. (2005). Systematic direct observational assessment of student behavior: Its use and interpretation in multiple settings. School Psychology Review, 34(4), 451–453. https://doi.org/10.1080/02796015.2005.12088008
   Web of Science ®Google Scholar
• Volpe, R. J., McConaughy, S. H., & Hintze, J. M. (2009). Generalizability of classroom behavior problem and on-task scores from the Direct Observation Form. School Psychology Review, 38(3), 382–401. https://doi.org/10.1080/02796015.2009.12087822
   Web of Science ®Google Scholar
• Walcott, C. M., Hyson, D., McNamara, K., & Charvat, J. L. (2018). Results from the NASP 2015 membership survey, part one: Demographics and employment conditions. NASP Research Reports, 3(1), 1–17.
   Google Scholar
• Walker, H. M., Ramsey, E., & Gresham, F. M. (2003). Heading off disruptive behavior: How early intervention can reduce defiant behavior—and win back teaching time. American Educator, 26(4), 6–45.
   Google Scholar
• Wilder, D. A., Atwell, J., & Wine, B. (2006). The effects of varying levels of treatment integrity on child compliance during treatment with a three-step prompting procedure. Journal of Applied Behavior Analysis, 39(3), 369–373. https://doi.org/10.1901/jaba.2006.144-05
   PubMed Web of Science ®Google Scholar
• Wilson, M. S., & Reschly, D. J. (1996). Assessment in school psychology training and practice. School Psychology Review, 25(1), 9–23. https://doi.org/10.1080/02796015.1996.12085799
   Web of Science ®Google Scholar
• Zuckerman, H., Pan, Z., Park, C., Brietzke, E., Musial, N., Shariq, A. S., Iacobucci, M., Yim, S. J., Lui, L. M. W., Rong, C., & McIntyre, R. S. (2018). Recognition and treatment of cognitive dysfunction in Major Depressive Disorder. Frontiers in Psychiatry, 9, 655. https://doi.org/10.3389/fpsyt.2018.00655
   PubMed Web of Science ®Google Scholar