191
Views
8
CrossRef citations to date
0
Altmetric
Original Articles

A Behaviorally-Anchored Rating System to Monitor Treatment Integrity for Community Clinicians Using the Adolescent Community Reinforcement Approach

, , , &
Pages 185-199 | Published online: 09 Apr 2014
 

Abstract

This study evaluated a process for training raters to reliably rate clinicians delivering the Adolescent Community Reinforcement Approach (A-CRA) in a national dissemination project. The unique A-CRA coding system uses specific behavioral anchors throughout its 73 procedure components. Five randomly selected raters each rated “passing” and “not passing” examples of the 19 A-CRA procedures. Ninety-four percent of the final intraclass correlation coefficients were at least “good” (≥.60) and 66.7% were “excellent” (≥.75), and 95% of the ratings exceeded the 60% or better agreement threshold between raters and the gold standard. Raters can be trained to provide reliable A-CRA feedback for large-scale dissemination projects.

Acknowledgments

The authors thank the raters who participated in the study; the trainees whose clinical work was rated; and Christin Bair, Brandi Barnes, Jutta Butler, Mark D. Godley, Courtney Hupp, Stephanie Merkle, Robert J. Meyers, Randolph Muck, Laura Reichel, and Kelli Wright for their help and support of this project.

Notes

Note. “Passed” Samples = the therapist in the session had been rated previously as having passed the procedure; “Not Passed” Samples = the therapist in the session had been rated previously as not having passed the procedure. ICC = intraclass correlation coefficient.

a ICC not computed because none of the randomly selected raters rated this procedure as having been attempted.

b ICC could not be computed due to items having a negative average covariance.

c ICC could not be computed due to items having zero variance.

Note. ICC = intraclass correlation coefficient.

a Indicates the example was of a therapist who had been rated previously as having passed the procedure.

b ICC could not be computed due to items having zero variance.

c ICC could not be computed due to items having a negative average covariance.

d Indicates the example was of a therapist who had been rated previously as not having passed the procedure.

Log in via your institution

Log in to Taylor & Francis Online

PDF download + Online access

  • 48 hours access to article PDF & online version
  • Article PDF can be downloaded
  • Article PDF can be printed
USD 53.00 Add to cart

Issue Purchase

  • 30 days online access to complete issue
  • Article PDFs can be downloaded
  • Article PDFs can be printed
USD 347.00 Add to cart

* Local tax will be added as applicable

Related Research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.