Feedback mechanisms of change: How problem alerts reported by youth clients and their caregivers impact clinician-reported session content

References

• APA Presidential Task Force on Evidence-Based Practice. (2006). Evidence-based practice in psychology. American Psychologist, 61, 271–285. doi: 10.1037/0003-066X.61.4.271
   PubMed Web of Science ®Google Scholar
• Athay, M. M. (2012). Satisfaction with Life Scale (SWLS) in caregivers of clinically-referred youth: Psychometric properties and mediation analysis. Administration and Policy in Mental Health and Mental Health Services Research, 39(1–2), 41–50. doi:10.1007/s10488-011-0390-8.
   PubMed Web of Science ®Google Scholar
• Athay, M. M., & Bickman, L. (2012). Development and psychometric evaluation of the youth and caregiver Service Satisfaction Scale. Administration and Policy in Mental Health and Mental Health Services Research, 39(1–2), 71–77. doi:10.1007/s10488-012-0407-y.
   PubMed Web of Science ®Google Scholar
• Athay, M. M., Riemer, M., & Bickman, L. (2012). The Symptoms and Functioning Severity Scale (SFSS): Psychometric evaluation and discrepancies among youth, caregiver, and clinician ratings over time. Administration and Policy in Mental Health and Mental Health Services Research, 39(1–2), 13–29. doi:10.1007/s10488-012-0403-2.
   PubMed Web of Science ®Google Scholar
• Bearsley-Smith, C., Sellick, K., Chesters, J., & Francis, K. (2008). Treatment content in child and adolescent mental health services: Development of the treatment recording sheet. Administration and Policy in Mental Health and Mental Health Services Research, 35(5), 423–435. doi: 10.1007/s10488-008-0184-9
   PubMed Web of Science ®Google Scholar
• Bickman, L., & Athay, M. M. (Eds.). (2012). Youth mental health measurement [special issue] Administration and policy in mental health and mental health services research, 39(1–2), 1–146.
   Google Scholar
• Bickman, L., Athay, M. M., Riemer, M., Lambert, E. W., Kelley, S. D., Breda, C., … Vides de Andrade, A. R. (Eds.). (2010). Manual of the Peabody Treatment Progress Battery (2nd ed.). Nashville, TN: Vanderbilt University.
   Google Scholar
• Bickman, L., Douglas Kelley, S., & Athay, M. (2012). The technology of measurement feedback systems. Journal of Couple & Family Psychology: Research and Practice, 1(4), 274–284. doi: 10.1037/a0031022
   PubMedGoogle Scholar
• Bickman, L., Douglas Kelley, S., Breda, C., de Andrade, A. R., & Riemer, M. (2011). Effects of routine feedback to clinicians on mental health outcomes of youths: Results of a randomized trial. Psychiatric Services, 62, 1423–1429. doi: 10.1176/appi.ps.002052011
   PubMed Web of Science ®Google Scholar
• Bickman, L., Douglas, S., Vides de Andrade, A. R., Tomlinson, M., Gleacher, A., Olin, S., & Hoagwood, K. (2015). Implementing a measurement feedback system: A tale of two sites. Administration and Policy in Mental health and Mental Health Services Research. doi:10.1007/s10488-015-0647-8.
   Google Scholar
• Bickman, L., Vides de Andrade, A. R., Athay, M. M., Chen, J. I., De Nadai, A. S., Jordan-Arthur, B., & Karver, M.S. (2012). The relationship between change in therapeutic alliance and improvement in youth symptom severity: Whose ratings matter the most? Administration and Policy in Mental Health and Mental Health Services Research, 39(1–2), 78–89. doi:10.1007/s10488-011-0398-0.
   PubMed Web of Science ®Google Scholar
• Boswell, J. F., Kraus, D. R., Miller, S. D., & Lambert, M. J. (2015). Implementing routine outcome monitoring in clinical practice: Benefits, challenges, and solutions. Psychotherapy Research, 25(1), 6–19. doi: 10.1080/10503307.2013.817696
   PubMed Web of Science ®Google Scholar
• Brannan, A. M., Athay, M. M., & Vides de Andrade, A. R. (2012). Measurement quality of the Caregiver Strain Questionnaire-Short Form 7 (CGSQ-SF7). Administration and Policy in Mental Health and Mental Health Services Research, 39(1–2), 51–59. doi:10.1007/s10488-012-0412-1
   PubMed Web of Science ®Google Scholar
• Breda, C. S., & Riemer, M. (2012). Motivation for Youth's Treatment Scale (MYTS): A new tool for measuring motivation among youths and their caregivers. Administration and Policy in Mental Health and Mental Health Services Research, 39(1–2), 118–132. doi:10.1007/s10488-012-0408-x
   PubMed Web of Science ®Google Scholar
• Cannon, M. D., & Witherspoon, R. (2005). Actionable feedback: Unlocking the power of learning and performance improvement. The Academy of Management Executive, 19(2), 120–134. doi: 10.5465/AME.2005.16965107
   Web of Science ®Google Scholar
• Chorpita, B. F., Bernstein, A. D., & Daleiden, E. L. (2011). Empirically guided coordination of multiple evidence-based treatments: An illustration of relevance mapping in children's mental health services. Journal of Consulting and Clinical Psychology, 79, 470–480. doi: 10.1037/a0023982
   PubMed Web of Science ®Google Scholar
• Chorpita, B. F., Bernstein, A. D., Daleiden, E. L., & the Research Network on Youth Mental Health. (2008). Driving with roadmaps and dashboards: Using information resources to structure the decision models in service organizations. Administration and Policy in Mental Health and Mental Health Services Research, 35, 114–123. doi: 10.1007/s10488-007-0151-x
   PubMed Web of Science ®Google Scholar
• Dew-Reeves, S. E., Athay, M. M., & Kelley, S. D. (2012). Validation and use of the Children's Hope Scale-Revised PTPB Edition (CHS-PTPB): High initial youth hope and elevated baseline symptomatology predict poor treatment outcomes. Administration and Policy in Mental Health and Mental Health Services Research, 39(1–2), 60–70. doi:10.1007/s10488-012-0411-2.
   PubMed Web of Science ®Google Scholar
• Douglas, S., Button, S., & Casey, S. E. (2014). Implementing for sustainability: Promoting use of a measurement feedback system for innovation and quality improvement. Administration and Policy in Mental Health and Mental Health Services Research. Advance online publication. doi:10.1007/s10488-014-0607-8
   PubMedGoogle Scholar
• Douglas Kelley, S., Bickman, L., & Norwood, E. (2010). Evidence-based treatments and common factors in youth psychotherapy. In B. L. Duncan, S. D. Miller, B. E. Wampold, & M. A. Hubble (Eds.), The heart and soul of change: What works in therapy (2nd ed., pp. 325–355). Washington, DC: American Psychological Association.
   Google Scholar
• Douglas Kelley, S., Vides de Andrade, A. R., Bickman, L., & Robin, A. V. (2012). The Session Report Form (SRF): Are clinicians addressing concerns reported by youth and caregivers? Administration and Policy in Mental Health and Mental Health Services Research, 39(1–2), 133–145. doi: 10.1007/s10488-012-0415-y
   PubMed Web of Science ®Google Scholar
• Douglas Kelley, S., Vides de Andrade, A. R., Sheffer, E., & Bickman, L. (2010). Exploring the black box: Measuring youth treatment process and progress in usual care. Administration and Policy in Mental Health and Mental Health Services Research. Special Issue: Psychotherapy Practice in Usual Care, 37(3), 287–300. doi: 10.1007/s10488-010-0298-8
   PubMed Web of Science ®Google Scholar
• Evans, C. (2012). Cautionary notes on power steering for psychotherapy. Canadian Psychology/Psychologie Canadienne, 53(2), 131–139. doi: 10.1037/a0027951
   Web of Science ®Google Scholar
• Garland, A. F., Hurlburt, M. S., Brookman-Frazee, L., Taylor, R. M., & Accurso, E. C. (2009). Methodological challenges of characterizing usual care psychotherapeutic practice. Administration and Policy in Mental Health and Mental Health Services, 37, 208–220. doi: 10.1007/s10488-009-0237-8
   PubMed Web of Science ®Google Scholar
• Hannan, C., Lambert, M. J., Harmon, C., Nielson, S., Smart, D., Shimokawa, K., & Sutton, S. W. (2005). A lab test and algorithms for identifying clients at risk for treatment failure. Journal of Clinical Psychology, 61(2), 155–163. doi: 10.1002/jclp.20108
   PubMed Web of Science ®Google Scholar
• Hatfield, D., McCullough, L., Frantz, S. H. B., & Krieger, K. (2009). Do we know when our clients get worse? An investigation of therapists’ ability to detect negative client change. Clinical Psychology and Psychotherapy, 17(1), 25–32.
   Web of Science ®Google Scholar
• Hawley, K. M., & Weisz, J. R. (2003). Child, parent and therapist (dis)agreement on target problems in outpatient therapy: The therapist's dilemma and its implications. Journal of Consulting and Clinical Psychology, 71(1), 62–70. doi: 10.1037/0022-006X.71.1.62
   PubMed Web of Science ®Google Scholar
• Hosmer, D. W., Lemeshow, S., & May, S. (2008). Applied survival analysis: Regression modeling of time-to-event data (2nd ed.). Hoboken, NJ: John Wiley & Sons.
   Google Scholar
• Hurlburt, M. S., Garland, A. F., Nguyen, K., & Brookman-Frazee, L. (2010). Child and family therapy process: Concordance of therapist and observational perspectives. Administration and Policy in Mental Health and Mental Health Services Research, 37, 230–244. doi: 10.1007/s10488-009-0251-x
   PubMed Web of Science ®Google Scholar
• de Jong, K. (2014). Deriving effective implementation strategies for outcome monitoring from feedback theory. Administration and Policy in Mental Health and Mental Health Services Research. Advance online publication. doi: 10.1007/s10488-014-0589-6
   Google Scholar
• Kazdin, A. E. (2008). Evidence-based treatment and practice: New opportunities to bridge clinical research and practice, enhance the knowledge base, and improve patient care. American Psychologist, 63(3), 146–159. doi: 10.1037/0003-066X.63.3.146
   PubMed Web of Science ®Google Scholar
• Kearns, M. A., Athay, M. M., & Riemer, M. (2012). Measuring youths’ perceptions of counseling impact: Description, psychometric evaluation, and longitudinal examination of the Youth Counseling Impact Scale v.2. Administration and Policy in Mental Health and Mental Health Services Research, 39(1-2), 104–117. doi:10.1007/s10488-012-0414-z.
   PubMed Web of Science ®Google Scholar
• Kluger, A. N., & DeNisi, A. (1996). The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychological Bulletin, 119, 254–284. doi: 10.1037/0033-2909.119.2.254
   Web of Science ®Google Scholar
• Knaup, C., Koesters, M., Schoefer, D., Becker, T., & Puschner, B. (2009). Effect of feedback of treatment outcome in specialist mental healthcare: Meta-analysis. The British Journal of Psychiatry, 195(1), 15–22. doi: 10.1192/bjp.bp.108.053967
   PubMed Web of Science ®Google Scholar
• Lambert, M. J., & Barley, D. E. (2002). Research summary on the therapeutic relationship and psychotherapy outcome. In J. C. Norcross (Ed.), Psychotherapy relationships that work: Therapist contributions and responsiveness to patients (pp. 17–32). Oxford: Oxford University Press.
   Google Scholar
• Lambert, M. J., Harmon, C., Slade, K., Whipple, J. L., & Hawkins, E. J. (2005). Providing feedback to psychotherapists on their patients’ progress: Clinical results and practice suggestions. Journal of Clinical Psychology, 61(2), 165–174. doi: 10.1002/jclp.20113
   PubMed Web of Science ®Google Scholar
• Lambert, M. J., Whipple, J. L., Hawkins, E. J., Vermeersch, D. A., Nielsen, S. L., & Smart, D. W. (2003). Is it time for clinicians to routinely track patient outcome? A meta-analysis. Clinical Psychology, 10(3), 288–301.
   Google Scholar
• Levinson, W., Lesser, C. S., & Epstein, R. M. (2010). Developing physician communication skills for patient-centered care. Health Affairs, 29, 1310–1318. doi: 10.1377/hlthaff.2009.0450
   PubMed Web of Science ®Google Scholar
• Makoul, G. (2001). Essential elements of communication in medical encounters: The Kalamazoo consensus statement. Academic Medicine, 76, 390–393. doi: 10.1097/00001888-200104000-00021
   PubMed Web of Science ®Google Scholar
• Noell, G. H., & Gansle, K. A. (2014). The use of performance feedback to improve intervention implementation in schools. In L. M. Hagermoser Sanetti & T. R. Kratochwill (Eds.), Treatment integrity: A foundation for evidence-based practice in applied psychology (pp. 161–184). Washington, DC: American Psychological Association.
   Google Scholar
• Riemer, M., & Bickman, L. (2011). Using program theory to link social psychology and program evaluation. In M. M. Mark, S. I. Donaldson, & B. Campbell (Eds.), Social psychology and program/policy evaluation (pp. 104–139). New York, NY: Guilford.
   Google Scholar
• Riemer, M., Douglas Kelley, S., Casey, S., & Taylor Haynes, K. (2012). Developing effective research-practice partnerships for creating a culture of evidence-based decision making. Administration and Policy in Mental Health and Mental Health Services Research. Special Issue: Research Practice Partnerships, 39(4), 248–257. doi: 10.1007/s10488-011-0368-6
   PubMed Web of Science ®Google Scholar
• Riemer, M., Rosof-Williams, J., & Bickman, L. (2005). Theories related to changing clinician practice. Child and Adolescent Psychiatric Clinics of North America, 14, 241–254, viii. doi: 10.1016/j.chc.2004.05.002
   PubMed Web of Science ®Google Scholar
• Sapyta, J., Riemer, M., & Bickman, L. (2005). Feedback to clinicians: Theory, research and practice. Journal of Clinical Psychology, 61, 145–153. doi: 10.1002/jclp.20107
   PubMed Web of Science ®Google Scholar
• Shimokawa, K., Lambert, M. J., & Smart, D. (2010). Enhancing treatment outcome of patients at risk of treatment failure: Meta-analytic and mega-analytic review of a psychotherapy quality assurance system. Journal of Consulting and Clinical Psychology, 78, 298–311. doi: 10.1037/a0019247
   PubMed Web of Science ®Google Scholar
• Sparks, J. A., Kisler, T. S., Adams, J. F., & Blumen, D. G. (2011). Teaching accountability: Using client feedback to train effective family therapists. Journal of Marital and Family Therapy, 37, 452–467. doi: 10.1111/j.1752-0606.2011.00224.x
   PubMed Web of Science ®Google Scholar
• Twisk, J. W. R., Smidt, N., & de Vente, W. (2005). Applied analysis of recurrent events: A practical overview. Journal of Epidemiological Community Health, 59, 706–710. doi: 10.1136/jech.2004.030759
   PubMed Web of Science ®Google Scholar
• Wampold, B. E. (2001). The great psychotherapy debate: Models, methods, and findings. Mahwah, NJ: Lawrence Erlbaum Associates.
   Google Scholar
• Weisz, J. R., Ng, M. Y., & Bearman, S. K. (2014). Odd couple? Reenvisioning the relation between science and practice in the dissemination-implementation era. Clinical Psychological Science, 2(1), 58–74. doi: 10.1177/2167702613501307
   Google Scholar
• Worthen, V. E., & Lambert, M. J. (2007). Outcome oriented supervision: Advantages of adding systematic client tracking to supportive consultations. Counseling and Psychotherapy Research, 7(1), 48–53. doi: 10.1080/14733140601140873
   Google Scholar
• Youn, S. J., Kraus, D. R., & Castonguay, L. G. (2012). The treatment outcome package: Facilitating practice and clinically relevant research. Psychotherapy, 49, 115–122. doi: 10.1037/a0027932
   PubMed Web of Science ®Google Scholar