Using client feedback in training of future counseling psychologists: An evidence-based and social justice practice

References

• Ackerman, S. J., Benjamin, L. S., Beutler, L. E., Gelso, C. J., Goldfried, M. R., Hill, C., … Rainer, J. (2001). Empirically supported therapy relationships: Conclusions and recommendations of the Division 29 task force. Psychotherapy: Theory Research, Practice, Training, 38, 495–497. doi:10.1037/0033-3204.38.4.495
   Web of Science ®Google Scholar
• Albee, G. W. (2000). The Boulder model’s fatal flaw. American Psychologist, 55, 247–248. doi:10.10371/0003-066X.55.2.247
   PubMed Web of Science ®Google Scholar
• Anderson, E. W., & Lambert, M. J. (2001). A survival analysis of clinically significant change in outpatient psychotherapy. Journal of Clinical Psychology, 57, 857–888. doi:10.1002/jclp.1056
   Google Scholar
• Anker, M. G., Duncan, B. L., & Sparks, J. A. (2009). Using client feedback to improve couple therapy outcomes: A randomized clinical trial in a naturalistic setting. Journal of Consulting and Clinical Psychology, 77, 693–704. doi:10.1037/a0016062
   PubMed Web of Science ®Google Scholar
• APA Commission on Accreditation. (2011). Commission on accreditation implementing regulations. Retrieved June 28, 2013, from http://www.apa.org/ed/accreditation/about/policies/implementing-guidelines.pdf
   Google Scholar
• APA Presidential Task Force on Evidence-Based Practice. (2006). Evidence-based practice in psychology. American Psychologist, 61, 271–285. doi:10.1037/0003-066X.61.4.271
   PubMed Web of Science ®Google Scholar
• Arredondo, P., Toporek, R., Brown, S. P., Sanchez, J., Locke, D. C., Sanchez, J., & Stadler, H. (1996). Operationalization of the multicultural counseling competencies. Journal of Multicultural Counseling & Development, 24, 42–78.
   Web of Science ®Google Scholar
• Bell, L. A. (1997). Theoretical foundations for social justice education. In M. Adams, L. A. Bell, & P. Griffin (Eds.), Teaching for diversity and social justice (pp. 3–15). New York, NY: Routledge.
   Google Scholar
• Bhattacharyya, S., Ashby, K. M., & Goodman, L. A. (2014). Social justice beyond the classroom: Responding to the marathon bombing’s Islamaphobic aftermath. The Counseling Psychologist, 42, 1136–1158.10.1177/0011000014551420
   Web of Science ®Google Scholar
• Bordin, E. S. (1979). The generalizability of the psychoanalytic concept of the working alliance. Psychotherapy: Theory Research & Practice, 16, 252–260. doi:10.1037/h0085885
   Google Scholar
• Brady-Amoon, P., Makhija, N., Dixit, V., & Dator, J. (2012). Social justice: Pushing past boundaries in graduate training. Journal for Social Action in Counseling Psychology, 4, 85–98.
   Google Scholar
• Burlingame, G. M., & Beecher, M. E. (2008). New directions and resources in group psychotherapy: Introduction to the issue. Journal of Clinical Psychology, 64, 1197–1205. doi:10.1002/jclp.20534
   PubMed Web of Science ®Google Scholar
• Chambless, D. L., & Crits-Christoph, P. (2006). The treatment method. In J. C. Norcross, L. E. Beutler, & R. F. Levant (Eds.), Evidence-based practices in mental health (pp. 191–199). Washington, DC: American Psychological Association.
   Google Scholar
• Chen, E. C., Kakkad, D., & Balzano, J. (2008). Multicultural competence and evidence-based practice in group therapy. Journal of Clinical Psychology, 64, 1261–1278. doi:10.1002/jclp.20533
   PubMed Web of Science ®Google Scholar
• Chwalisz, K. (2003). Evidence-based practice: A framework for twenty-first-century scientist-practitioner training. The Counseling Psychologist, 31, 497–528. doi:10.1177/0011000003256347
   Web of Science ®Google Scholar
• Constantine, M. G., Kindaichi, M., Arorash, T. J., Donnelly, P. C., & Jung, K.-S. K. (2002). Clients’ perceptions of multicultural counseling competence: Current status and future directions. The Counseling Psychologist, 30, 407–416. doi:10.1177/0011000002303003
   Web of Science ®Google Scholar
• Crits-Christoph, P., Ring-Kurtz, S., McClure, B., Temes, C., Kulaga, A., Gallop, R., … Rotrosen, J. (2010). A randomized controlled study of a web-based performance improvement system for substance abuse treatment providers. Journal of Substance Abuse Treatment, 38, 251–262. doi:10.1016/j.jsat.2010.01.001
   PubMed Web of Science ®Google Scholar
• Dodenhoff, J. T. (1981). Interpersonal attraction and direct–indirect supervisor influence as predictors of counselor trainee effectiveness. Journal of Counseling Psychology, 28, 47–52. doi:10.1037/0022-0167.28.1.47
   Web of Science ®Google Scholar
• Duncan, B. (2011). The partners for change outcome management system (PCOMS): Administration, scoring, interpreting update for the outcome and session ratings scale. Jensen Beach, FL: Author.
   Google Scholar
• Duncan, B. L. (2012). The partners for change outcome management system (PCOMS): The heart and soul of change project. Canadian Psychology, 53, 93–104. doi:10.1037/a0027762
   Web of Science ®Google Scholar
• Duncan, B. L., & Reese, R. J. (2012). Empirically supported treatments, evidence based treatments, and evidence based practice. In G. Stricker & T. Widiger (Vol. Eds.) & I. Weiner (Ed.), Handbook of Psychology: Clinical Psychology (2nd ed., Vol. 8, pp. 977–1023). Hoboken, NJ: Wiley.
   Google Scholar
• Gillaspy, J. A., & Murphy, J. J. (2011). The use of ultra-brief client feedback tools in SFBT. In C. W. Franklin, T. Trepper, E. McCollum, & W. Gingerich (Eds.), Solution-focused brief therapy (pp. 74–91). New York, NY: Oxford University Press.
   Google Scholar
• Goodheart, C. D., Kazdin, A. E., & Sternberg, R. J. (2006). Evidence-based psychotherapy: Where practice and research meet. Washington, DC: American Psychological Association.10.1037/11423-000
   Google Scholar
• Goodman, L. A., Liang, B., Helms, J. E., Latta, R. E., Sparks, E., & Weintraub, S. R. (2004). Training counseling psychologists as social justice agents: Feminist and multicultural principles in action. The Counseling Psychologist, 32, 793–836. doi:10.1177/0011000004268802
   Web of Science ®Google Scholar
• Grossl, A. B., Reese, R. J., Norsworthy, L. A., & Hopkins, N. B. (2014). Client feedback data in supervision: Effects on supervision and outcome. Training and Education in Professional Psychology, 8, 182–188. doi:10.1037/tep0000025
   Web of Science ®Google Scholar
• Hage, S. M. (2003). Reaffirming the unique identity of counseling psychology: Opting for the “Road Less Traveled By”. The Counseling Psychologist, 31, 555–563. doi:10.1177/0011000003256434
   Web of Science ®Google Scholar
• Hannan, C., Lambert, M. J., Harmon, C., Nielsen, S. L., Smart, D. W., Shimokawa, K., & Sutton, S. W. (2005). A lab test and algorithms for identifying clients at risk for treatment failure. Journal of Clinical Psychology, 61, 155–163. doi:10.1002/jclp.20108
   PubMed Web of Science ®Google Scholar
• Harris, M. B. C. (1994). Supervisory evaluation and feedback. In L. D. Borders (Ed.), Supervision: Exploring the effective components (pp. 19–20). Greensboro, NC: Educational Resources Information Center.
   Google Scholar
• Hatfield, D., McCullough, L., Plucinski, A., & Krieger, K. (2010). Do we know when our clients get worse? An investigation of therapists’ ability to detect negative client change. Clinical Psychology & Psychotherapy, 17, 25–32. doi:10.1002/cpp.656
   PubMed Web of Science ®Google Scholar
• Heppner, P. P., & Wang, K. (2014). A cross-cultural immersion program: Promoting students’ cultural journeys. The Counseling Psychologist, 42, 1159–1187.10.1177/0011000014548899
   Web of Science ®Google Scholar
• Hoffman, M. A., Hill, C. E., Holmes, S. E., & Freitas, G. F. (2005). Supervisor perspective on the process and outcome of giving easy, difficult, or no feedback to supervisees. Journal of Counseling Psychology, 52, 3–13. doi:10.1037/0022-0167.52.1.3
   Web of Science ®Google Scholar
• Holloway, E. L., & Neufeldt, S. A. (1995). Supervision: Its contributions to treatment efficacy. Journal of Consulting and Clinical Psychology, 63, 207–213. doi:10.1037/0022-006X.63.2.207
   PubMed Web of Science ®Google Scholar
• Kazdin, A. E. (2006). Assessment and evaluation in clinical practice. In C. Goodheart, A. Kazdin, & R. Sternberg (Eds.), Evidence-based psychotherapy: Where practice and research meet (pp. 153–177). Washington, DC: American Psychological Association.10.1037/11423-000
   Google Scholar
• Koch, J. M., Ross, J. B., Wendell, J., & Aleksandrova-Howell, M. (2014). Results of immersion service learning activism with peers: Anticipated and surprising. The Counseling Psychologist, 42, 1215–1246.10.1177/0011000014535955
   Web of Science ®Google Scholar
• Knobloch-Fedders, L. M., Pinsof, W. M., & Mann, B. J. (2007). Therapeutic alliance and treatment progress in couple psychotherapy. Journal of Martial and Family Therapy, 33, 245–257. doi:10.1111/j.1752-0606.2007.00019.x
   PubMed Web of Science ®Google Scholar
• Ladany, N., Hill, C. E., Corbett, M. M., & Nutt, E. A. (1996). Nature, extent, and importance of what psychotherapy trainees do not disclose to their supervisors. Journal of Counseling Psychology, 43, 10–24. doi:10.1037/0022-0167.43.1.10
   Web of Science ®Google Scholar
• Lambert, M. J. (2010). Yes it is time for therapists to routinely monitor treatment outcomes. In B. Duncan, S. Miller, B. Wampold, & M. Hubble (Eds.), The heart and soul of change: Delivering what works in therapy (2nd ed.). (pp. 239–266). Washington, DC: American Psychological Association.10.1037/12075-000
   Google Scholar
• Lambert, M. J. (2012). Helping clinicians to use and learn from research-based systems: The OQ-analyst. Psychotherapy, 49, 109–114. doi:10.1037/a0027110
   PubMed Web of Science ®Google Scholar
• Lambert, M. J. (2013). Outcome in psychotherapy: The past and important advances. Psychotherapy, 50, 42–51. doi:10.1037/a0030682
   PubMed Web of Science ®Google Scholar
• Lambert, M. J., & Archer, A. (2006). Research findings on the effects of psychotherapy and their implications for practice. In C. Goodheart, A. Kazdin, & R. Sternberg (Eds.), Evidence-based psychotherapy: Where practice and research meet (pp. 111–130). Washington, DC: American Psychological Association.10.1037/11423-000
   Google Scholar
• Lambert, M. J., Harmon, C., Slade, K., Whipple, J. L., & Hawkins, E. J. (2005). Providing feedback to psychotherapists on their patients’ progress: Clinical results and practice suggestions. Journal of Clinical Psychology, 61, 165–174. doi:10.1002/jclp.20113
   PubMed Web of Science ®Google Scholar
• Lambert, M. J., & Hawkins, E. J. (2001). Using information about patient progress in supervision: Are outcomes enhanced? Australian Psychologist, 36, 131–138. doi:10.1080/00050060108259645
   Web of Science ®Google Scholar
• Lambert, M. J., Morton, J. J., Hatfield, D., Harmon, C., Hamilton, S., Reid, R. C., … Burlingame, G.M. (2004). Administration and scoring manual for the Outcome Questionnaire-45. Salt Lake City, UT: OQMeasures.
   Google Scholar
• Lambert, M. J., & Ogles, B. M. (2004). The efficacy and effectiveness of psychotherapy. In M. Lambert (Ed.), Bergin and Garfield’s handbook of psychotherapy and behavior change (5th ed., pp. 139–193). New York, NY: Wiley.
   Google Scholar
• Lambert, M. J., & Shimokawa, K. (2011). Collecting client feedback. Psychotherapy, 48, 72–79. doi:10.1037/a0022238
   PubMed Web of Science ®Google Scholar
• Lambert, M. J., Whipple, J. L., Hawkins, E. J., Vermeersch, D. A., Nielsen, S. L., & Smart, D. W. (2003). Is it time for therapists to routinely track patient outcome? A meta-analysis. Clinical Psychology: Science and Practice, 10, 288–301. doi:10.1093/clipsy/bpg025
   Web of Science ®Google Scholar
• McHugh, R. K., & Barlow, D. H. (2010). The dissemination and implementation of evidence-based psychological treatments: A review of current efforts. American Psychologist, 65, 73–84. doi:10.1037/a0018121
   PubMed Web of Science ®Google Scholar
• Mihalic, S., Fagan, A., Irwin, K., Ballard, D., & Elliott, D. (2004). Blueprints for violence prevention. Washington, DC: U.S. Department of Justice, Office of Juvenile Justice and Delinquency Prevention.10.1037/e302992005-001
   Google Scholar
• Miller, S. D., & Duncan, B. L. (2000). The outcome rating scale. Chicago, IL: Author.
   Google Scholar
• Miller, S. D., Duncan, B. L., & Johnson, L. D. (2000). The Session Rating Scale 3.0. Chicago, IL: Authors.
   Google Scholar
• Mintz, L. B., Jackson, A. P., Neville, H. A., Illfelder-Kaye, J., Winterowd, C. L., & Loewy, M. I. (2009). The need for a counseling psychology model training values statement addressing diversity. The Counseling Psychologist, 37, 644–675. doi:10.1177/0011000009331931
   Web of Science ®Google Scholar
• Motulsky, S. L., Gere, S. H., Saleem, R., & Trantham, S. M. (2014). Teaching social justice in counseling psychology. The Counseling Psychologist, 42, 1058–1083.10.1177/0011000014553855
   Web of Science ®Google Scholar
• Mozdzierz, G. J., Peluso, P. R., & Lisiecki, J. (2011). Evidence-based psychological practices and therapist training: At the crossroads. Journal of Humanistic Psychology, 51, 439–464. doi:10.1177/0022167810386959
   Web of Science ®Google Scholar
• Nathan, P. E. (2007). Efficacy, effectiveness, and the clinical utility of psychotherapy research. In S. G. Hofmann & J. Weinberger (Eds.), The art and science of psychotherapy (pp. 69–83). New York, NY: Routledge.
   Google Scholar
• Norcross, J. C., Beutler, L. E., & Levant, R. F. (2006). Evidence-based practices in mental health: Debate and dialogue on the fundamental questions. Washington, DC: American Psychological Association.10.1037/11265-000
   Google Scholar
• Packard, T. (2009). The 2008 Leona Tyler Award Address: Core values that distinguish counseling psychology: Personal and professional perspectives. The Counseling Psychologist, 37, 610–624. doi:10.1177/0011000009333986
   Web of Science ®Google Scholar
• Pieterse, A. L., Lee, M., Ritmeester, A., & Collins, N. M. (2013). Towards a model of self-awareness development for counselling and psychotherapy training. Counselling Psychology Quarterly, 26, 190–207. doi:10.1080/09515070.2013.793451
   Google Scholar
• Plano Clark, V. L., & Wang, S. C. (2010). Adapting mixed methods research to multicultural counseling. In J. G. Ponterotto, J. M. Casas, L. A. Suzuki, & C. M. Alexander (Eds.), Handbook of multicultural counseling (3rd ed., pp. 427–438). Thousand Oaks, CA: Sage.
   Google Scholar
• Ponterotto, J. G., Mathew, J., & Raughley, B. (2013). The value of mixed methods designs to social justice research in counseling and psychology. Journal for Social Action in Counseling and Psychology, 5, 42–68.
   Google Scholar
• Reed, G. M., & Eisman, E. J. (2006). Uses and misuses of evidence: Managed care, treatment guidelines, and outcomes measurement in professional practice. In C. Goodheart, A. Kazdin, & R. Sternberg (Eds.), Evidence-based psychotherapy: Where practice and research meet (pp. 13–35). Washington, DC: American Psychological Association.10.1037/11423-000
   Google Scholar
• Reese, R. J., Duncan, B., Bohanske, R., Owen, J., & Minami, T. (2014). Benchmarking outcomes in a public behavioral health setting: Feedback as a quality improvement strategy. Journal of Consulting and Clinical Psychology, 82, 731–742. doi:10.1037/a0036915
   PubMed Web of Science ®Google Scholar
• Reese, R. J., Norsworthy, L. A., & Rowlands, S. R. (2009). Does a continuous feedback system improve psychotherapy outcome? Psychotherapy: Theory Research, Practice, Training, 46, 418–431. doi:10.1037/a0017901
   PubMed Web of Science ®Google Scholar
• Reese, R. J., Toland, M. D., Slone, N. C., & Norsworthy, L. A. (2010). Effect of client feedback on couple psychotherapy outcomes. Psychotherapy: Theory Research, Practice, Training, 47, 616–630. doi:10.1037/a0021182
   PubMed Web of Science ®Google Scholar
• Reese, R. J., Usher, E. L., Bowman, D. C., Norsworthy, L. A., Halstead, J. L., Rowlands, S. R., & Chisholm, R. R. (2009). Using client feedback in psychotherapy training: An analysis of its influence on supervision and counselor self-efficacy. Training and Education in Professional Psychology, 3, 157–168. doi:10.1037/a0015673
   Web of Science ®Google Scholar
• Reinkraut, R., Motulsky, S. L., & Ritchie, J. (2009). Developing a competent practitioner: Use of self in counseling psychology training. Asian Journal of Counselling, 16, 7–29.
   Google Scholar
• Sackett, D. L., Rosenberg, W. M. C., Muir-Gray, J. A., Haynes, R. B., & Richardson, W. S. (1996). Evidence based medicine: What it is and what it isn’t. British Medical Journal, 312, 71–72. Retrieved from http://www.bmj.com/content/312/7023/71.long
   PubMed Web of Science ®Google Scholar
• Schuman, D., Slone, N., Reese, R., & Duncan, B. (2015). Using client feedback to improve outcomes in group psychotherapy with soldiers referred for substance abuse treatment. Psychotherapy Research, 25, 396–407. doi:10.1080/10503307.2014.900875
   PubMed Web of Science ®Google Scholar
• Slone, N. C., Reese, R. J., Mathews-Duvall, S., & Kodet, J. (2015). Evaluating the efficacy of client feedback in group psychotherapy. Group Dynamics: Theory, Research, and Practice, 19, 122–136. doi:10.1037/gdn0000026
   Web of Science ®Google Scholar
• Shimokawa, K., Lambert, M. J., & Smart, D. W. (2010). Enhancing treatment outcome of patients at risk of treatment failure: Meta-analytic and mega-analytic review of a psychotherapy quality assurance system. Journal of Consulting and Clinical Psychology, 78, 298–311. doi:10.1037/a0019247
   PubMed Web of Science ®Google Scholar
• Smith, M. D. M., Jennings, L., & Lakhan, S. (2014). International education and service learning: Approaches toward cultural competency and social justice. The Counseling Psychologist, 42, 1188–1214.10.1177/0011000014557499
   Web of Science ®Google Scholar
• Sparks, J. A., Kisler, T. J., Adams, J. F., & Blumen, D. G. (2011). Teaching accountability: Using client feedback to train effective family therapists. Journal of Marital & Family Therapy, 37, 452–467. doi:10.1111/j.1752-0606.2011.00224.x
   PubMed Web of Science ®Google Scholar
• Speight, S. L., & Vera, E. M. (2004). A social justice agenda: ready, or not? The Counseling Psychologist, 32, 109–118. doi:10.1177/0011000003260005
   Web of Science ®Google Scholar
• Substance Abuse and Mental Health Services Administration. (2007). National registry of evidence-based programs and practices. Retrieved September 30, 2012, from http://www.nrepp.samhsa.gov/
   Google Scholar
• Sue, D. W., Arredondo, P., & McDavis, R. J. (1992). Multicultural counseling competencies and standards: A call to the profession. Journal of Counseling & Development, 70, 477–486.
   Web of Science ®Google Scholar
• Sue, D. W., & Sue, D. (2008). Counseling the culturally diverse. Hoboken, NJ: Wiley.
   Google Scholar
• Vera, E. M., & Speight, S. L. (2003). Multicultural competence, social justice, and counseling psychology: Expanding our roles. The Counseling Psychologist, 31, 253–272. doi:10.1177/0011000003031003001
   Web of Science ®Google Scholar
• Wampold, B. E. (2007). Psychotherapy: The humanistic (and effective) treatment. American Psychologist, 62, 857–873. doi:10.1037/0003-066X.62.8.857
   Web of Science ®Google Scholar
• Watkins, C. E. (2011). Does psychotherapy supervision contribute to patient outcomes? Considering thirty years of research. The Clinical Supervisor, 30, 235–256. doi:10.1080/07325223.2011.619417
   Google Scholar
• Winterowd, C. L., Adams, E. M., Miville, M. L., & Mintz, L. B. (2009). Operationalizing, instilling, and assessing counseling psychology training values related to diversity in academic programs. The Counseling Psychologist, 37, 676–704. doi:10.1177/0011000009331936
   Web of Science ®Google Scholar
• Worthen, V. E., & Lambert, M. J. (2007). Outcome oriented supervision: Advantages of adding systematic client tracking to supportive consultations. Counselling and Psychotherapy Research, 7, 48–53. doi:10.1080/14733140601140873
   Google Scholar