The effect of using the Partners for Change Outcome Management System as feedback tool in psychotherapy—A systematic review and meta-analysis

References

• Amble, I., Gude, T., Stubdal, S., Andersen, B. J., & Wampold, B. E. (2015). The effect of implementing the outcome Questionnaire-45.2 feedback system in Norway: A multisite randomized clinical trial in a naturalistic setting. Psychotherapy Research, 25(6), 669–677. doi: 10.1080/10503307.2014.928756
   PubMed Web of Science ®Google Scholar
• American Psychological Association. (2006). Evidence-based practice in psychology: APA presidential task force on evidence-based practice. The American Psychologist, 61(4), 271–285. doi: 10.1037/0003-066X.61.4.271
   PubMed Web of Science ®Google Scholar
• *Anker, M., Duncan, B. L., & Sparks, J. (2009). Using client feedback to improve couple therapy outcomes: A randomized clinical trial in a naturalistic setting. Journal of Consulting and Clinical Psychology, 77(4), 693–704. doi: 10.1037/a0016062
   PubMed Web of Science ®Google Scholar
• Barkham, M., & Margison, F. (2007). Practice-based evidence as a complement to evidence-based practice: From dichotomy to chiasmus. In C. Freeman & M. Power (Ed.), Handbook of Evidence-Based Psychotherapies: A Guide for Research and Practice (pp. 443–476). New York: John Wiley. doi: 10.1002/9780470713242.ch25
   Google Scholar
• Barkham, M., Margison, F., Leach, C., Lucock, M., Mellor-Clark, J., Evans, C., … McGrath, G. (2001). Service profiling and outcomes benchmarking using the CORE-OM: Toward practice-based evidence in the psychological therapies. Journal of Consulting and Clinical Psychology, 69(2), 184–196. doi: 10.1037/0022-006X.69.2.184
   PubMed Web of Science ®Google Scholar
• Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009). Introduction to meta-analysis. New York: John Wiley. doi: 10.1002/9780470743386
   Google Scholar
• Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2010). A basic introduction to fixed-effect and random-effects models for meta-analysis. Research Synthesis Methods, 1(2), 97–111. doi: 10.1002/jrsm.12
   PubMed Web of Science ®Google Scholar
• Borenstein, M., Higgins, J. P. T., Hedges, L. V., & Rothstein, H. R. (2017). Basics of meta-analysis: I2 is not an absolute measure of heterogeneity. Research Synthesis Methods, 8(1), 5–18. doi: 10.1002/jrsm.1230
   PubMed Web of Science ®Google Scholar
• *Brattland, H., Koksvik, J. M., Burkeland, O., Gråve, R. W., Klöckner, C., Linaker, O. M. … Iversen, V. C. (2018). The effects of Routine Outcomes Monitoring (ROM) on therapy outcome in the course of an implementation process. A randomized clinical trial. Journal of Counseling Psychology. Advance online publication. doi:10.1037/cou0000286.
   Web of Science ®Google Scholar
• Bringhurst, D. L., Watson, C. W., Miller, S. D., & Duncan, B. L. (2006). The reliability and validity of the Outcome Rating Scale: A replication study of a brief clinical measure. Journal of Brief Therapy, 5, 23–30. Retrieved from http://journalbrieftherapy.com/
   Google Scholar
• Burgess, P. M., Pirkis, J. E., Slade, T. N., Johnston, A. K., Meadows, G. N., & Gunn, J. M. (2009). Service use for mental health problems: Findings from the 2007 National Survey of Mental Health and Wellbeing. The Australian and New Zealand Journal of Psychiatry, 43, 615–623. doi: 10.1080/00048670902970858
   PubMed Web of Science ®Google Scholar
• Campbell, A., & Hemsley, S. (2009). Outcome Rating Scale and Session Rating Scale in psychological practice: Clinical utility of ultra-brief measures. Clinical Psychologist, 13(1), 1–9. doi: 10.1080/13284200802676391
   Web of Science ®Google Scholar
• Castonguay, L. G., Barkham, M., Lutz, W., & McAleavy, A. (2013). Practice-oriented research: Approaches and applications. In M. J. Lambert (Ed.), Bergin and Garfield’s handbook of psychotherapy and behavior change (6th ed., pp. 85–133). New York: John Wiley.
   Google Scholar
• Child Outcomes Research Consortium. (2018, February 7). Retrieved from http://www.corc.uk.net/
   Google Scholar
• *Chow, D., & Huixian, S. (2015). The use of routine outcome monitoring in an Asian outpatient psychiatric setting. Poster session presented at The World Federal of Mental Health Conference, Singapore.
   Google Scholar
• Clark, D. M. (2018). Realizing the mass public benefit of evidence-based psychological therapies: The IAPT program. Annual Review of Clinical Psychology, 14, 159–183. http://doi.org/10.1146/annurev-clinpsy-050817-084833
   PubMed Web of Science ®Google Scholar
• Comprehensive Meta-Analysis ( Version 3) [Computer software]. (2014). Englewood, CO: Biostat. Retrieved from http://www.comprehensive.com
   Google Scholar
• Covidence Systematic Review Software. (2017). Veritas Health Innovation. Retrieved from www.covidence.org.
   Google Scholar
• *Davidsen, A. H., Poulsen, S., Lindschou, J., Winkel, P., Tróndarson, M. F., Waaddegaard, M., & Lau, M. (2017). Feedback in group psychotherapy for eating disorders: A randomized clinical trial. Journal of Consulting and Clinical Psychology, 85(5), 484–494. doi: 10.1037/ccp0000173
   PubMed Web of Science ®Google Scholar
• Davidson, K., Perry, A., & Bell, L. (2015). Would continuous feedback of patient’s clinical outcomes to practitioners improve NHS psychological therapy services? Critical analysis and assessment of quality of existing studies. Psychology and Psychotherapy, 88(1), 21–37. http://doi.org/10.1111/papt.12032
   PubMed Web of Science ®Google Scholar
• de Beurs, E., den Hollander-Gijsman, M. E., van Rood, Y. R., van der Wee, N. J. A., Giltay, E. J., van Noorden, M. S. … Zitman, F. G. (2011). Routine outcome monitoring in the Netherlands: Practical experiences with a web-based strategy for the assessment of treatment outcome in clinical practice. Clinical Psychology & Psychotherapy, 18(1), 1–12. doi: 10.1002/cpp.696
   PubMed Web of Science ®Google Scholar
• de Jong, K. (2016). Deriving implementation strategies for outcome monitoring feedback from theory, research and practice. Administration and Policy in Mental Health, 43(3), 292. doi: 10.1007/s10488-014-0589-6
   PubMed Web of Science ®Google Scholar
• de Jong, K., van Sluis, P., Nugter, M. A., Heiser, W. J., & Spinhoven, P. (2012). Understanding the differential impact of outcome monitoring: Therapist variables that moderate feedback effects in a randomized clinical trial. Psychotherapy Research, 22(4), 464–474. doi: 10.1080/10503307.2012.673023
   PubMed Web of Science ®Google Scholar
• Derogatis, L. R. (1992). SCL-90-R: Administration, scoring & procedures manual – II for the r(evised) version and other instruments of the psychopathology rating scale series (2nd ed.). Towson, MD: Clinical Psychometric Research.
   Google Scholar
• Drapeau, M. (2012). The value of progress tracking in psychotherapy. Integrating Science and Practice, 2(2). Retrieved from file:///U:/dokumenter%2015_11_2017/Artikler/Artikel%20metaanalyse/Drapeau%2010%20outcome%20monotoring%20tools_2012.pdf
   Google Scholar
• Duncan, B. L. (2012). The Partners for Change Outcome Management System (PCOMS): The heart and soul of change project. Canadian Psychology/Psychologie Canadienne, 53(2), 93–104. doi: 10.1037/a0027762
   Web of Science ®Google Scholar
• Duncan, B. L., & Reese, R. J. (2015). The Partners for Change Outcome Management System (PCOMS): Revisiting the client’s frame of reference. Psychotherapy, 52(4), 391–401. doi: 10.1037/pst0000026
   PubMed Web of Science ®Google Scholar
• Duval, S., & Tweedie, R. (2000). Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics, 56(2), 455–463. doi: 10.1111/j.0006-341X.2000.00455.x
   PubMed Web of Science ®Google Scholar
• Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997). Bias in meta-analysis detected by a simple, graphical test. BMJ, 315(7109), 629–634. doi: 10.1136/bmj.315.7109.629
   PubMed Web of Science ®Google Scholar
• Errázuriz, P., & Zilcha-Mano, S. (2018). In psychotherapy with severe patients discouraging news may be worse than no news: The impact of providing feedback to therapists on psychotherapy outcome, session attendance, and the alliance. Journal of Consulting and Clinical Psychology, 86(2), 125–139. doi: 10.1037/ccp0000277
   PubMed Web of Science ®Google Scholar
• Hannan, C., Lambert, M. J., Harmon, C., Nielsen, S. L., Smart, D. W., Shimokawa, K., & Sutton, S. W. (2005). A lab test and algorithms for identifying clients at risk for treatment failure. Journal of Clinical Psychology, 61(2), 155–163. doi: 10.1002/jclp.20108
   PubMed Web of Science ®Google Scholar
• *Hansen, B., Howe, A., Sutton, P., & Ronan, K. (2015). Impact of client feedback on clinical outcomes for young people using public mental health services: A pilot study. Psychiatry Research, 229(1–2), 617–619. doi: 10.1016/j.psychres.2015.05.007
   PubMed Web of Science ®Google Scholar
• Heart and Soul of Change Project. (2017, August 22). Retrieved from https://heartandsoulofchange.com/content/community
   Google Scholar
• Heart and Soul of Change Project. (2018, February 7). Retrieved from https://heartandsoulofchange.com/content/community
   Google Scholar
• Hedges, L. V., & Vevea, J. L. (1998). Fixed- and random-effects models in meta-analysis. Psychological Methods, 3(4), 486–504. doi: 10.1037/1082-989X.3.4.486
   Web of Science ®Google Scholar
• Higgins, J. P. T., Altman, D. G., & Sterne, J. A. C. (2011). Assessing risk of bias in included studies. In J. P. T. Higgins & S. Green (Ed.), Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 ( updated March 2011, pp. 187–241). The Cochrane Collaboration, 2011. Retrieved from www.handbook.cochrane.org
   Google Scholar
• Higgins, J. P. T., & Thompson, S. G. (2002). Quantifying heterogeneity in a meta-analysis. Statistics in Medicine, 21(11), 1539–1558. doi: 10.1002/sim.1186
   PubMed Web of Science ®Google Scholar
• Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003). Measuring inconsistency in meta-analyses. BMJ, 327(7414), 557–560. doi: 10.1136/bmj.327.7414.557
   PubMed Web of Science ®Google Scholar
• Howard, K. I., Moras, K., Brill, P. L., Martinovich, Z., & Lutz, W. (1996). Evaluation of psychotherapy: Efficacy, effectiveness, and patient progress. American Psychologist, 51(10), 1059–1064. doi: 10.1037/0003-066X.51.10.1059
   PubMed Web of Science ®Google Scholar
• International Center for Clinical Excellence. (2017, August 22). Retrieved from https://www.centerforclinicalexcellence.com
   Google Scholar
• International Center for Clinical Excellence. (2018, February 7). Retrieved from https://www.centerforclinicalexcellence.com
   Google Scholar
• Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59(1), 12–19. doi: 10.1037/0022-006X.59.1.12
   PubMed Web of Science ®Google Scholar
• Janse, P. D., Boezen-Hilberdink, L., van Dijk, M. K., Verbraak, M. J. P. M., & Hutschemaekers, G. J. M. (2014). Measuring feedback from clients: The psychometric properties of the Dutch Outcome Rating Scale and Session Rating Scale. European Journal of Psychological Assessment, 30(2), 86–92. doi: 10.1027/1015-5759/a000172
   Web of Science ®Google Scholar
• *Janse, P. D., de Jong, K., van Dijk, M. K., Hutschemaekers, G. J. M., & Verbraak, M. J. P. M. (2017). Improving the efficiency of cognitive-behavioural therapy by using formal client feedback. Psychotherapy Research, 27(5), 525–538. doi: 10.1080/10503307.2016.1152408
   PubMed Web of Science ®Google Scholar
• *Kellybrew-Miller, A. (2015). Retrieved from https://search.proquest.com/docview/1766579664?accountid=14468
   Google Scholar
• Kendrick, T., El-Gohary, M., Stuart, B., Gilbody, S., Churchill, R., Aiken, L., … Moore, M. (2016). Routine use of patient reported outcome measures (PROMs) for improving treatment of common mental health disorders in adults. Cochrane Database of Systematic Reviews, 7, CD011119. doi: 10.1002/14651858.CD011119.pub2
   PubMedGoogle Scholar
• Kordy, H., Hannöver, W., & Richard, M. (2001). Computer-assisted feedback-driven quality management for psychotherapy: The Stuttgart-Heidelberg model. Journal of Consulting and Clinical Psychology, 69(2), 173–183. doi: 10.1037/0022-006X.69.2.173
   PubMed Web of Science ®Google Scholar
• Lambert, M. J. (2013). The efficacy and effectiveness of psychotherapy. In M. J. Lambert (Ed.), Bergin and Garfield’s handbook of psychotherapy and behavior change (6th ed., pp. 169–218). New York: John Wiley.
   Google Scholar
• Lambert, M. J. (2015). Progress feedback and the OQ-system: The past and the future. Psychotherapy, 52(4), 381–390. doi: 10.1037/pst0000027
   PubMed Web of Science ®Google Scholar
• Lambert, M. J., Morton, J. J., Hatfield, D. R., Harmon, C., Hamilton, S., Reid, R. C., … Burlingame, G. M. (2004). Administration and scoring manual for the OQ-45.2 (Outcome Questionnaire). Salt Lake City, UT: OQ Measures, LLC.
   Google Scholar
• Lambert, M. J., & Shimokawa, K. (2011a). Collecting client feedback. Psychotherapy, 48(1), 72–79. doi: 10.1037/a0022238
   PubMed Web of Science ®Google Scholar
• Lambert, M. J., & Shimokawa, K. (2011b). Collecting client feedback. In J. C. Norcross (Ed.), Psychotherapy relationships that work: Evidence-based responsiveness (2nd ed. pp. 203–223). New York: Oxford University Press. doi: 10.1093/acprof:oso/9780199737208.003.0010
   Google Scholar
• Lambert, M. J., Whipple, J. L., Vermeersch, D. A., Smart, D. W., Hawkins, E. J., Nielsen, S. L., & Goates, M. (2002). Enhancing psychotherapy outcomes via providing feedback on client progress: A replication. Clinical Psychology & Psychotherapy, 9(2), 91–103. doi: 10.1002/cpp.324
   Web of Science ®Google Scholar
• *Lester, M. C. (2012). Retrieved from https://search.proquest.com/docview/1039541820?accountid=14468
   Google Scholar
• Lutz, W., Böhnke, J. R., & Köck, K. (2011). Lending an ear to feedback systems: Evaluation of recovery and non-response in psychotherapy in a German outpatient setting. Community Mental Health Journal, 47(3), 311–317. doi: 10.1007/s10597-010-9307-3
   PubMed Web of Science ®Google Scholar
• Lutz, W., de Jong, K., & Rubel, J. (2015). Patient-focused and feedback research in psychotherapy: Where are we and where do we want to go? Psychotherapy Research, 25(6), 625–632. doi: 10.1080/10503307.2015.1079661
   PubMed Web of Science ®Google Scholar
• Miller, S. D., & Duncan, B. L. (2004). The outcome and session rating scales: Administration and scoring manual. Chicago, IL: Institute for the Study of Therapeutic Change.
   Google Scholar
• Miller, S. D., Duncan, B. L., Brown, J., Sparks, J. A., & Claud, D. A. (2003). The Outcome Rating Scale: A preliminary study of the reliability, validity, and feasibility of a brief visual analog measure. Journal of Brief Therapy, 2, 91–100. Retrieved from http://journalbrieftherapy.com/
   Google Scholar
• Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. Journal of Clinical Epidemiology, 62(10), 1006–1012. doi: 10.1016/j.jclinepi.2009.06.005
   PubMed Web of Science ®Google Scholar
• Munder, T., Brütsch, O., Leonhart, R., Gerger, H., & Barth, J. (2013). Researcher allegiance in psychotherapy outcome research: An overview of reviews. Clinical Psychology Review, 33(4), 501–511. doi: 10.1016/j.cpr.2013.02.002
   PubMed Web of Science ®Google Scholar
• *Murphy, K. P., Rashleigh, C. M., & Timulak, L. (2012). The relationship between progress feedback and therapeutic outcome in student counselling: A randomised control trial. Counselling Psychology Quarterly, 25(1), 1–18. doi: 10.1080/09515070.2012.662349
   Google Scholar
• Norcross, J. C. (2011). Psychotherapy relationships that work: Evidence-based responsiveness (2nd ed.). New York: Oxford University Press. doi: 10.1093/acprof:oso/9780199737208.001.0001
   Google Scholar
• Norcross, J. C., & Wampold, B. E. (2011). Evidence-based therapy relationships: Research conclusions and clinical practices. Psychotherapy, 48(1), 98–102. doi: 10.1037/a0022161
   PubMed Web of Science ®Google Scholar
• Østergård, O. K., Randa, H., & Hougaard, E. (2017). The effect of using the Partner for Change Outcome Management System (PCOMS) as a feedback tool in psychotherapy: protocol for a systematic review and meta-analysis. Retrieved from http://www.crd.york.ac.uk/PROSPERO/display_record.asp?ID=CRD42017069867
   Google Scholar
• Reese, R. J., Gillaspy, J. A., Owen, J. J., Flora, K. L., Cunningham, L. C., Archie, D., & Marsden, T. (2013). The influence of demand characteristics and social desirability on clients’ ratings of the therapeutic alliance. Journal of Clinical Psychology, 69(7), 696–709. doi: 10.1002/jclp.21946
   PubMed Web of Science ®Google Scholar
• *Reese, R. J., Norsworthy, L. A., & Rowlands, S. R. (2009a). Does a continuous feedback system improve psychotherapy outcome? Psychotherapy: Theory, Research, Practice, Training, 46(4), 418–431. doi: 10.1037/a0017901
   PubMed Web of Science ®Google Scholar
• *Reese, R. J., Norsworthy, L. A., & Rowlands, S. R. (2009b). Does a continuous feedback system improve psychotherapy outcome? Psychotherapy: Theory, Research, Practice, Training, 46(4), 418–431. doi: 10.1037/a0017901
   PubMed Web of Science ®Google Scholar
• *Reese, R. J., Toland, M. D., Slone, N. C., & Norsworthy, L. A. (2010). Effect of client feedback on couple psychotherapy outcomes. Psychotherapy, 47(4), 616–630. doi: 10.1037/a0021182
   PubMed Web of Science ®Google Scholar
• *Rise, M. B., Eriksen, L., Grimstad, H., & Steinsbekk, A. (2016). The long-term effect on mental health symptoms and patient activation of using patient feedback scales in mental health out-patient treatment. A randomised controlled trial. Patient Education and Counseling, 99(1), 164–168. doi: 10.1016/j.pec.2015.07.016
   PubMed Web of Science ®Google Scholar
• SAMSHA. (2017, August 22). Substance Abuse and Mental Health Administration’s (SAMHSA) National Registry of Evidence-based Programs and Practices. Retrieved from https://www.samhsa.gov/nrepp
   Google Scholar
• *Schuman, D. L., Slone, N. C., Reese, R. J., & Duncan, B. L. (2015). Efficacy of client feedback in group psychotherapy with soldiers referred for substance abuse treatment. Psychotherapy Research, 25(4), 396–407. doi: 10.1080/10503307.2014.900875
   PubMed Web of Science ®Google Scholar
• Seidel, J. A., Andrews, W. P., Owen, J., Miller, S. D., & Buccino, D. L. (2017). Preliminary validation of the Rating of Outcome Scale and equivalence of ultra-brief measures of well-being. Psychological Assessment, 29(1), 65–75. doi: 10.1037/pas0000311
   PubMed Web of Science ®Google Scholar
• *She, Z., Duncan, B. L., Reese, R. J., Sun, Q., Shi, Y., Jiang, G. … Clements, A. L. (2018). Client feedback in China: A randomized clinical trial in a college counseling center. Journal of Counseling Psychology. Advance online publication. doi: 10.1037/cou0000300
   Web of Science ®Google Scholar
• Shimokawa, K., Lambert, M. J., & Smart, D. W. (2010). Enhancing treatment outcome of patients at risk of treatment failure: Meta-analytic and mega-analytic review of a psychotherapy quality assurance system. Journal of Consulting and Clinical Psychology, 78(3), 298–311. doi: 10.1037/a0019247
   PubMed Web of Science ®Google Scholar
• *Slone, N. C., Reese, R. J., Mathews-Duvall, S., & Kodet, J. (2015). Evaluating the efficacy of client feedback in group psychotherapy. Group Dynamics, 19(2), 122–136. doi: 10.1037/gdn0000026
   Web of Science ®Google Scholar
• Swift, J. K., & Greenberg, R. P. (2012). Premature discontinuation in adult psychotherapy: A meta-analysis. Journal of Consulting and Clinical Psychology, 80(4), 547–559. doi: 10.1037/a0028226
   PubMed Web of Science ®Google Scholar
• Tam, H. E., & Ronan, K. (2017). The application of a feedback-informed approach in psychological service with youth: Systematic review and meta-analysis. Clinical Psychology Review, 55, 41–55. doi: 10.1016/j.cpr.2017.04.005
   PubMed Web of Science ®Google Scholar
• Tasma, M., Swart, M., Wolters, G., Liemburg, E., Bruggeman, R., Knegtering, H., & Castelein, S. (2016). Do routine outcome monitoring results translate to clinical practice? A cross-sectional study in patients with a psychotic disorder. BMC Psychiatry, 16, 107. doi: 10.1186/s12888-016-0817-6
   PubMed Web of Science ®Google Scholar
• *Van Oenen, F. J., Schipper, S., van, R., Schoevers, R., Visch, I., Peen, J., & Dekker, J. (2016). Feedback-informed treatment in emergency psychiatry; a randomised controlled trial. BMC Psychiatry, 16, 110. doi: 10.1186/s12888-016-0811-z
   PubMed Web of Science ®Google Scholar
• *Winkelhorst, Y., Hafkenscheid, A., & de Groot, E. (2013). Verhoogt Routine Process Monitoring (RPM) de effectiviteit van behandeling. Tijdschrift voor Psychotherapie, 39(3), 146–156. https://doi.org/10.1007/s12485-013-0028-2
   Google Scholar