Do routine outcome monitoring measures tell the same story? Evaluating outcome trajectories and clinical outcomes for the outcome rating scale and outcome questionnaire - 45

References

• Anker, M. G., Duncan, B. L., & Sparks, J. A. (2009). Using client feedback to improve couple therapy outcomes: A randomized clinical trial in a naturalistic setting. Journal of Consulting and Clinical Psychology, 77(4), 693–704. https://doi.org/10.1037/a0016062
   PubMed Web of Science ®Google Scholar
• Baldwin, S. A., Berkeljon, A., Atkins, D. C., Olsen, J. A., & Nielsen, S. L. (2009). Rates of change in naturalistic psychotherapy: contrasting dose-effect and good-enough level models of change. Journal of Consulting and Clinical Psychology, 77(2), 203–211. https://doi.org/10.1037/a0015235
   PubMed Web of Science ®Google Scholar
• Beck, A. T., Epstein, N., Brown, G., & Steer, R. A. (1988). An inventory for measuring clinical anxiety: Psychometric properties. Journal of Consulting and Clinical Psychology, 56(6), 893–897. https://doi.org/10.1037/0022-006X.56.6.893
   PubMed Web of Science ®Google Scholar
• Beck, A. T., Rush, A. J., Shaw, B. F., & Emery, G. (1979). Cognitive therapy of depression. The Guildford Press.
   Google Scholar
• Boswell, D. L., White, J. K., Sims, W. D., Harrist, R. S., & Romans, J. S. C. (2013). Reliability and validity of the outcome questionnaire–45.2. Psychological Reports, 112(3), 689–693. https://doi.org/10.2466/02.08.PR0.112.3.689-693
   PubMed Web of Science ®Google Scholar
• Bovendeerd, B., De Jong, K., De Groot, E., Moerbeek, M., & De Keijser, J. (2022). Enhancing the effect of psychotherapy through systematic client feedback in outpatient mental healthcare: A cluster randomized trial. Psychotherapy Research, 32(6), 710–722. https://doi.org/10.1080/10503307.2021.2015637
   PubMed Web of Science ®Google Scholar
• Brattland, H., Koksvik, J. M., Burkeland, O., Gråwe, R. W., Klöckner, C., Linaker, O. M., Ryum, T., Wampold, B., Lara-Cabrera, M. L., & Iversen, V. C. (2018). The effects of routine outcome monitoring (ROM) on therapy outcomes in the course of an implementation process: A randomized clinical trial. Journal of Counseling Psychology, 65(5), 641–652. https://doi.org/10.1037/cou0000286
   PubMed Web of Science ®Google Scholar
• Campbell, A., & Hemsley, S. (2009). Outcome rating scale and session rating scale in psychological practice: Clinical utility of ultra-brief measures. Clinical Psychologist, 13(1), 1–9. https://doi.org/10.1080/13284200802676391
   Web of Science ®Google Scholar
• Castonguay, L., Barkham, M., Lutz, W., & McAleavey, A. (2013). Practice-oriented research: Approaches and applications. In M. J. Lambert (Ed.), Bergin and garfield’s handbook of psychotherapy and behavior change (6th ed (pp. 85–133). Wiley.
   Google Scholar
• Choi, B., & Pak, A. (2007). Hello-goodbye effect. In N. J. Salkind (Ed.), Encyclopedia of measurement and statistics (Vol. 1 (pp. 429–430). Sage.
   Google Scholar
• Conoley, C. W., & Scheel, M. J. (2018). Goal focused positive psychotherapy: A strengths-based approach. Oxford University Press.
   Google Scholar
• de Jong, K., Conijn, J. M., Gallagher, R. A. V., Reshetnikovea, A. S., Jeij, M., & Lutz, M. C. (2021). Using progress feedback to improve outcomes and reduce drop-out, treatment duration, and deterioration: A multilevel meta-analysis. Clinical Psychology Review, 85, https://doi.org/10.1016/j.cpr.2021.102002
   PubMed Web of Science ®Google Scholar
• De Jong, P., & Berg, I. K. (2015). Interviewing for solutions (4th ed.). Brooks/Cole.
   Google Scholar
• de Vries, R. M., Meijer, R. R., van Bruggen, V., & Morey, R. D. (2016). Improving the analysis of routine outcome measurement data: What a Bayesian approach can do for you. International Journal of Methods in Psychiatric Research, 25(3), 155–167. https://doi.org/10.1002/mpr.1496
   PubMed Web of Science ®Google Scholar
• Duncan, B., Miller, S., Sparks, J., Claud, D., Reynolds, L., Brown, J., & Johnson, L. D. (2003). The session rating scale: Preliminary psychometric properties of a “working” alliance measure. Journal of Brief Therapy, 3, 3–12.
   Google Scholar
• Duncan, B., & Sparks, J. (2019). The partners for change outcome management system: An integrated elearning manual for everything PCOMS. Author.
   Google Scholar
• Duncan, B. L. (2012). The partners for change outcome management system (PCOMS): The heart and soul of change project. Canadian Psychology / Psychologie Canadienne, 53(2), 93–104. https://doi.org/10.1037/a0027762
   Web of Science ®Google Scholar
• Harris, R. (2019). ACT made simple: An easy-to-read primer on acceptance and commitment therapy. New Harbinger Press.
   Google Scholar
• Kersten, P., White, P. J., & Tennant, A. (2014). Is the pain visual analogue scale linear and responsive to change? An exploration using Rasch analysis. PloS One, 9(6), e99485. https://doi.org/10.1371/journal.pone.0099485
   PubMed Web of Science ®Google Scholar
• Lambert, M. (2010). Prevention of treatment failure: The use of measuring, monitoring, and feedback in clinical practice. American Psychological Association, https://doi.org/10.1037/12141-000.
   Google Scholar
• Lambert, M. J. (2004). Administration and scoring manual for the OQ-45.2 (outcome questionnaire). OQ Measures, LLC.
   Google Scholar
• Lambert, M. J., Burlingame, G. M., Umphress, V., Hansen, N. B., Vermeersch, D. A., Clouse, G. C., & Yanchar, S. C. (1996). The reliability and validity of the outcome questionnaire. Clinical Psychology and Psychotherapy, 3, 249–258. https://doi.org/10.1002/(SICI)1099-0879(199612)3:43.0.CO;2-S
   Web of Science ®Google Scholar
• Lambert, M. J., & Shimokawa, K. (2011). Collecting client feedback. Psychotherapy, 48(1), 72–79. https://doi.org/10.1037/a0022238
   PubMed Web of Science ®Google Scholar
• Lambert, M. J., Whipple, J. L., & Kleinstäuber, M. (2018). Collecting and delivering progress feedback: A meta-analysis of routine outcome monitoring. Psychotherapy, 55(4), 520–537. https://doi.org/10.1037/pst0000167
   PubMed Web of Science ®Google Scholar
• Lambert, M. J., Whipple, J. L., Smart, D. W., Vermeersch, D. A., Nielsen, S. L., & Hawkins, E. J. (2001). The effects of providing therapists with feedback on patient progress during psychotherapy: Are outcomes enhanced? Psychotherapy Research, 11(1), 49–68. https://doi.org/10.1080/713663852
   PubMed Web of Science ®Google Scholar
• Linehan, M. M. (2015). DBT skills training manual (2nd ed.). The Guilford Press.
   Google Scholar
• McCullough, L., Kuhn, N., Andrews, S., Kaplan, A., Wolf, J., & Hurley, C. L. (2003). Treating affect phobia: A manual for short-term dynamic psychotherapy. The Guilford Press.
   Google Scholar
• Miller, S. D., & Duncan, B. L. (2000). The outcome rating scale. Author.
   Google Scholar
• Miller, S. D., Duncan, B. L., Brown, J., Sparks, J., & Claud, D. (2003). The outcome rating scale: A preliminary study of the reliability, validity, and feasibility of a brief visual analog measure. Journal of Brief Therapy, 2, 91–100.
   Google Scholar
• Miller, S. D., Duncan, B. L., Sorrell, R., & Brown, G. S. (2005). The partners for change outcome management system. Journal of Clinical Psychology, 61(2), 199–208. https://doi.org/10.1002/jclp.20111
   PubMed Web of Science ®Google Scholar
• Minami, T., Wampold, B. E., Serlin, R. C., Kircher, J. C., & Brown, G. S. (2007). Benchmarks for psychotherapy efficacy in adult major depression. Journal of Consulting and Clinical Psychology, 75(2), 232–243. https://doi.org/10.1037/0022-006X.75.2.232
   PubMed Web of Science ®Google Scholar
• Nugter, M., Hermens, M., Robbers, S., Van Son, G., Theunissen, J., & Engelsbel, F. (2019). Use of outcome measurements in clinical practice: How specific should one be? Psychotherapy Research, 29(4), 432–444. https://doi.org/10.1080/10503307.2017.1408975
   PubMed Web of Science ®Google Scholar
• Østergård, O. K., O’Toole, M. S., Svendsen, M. M., & Hougaard, E. (2019). The effect of implementing the partners for change outcome management system in a nationwide student counseling service. Journal of Counseling Psychology, https://doi.org/10.1037/cou0000353
   PubMed Web of Science ®Google Scholar
• Østergård, O. K., Randa, H., & Hougaard, E. (2020). The effect of using the Partners for Change Outcome Management System as feedback tool in psychotherapy-A systematic review and meta-analysis. Psychotherapy Research, 30(2), 195–212. https://doi.org/10.1080/10503307.2018.1517949
   PubMed Web of Science ®Google Scholar
• Owen, J., Adelson, J., Budge, S., Wampold, B., Kopta, M., Minami, T., & Miller, S. (2015). Trajectories of change in psychotherapy. Journal of Clinical Psychology, 71, 817–827. https://doi.org/10.1002/jclp.22191
   PubMed Web of Science ®Google Scholar
• Pejtersen, J. H., Viinholt, B., & Hansen, H. (2020). Feedback-informed treatment: A systematic review and meta-analysis of the partners for change outcome management system. Journal of Counseling Psychology, 67(6), 723–735. https://doi.org/10.1037/cou0000420
   PubMed Web of Science ®Google Scholar
• Reese, R., Duncan, B., Kodet, J., Brown, H., Meiller, C., Farook, M., Lengerich, A. J., Vasilj, I., Hong, S.-H., & Bohanske, R. (2018). Patient feedback as a quality improvement strategy in an acute care, inpatient unit: An investigation of outcome and readmission rates. Psychological Services, 15(4), 470–476. https://doi.org/10.1037/ser0000163
   PubMed Web of Science ®Google Scholar
• Reese, R. J., Duncan, B. L., Bohanske, R. T., Owen, J. J., & Minami, T. (2014). Benchmarking outcomes in a public behavioral health setting: Feedback as a quality improvement strategy. Journal of Consulting and Clinical Psychology, 82(4), 731–742. https://doi.org/10.1037/a0036915
   PubMed Web of Science ®Google Scholar
• Reese, R. J., Duncan, B. L., & Clements-Hickman, A. L. (in press). Does practice-generated data improve psychotherapy effectiveness (routine outcome monitoring)? In F. Leong, M. Constantino, & C. Eubanks (Eds.), APA handbook of psychotherapy. American Psychological Association.
   Google Scholar
• Reese, R. J., Norsworthy, L. A., & Rowlands, S. R. (2009). Does a continuous feedback system improve psychotherapy outcome? Psychotherapy: Theory, Research, Practice, Training, 46(4), 418–431. https://doi.org/10.1037/a0017901
   PubMed Web of Science ®Google Scholar
• Reese, R. J., Toland, M. D., Slone, N. C., & Norsworthy, L. A. (2010). Effect of client feedback on couple psychotherapy outcomes. Psychotherapy: Theory, Research, Practice, Training, 47(4), 616–630. https://doi.org/10.1037/a0021182
   PubMed Web of Science ®Google Scholar
• Rogers, C. R. (1961). On becoming a person. Houghton Mifflin Company.
   Google Scholar
• Segal, Z., Williams, M., & Teasdale, J. (2018). Mindfulness-based cognitive therapy for depression (2nd ed.). The Guilford Press.
   Google Scholar
• Seidel, J. A., Andrews, W. P., Owen, J., Miller, S. D., & Buccino, D. L. (2017). Preliminary validation of the rating of outcome scale and equivalence of ultra-brief measures of well-being. Psychological Assessment, 29(1), 65–75. https://doi.org/10.1037/pas0000311
   PubMed Web of Science ®Google Scholar
• She, Z., Duncan, B., Reese, R., Sun, Q., Shi, Y., Jiang, G., Wu, C., & Clements, A. (2018). Client feedback in China: A randomized clinical trial in a college counseling center. Journal of Counseling Psychology, 65(6), 727–737. https://doi.org/10.1037/cou0000300
   PubMed Web of Science ®Google Scholar
• Slone, N. C., Reese, R. J., Mathews-Duvall, S., & Kodet, J. (2015). Evaluating the efficacy of client feedback in group psychotherapy. Group Dynamics: Theory, Research, and Practice, 19(2), 122–136. https://doi.org/10.1037/gdn0000026
   Web of Science ®Google Scholar
• Toland, M. D., Li, C., Kodet, J., & Reese, R. J. (2021). Psychometric properties of the outcome rating scale: An item response theory analysis. Measurement and Evaluation in Counseling and Development, 54(2), 90–105. https://doi.org/10.1080/07481756.2020.1745647
   Web of Science ®Google Scholar