The effect of process and outcome feedback in highly distressed outpatients: A randomized controlled trial

References

• Amble, I., Gude, T., Stubdal, S., Andersen, B. J., & Wampold, B. E. (2015). The effect of implementing the Outcome Questionnaire-45.2 feedback system in Norway: A multisite randomized clinical trial in a naturalistic setting. Psychotherapy Research, 25(6), 669–677. doi: 10.1080/10503307.2014.928756
   PubMed Web of Science ®Google Scholar
• American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Washington, DC: Author.
   Google Scholar
• Andersson, E. M., & Lambert, M. J. (2001). A survival analysis of clinically significant change in outpatient psychotherapy. Journal of Clinical Psychology, 57(7), 875–888. doi:10.1002/jclp.1056
   PubMed Web of Science ®Google Scholar
• Berking, M., Orth, U., & Lutz, W. (2006). Wie effektiv sind systematische Rückmeldungen des Therapieverlaufs an den Therapeuten? Zeitschrift für Klinische Psychologie und Psychotherapie, 35(1), 21–29.
   Google Scholar
• Bolger, N., & Laurenceau, J. P. (2013). Intensive longitudinal methods: An introduction to diary and experience sampling research. New York, NY: Guilford Press.
   Google Scholar
• Brattland, H., Koksvik, J. M., Burkeland, O., Gråwe, R. W., Klöckner, C., Linaker, O. M., … Iversen, V. C. (2018). The effects of routine outcome monitoring (ROM) on therapy outcomes in the course of an implementation process: A randomized clinical trial. Journal of Counseling Psychology, 65(5), 641–652. doi: 10.1037/cou0000286
   PubMed Web of Science ®Google Scholar
• Brattland, H., Koksvik, J. M., Burkeland, O., Klöckner, C. A., Lara-Cabrera, M. L., Miller, S. D., … Iversen, V. C. (2019). Does the working alliance mediate the effect of routine outcome monitoring (ROM) and alliance feedback on psychotherapy outcomes? A secondary analysis from a randomized clinical trial. Journal of Counseling Psychology, 66(2), 234–246. doi: 10.1037/cou0000320
   PubMed Web of Science ®Google Scholar
• Davidsen, A. H., Poulsen, S., Lindschou, J., Winkel, P., Tróndarson, M. F., Waaddegaard, M., & Lau, M. (2017). Feedback in group psychotherapy for eating disorders: A randomized clinical trial. Journal of Consulting and Clinical Psychology, 85(5), 484–494. doi: 10.1037/ccp0000173
   PubMed Web of Science ®Google Scholar
• Davidson, K., Perry, A., & Bell, L. (2015). Would continuous feedback of patient’s clinical outcomes to practitioners improve NHS psychological therapy services? Critical analysis and assessment of quality of existing studies. Psychology and Psychotherapy: Theory, Research and Practice, 88(1), 21–37. doi: 10.1111/papt.12032
   PubMed Web of Science ®Google Scholar
• De Jong, K., Segaar, J., Ingenhoven, T., van Busschbach, J., & Timman, R. (2018). Adverse effects of outcome monitoring feedback in patients with personality disorders: A randomized controlled trial in day treatment and inpatient settings. Journal of Personality Disorders, 32(3), 393–413. doi: 10.1521/pedi_2017_31_297
   PubMed Web of Science ®Google Scholar
• De Jong, K., Van Sluis, P., Nugter, M. A., Heiser, W. J., & Spinhoven, P. (2012). Understanding the differential impact of outcome monitoring: Therapist variables that moderate feedback effects in a randomized clinical trial. Psychotherapy Research, 22(4), 464–474. doi: 10.1080/10503307.2012.673023
   PubMed Web of Science ®Google Scholar
• Derogatis, L. R. (1992). SCL-90-R: Administration, scoring & procedures manual-II for the (revised) version and other instruments of the psychopathology rating scale series. Towson, MD: Clinical Psychometric Research.
   Google Scholar
• Doerfler, L. A., Addis, M. E., & Moran, P. W. (2002). Evaluating mental health outcomes in an inpatient setting: Convergent and divergent validity of the OQ-45 and BASIS-32. The Journal of Behavioral Health Services & Research, 29(4), 394–403. doi: 10.1007/BF02287346
   PubMed Web of Science ®Google Scholar
• Errázuriz, P., & Zilcha-Mano, S. (2018). In psychotherapy with severe patients discouraging news may be worse than no news: The impact of providing feedback to therapists on psychotherapy outcome, session attendance, and the alliance. Journal of Consulting and Clinical Psychology, 86(2), 125–139. doi: 10.1037/ccp0000277
   PubMed Web of Science ®Google Scholar
• Falkenström, F., Hatcher, R. L., Skjulsvik, T., Larsson, M. H., & Holmqvist, R. (2015). Development and validation of a 6-item working alliance questionnaire for repeated administrations during psychotherapy. Psychological Assessment, 27(1), 169–183. doi: 10.1037/pas0000038
   PubMed Web of Science ®Google Scholar
• Falkenström, F., Josefsson, A., Berggren, T., & Holmqvist, R. (2016). How much therapy is enough? Comparing dose-effect and good-enough models in two different settings. Psychotherapy, 53(1), 130–139.
   PubMed Web of Science ®Google Scholar
• Fowler, J. C., Madan, A., Frueh, B. C., Bradshaw, M., Flack, J., & Weinstein, B. (2019). Lessons learned while integrating patient-reported outcomes in a psychiatric hospital. Psychotherapy, 56(1), 91–99. doi: 10.1037/pst0000174
   PubMed Web of Science ®Google Scholar
• Gondek, D., Edbrooke-Childs, J., Fink, E., Deighton, J., & Wolpert, M. (2016). Feedback from outcome measures and treatment effectiveness, treatment efficiency, and collaborative practice: A systematic review. Administration and Policy in Mental Health and Mental Health Services Research, 43(3), 325–343. doi: 10.1007/s10488-015-0710-5
   PubMed Web of Science ®Google Scholar
• Gross, R., Glasser, S., Elisha, D., Tishby, O., Madar, J. D., Levitan, G., … Ponizovsky, A. M. (2015). Validation of the Hebrew and Arabic Versions of the Outcome Questionnaire (OQ-45). The Israel Journal of Psychiatry and Related Sciences, 52(1), 33–39.
   PubMed Web of Science ®Google Scholar
• Hatcher, R. L., & Gillaspy, J. A. (2006). Development and validation of a revised short version of the working alliance inventory. Psychotherapy Research, 16(1), 12–25. doi: 10.1080/10503300500352500
   Web of Science ®Google Scholar
• Heisel, M. J., Duberstein, P. R., Talbot, N. L., King, D. A., & Tu, X. M. (2009). Adapting interpersonal psychotherapy for older adults at risk for suicide: Preliminary findings. Professional Psychology: Research and Practice, 40(2), 156–164. doi: 10.1037/a0014731
   PubMed Web of Science ®Google Scholar
• Horvath, A. O., & Greenberg, L. S. (1989). Development and validation of the working alliance inventory. Journal of Counseling Psychology, 36(2), 223–233. doi: 10.1037/0022-0167.36.2.223
   Web of Science ®Google Scholar
• Klein, D. N., Schwartz, J. E., Santiago, N. J., Vivian, D., Vocisano, C., Castonguay, L. G., … Riso, L. P. (2003). Therapeutic alliance in depression treatment: Controlling for prior change and patient characteristics. Journal of Consulting and Clinical Psychology, 71(6), 997–1006. doi: 10.1037/0022-006X.71.6.997
   PubMed Web of Science ®Google Scholar
• Lambert, M. J., Hansen, N. B., Umpress, V., Lunnen, K., Okiishi, J., Burlingame, G. M., & Reisinger, C. W. (1996). Administration and scoring manual for the OQ-45.2. Stevenson, MD: American Professional Credentialing Services.
   Google Scholar
• Lambert, M. J., Whipple, J. L., & Kleinstäuber, M. (2018). Collecting and delivering progress feedback: A meta-analysis of routine outcome monitoring. Psychotherapy, 55(4), 520–537. doi: 10.1037/pst0000167
   PubMed Web of Science ®Google Scholar
• Lane, S. P., & Hennes, E. P. (2018). Power struggles: Estimating sample size for multilevel relationships research. Journal of Social and Personal Relationships, 35(1), 7–31.
   Web of Science ®Google Scholar
• Lutz, W., De Jong, K., & Rubel, J. (2015). Patient-focused and feedback research in psychotherapy: Where are we and where do we want to go? Psychotherapy Research, 25(6), 625–632. doi: 10.1080/10503307.2015.1079661
   PubMed Web of Science ®Google Scholar
• Lutz, W., Stulz, N., & Köck, K. (2009). Patterns of early change and their relationship to outcome and follow-up among patients with major depressive disorders. Journal of Affective Disorders, 118(1–3), 60–68. doi: 10.1016/j.jad.2009.01.019
   PubMed Web of Science ®Google Scholar
• Lutz, W., Tholen, S., Schürch, E., & Berking, M. (2006). The development, validation, and reliability of short-forms of current instruments for the evaluation of therapeutic progress in psychotherapy and psychiatry. Diagnostica, 52(1), 11–25. doi: 10.1026/0012-1924.52.1.11
   Web of Science ®Google Scholar
• McCabe, R., & Priebe, S. (2004). The therapeutic relationship in the treatment of severe mental illness: A review of methods and findings. International Journal of Social Psychiatry, 50(2), 115–128. doi: 10.1177/0020764004040959
   PubMed Web of Science ®Google Scholar
• McClintock, A. S., Perlman, M. R., McCarrick, S. M., Anderson, T., & Himawan, L. (2017). Enhancing psychotherapy process with common factors feedback: A randomized, clinical trial. Journal of Counseling Psychology, 64(3), 247–260. doi: 10.1037/cou0000188
   PubMed Web of Science ®Google Scholar
• Moltu, C., Veseth, M., Stefansen, J., Nøtnes, J. C., Skjølberg, Å, Binder, P. E., … Nordberg, S. S. (2018). This is what I need a clinical feedback system to do for me: A qualitative inquiry into therapists’ and patients’ perspectives. Psychotherapy Research, 28(2), 250–263. doi: 10.1080/10503307.2016.1189619
   PubMed Web of Science ®Google Scholar
• Muthén, L. K., & Muthén, B. O. (2002). How to use a Monte Carlo study to decide on sample size and determine power. Structural equation modeling, 9(4), 599–620. doi: 10.1207/S15328007SEM0904_8
   Web of Science ®Google Scholar
• Newnham, E. A., Hooke, G. R., & Page, A. C. (2010). Progress monitoring and feedback in psychiatric care reduces depressive symptoms. Journal of Affective Disorders, 127(1–3), 139–146. doi: 10.1016/j.jad.2010.05.003
   PubMed Web of Science ®Google Scholar
• Østergård, O. K., Randa, H., & Hougaard, E. (2018). The effect of using the partners for change outcome management system as feedback tool in psychotherapy—A systematic review and meta-analysis. Psychotherapy Research, 1–18. doi: 10.1080/10503307.2018.1517949
   PubMed Web of Science ®Google Scholar
• Ryff, C. D., & Keyes, C. L. M. (1995). The structure of psychological well-being revisited. Journal of Personality and Social Psychology, 69(4), 719–727. doi: 10.1037/0022-3514.69.4.719
   PubMed Web of Science ®Google Scholar
• Safran, J. D., & Muran, J. C. (2006). Has the concept of the therapeutic alliance outlived its usefulness? Psychotherapy: Theory, Research, Practice, Training, 43, 286–291. doi: 10.1037/0033-3204.43.3.286
   PubMed Web of Science ®Google Scholar
• Simon, W., Lambert, M. J., Harris, M. W., Busath, G., & Vazquez, A. (2012). Providing patient progress information and clinical support tools to therapists: Effects on patients at risk of treatment failure. Psychotherapy Research, 22(6), 638–647. doi: 10.1080/10503307.2012.698918
   PubMed Web of Science ®Google Scholar
• Slade, K., Lambert, M. J., Harmon, S. C., Smart, D. W., & Bailey, R. (2008). Improving psychotherapy outcome: The use of immediate electronic feedback and revised clinical support tools. Clinical Psychology & Psychotherapy: An International Journal of Theory & Practice, 15(5), 287–303. doi: 10.1002/cpp.594
   PubMed Web of Science ®Google Scholar
• Snell, M. N., Mallinckrodt, B., Hill, R. D., & Lambert, M. J. (2001). Predicting counseling center clients’ response to counseling: A 1-year follow-up.. Journal of Counseling Psychology, 48(4), 463–473. doi: 10.1037/0022-0167.48.4.463
   Web of Science ®Google Scholar
• Town, J. M., Diener, M. J., Abbass, A., Leichsenring, F., Driessen, E., & Rabung, S. (2012). A meta-analysis of psychodynamic psychotherapy outcomes: Evaluating the effects of research-specific procedures. Psychotherapy, 49(3), 276–290. doi: 10.1037/a0029564
   PubMed Web of Science ®Google Scholar
• Tzur Bitan, D., Ganor, O., Biran, L., & Bloch, Y. (2018). Implementing routine outcome monitoring in public mental health services in Israel: Shared and unique challenges. Journal of Evaluation in Clinical Practice, 24(2), 323–330. doi: 10.1111/jep.12839
   PubMed Web of Science ®Google Scholar
• Tzur Bitan, D., Zilcha-Mano, S., Ganor, O., Biran, L., & Bloch, Y. (2018). Routine measurement and feedback in support groups for parents of children with autistic spectrum disorder. Psychotherapy, 55(2), 191–195. doi: 10.1037/pst0000140
   PubMed Web of Science ®Google Scholar
• Verbeke, G., & Molenberghs, G. (1997). Linear mixed models in practice: a SAS-oriented approach. Vol. 126.
   Google Scholar
• Wampold, B. E. (2015). Routine outcome monitoring: Coming of age-with the usual developmental challenges. Psychotherapy, 52(4), 458–462. doi: 10.1037/pst0000037
   PubMed Web of Science ®Google Scholar