Enhancing the effect of psychotherapy through systematic client feedback in outpatient mental healthcare: A cluster randomized trial.

References

• American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders-text revision.
   Google Scholar
• Barkham, M., Mellor-Clark, J., Connell, J., & Cahill, J. (2006). A core approach to practice-based evidence: A brief history of the origins and applications of the CORE-OM and CORE system. Counselling & Psychotherapy Research, 6(1), 3–15. https://doi.org/https://doi.org/10.1080/14733140600581218
   Google Scholar
• Bordin, E. (1979). The generalizability of the psychoanalytic concept of the working alliance. Psychotherapy: Theory, Research & Practice, 16(3), 252–260. https://doi.org/https://doi.org/10.1037/h0085885
   Google Scholar
• Bovendeerd, B., de Jong, K., Colijn, S., Groot, I. W., Hafkenscheid, A., Moerbeek, M., & Keijser, A. (2019). Systematic client feedback to brief therapy in basic mental healthcare: Study protocol for a four-centre clinical trial. BMJ Open, 9. https://doi.org/https://doi.org/10.1136/bmjopen-2018-025701.
   Google Scholar
• Brattland, H., Koksvik, J. M., Burkeland, O., Gråwe, R. W., Klöckner, C., Linaker, O. M., Ryum, T., Wampold, B., Lara-Cabrera, M. L., & Iversen, V. C. (2018). The effects of routine outcome monitoring (ROM) on therapy outcomes in the course of an implementation process: A randomized clinical trial. Journal of Counseling Psychology, 65(5), 641–652. https://doi.org/https://doi.org/10.1037/cou0000286
   PubMed Web of Science ®Google Scholar
• Brattland, H., Koksvik, J. M., Burkeland, O., Klöckner, C. A., Lara-Cabrera, M. L., Miller, S. D., Wampold, B., Ryum, T., & Iversen, V. C. (2019). Does the working alliance mediate the effect of routine outcome monitoring (ROM) and alliance feedback on psychotherapy outcomes? A secondary analysis from a randomized clinical trial. Journal of Counseling Psychology, 66(2), 234–246. https://doi.org/https://doi.org/10.1037/cou0000320
   PubMed Web of Science ®Google Scholar
• Crouzen, M. (2010). Handleiding [manual] client directed outcome informed. http://www.stress-management-nl.org/lezingen/27sept2010-crouzen.pdf.
   Google Scholar
• Davidson, K., Perry, A., & Bell, L. (2015). Would continuous feedback of patient’s clinical outcomes to practitioners improve NHS psychological therapy services? Critical analysis and assessment of quality of existing studies. Psychology and Psychotherapy: Theory, Research and Practice, 88(1), 21–37. https://doi.org/https://doi.org/10.1111/papt.12032
   PubMed Web of Science ®Google Scholar
• De Jong, K., Conijn, J. M., Lutz, M. C., Gallagher, R. A. V., Reshetnikova, A. S., & Heij, M. (submitted). Using progress feedback to improve outcomes and reduce drop-out: A multilevel meta-analysis.
   Google Scholar
• De Jong, K., Nugter, M. A., Lambert, M. J., & Burlingame, G. M. (2009). Handleiding voor afname en scoring van de Outcome Questionnaire (OQ-45). [Manual for administration and scoring of the Outcome Questionnaire (OQ-45)]. OQ Measures LLC.
   Google Scholar
• De Jong, K., Nugter, M. A., Polak, M. G., Wagenborg, J. E. A., Spinhoven, P., & Heiser, W. J. (2007). The outcome questionnaire (OQ-45) in a Dutch population: A cross-cultural validation. Clinical Psychology & Psychotherapy, 14(4), 288–301. https://doi.org/https://doi.org/10.1002/cpp.529
   Web of Science ®Google Scholar
• Delgadillo, J., McMillan, D., Gilbody, S., de Jong, K., Lucock, M., Lutz, W., Rubel, J., Aguirre, E., & Ali, S. (2021). Cost-effectiveness of feedback-informed psychological treatment: Evidence from the IAPT-FIT trial. Behaviour Research and Therapy, 142, 103873. https://doi.org/https://doi.org/10.1016/j.brat.2021.103873
   PubMed Web of Science ®Google Scholar
• Delgadillo, J., Overend, K., Lucock, M., Groom, M., Kirby, N., McMillan, D., Gilbody, S., Lutz, W., Rubel, J. A., & de Jong, K. (2017). Improving the efficiency of psychological treatment using outcome feedback technology. Behaviour Research and Therapy, 99, 89–97. https://doi.org/https://doi.org/10.1016/j.brat.2017.09.011
   PubMed Web of Science ®Google Scholar
• Duncan, B., Miller, S., Sparks, J., Claud, D., Reynolds, L., Brown, J., & Johnson, L. D. (2003). The session rating scale: Preliminary psychometric properties of a “working” alliance measure. Journal of Brief Therapy, 3, 1, 3–12.
   Google Scholar
• Duncan, B. L., & Sparks, J. A. (2002). Heroic clients, heroic agencies: Partners for change. Nova Southeastern University.
   Google Scholar
• Horvath, A. O., & Symonds, B. D. (1991). Relation between working alliance and outcome in psychotherapy: A meta-analysis. Journal of Counseling Psychology, 38(2), 139–149. https://doi.org/https://doi.org/10.1037/0022-0167.38.2.139
   Web of Science ®Google Scholar
• Hox, J. J., Moerbeek, M., & Schoot, R. (2018). Multilevel analysis. Techniques and applications. Routledge.
   Google Scholar
• Janse, P. D., de Jong, K., Dijk, M. K., Hutschemaekers, G. J. M., & Verbraak, M. J. P. M. (2016). Improving the efficiency of cognitive behavioural therapy by using formal client feedback. Psychotherapy Research, 27, 5. https://doi.org/https://doi.org/10.1080/10503307.2016.1152408.
   Google Scholar
• Janse, P. D., de Jong, K., Veerkamp, C., Dijk, M. K., Hutschemaekers, G. J. M., & Verbraak, M. J. P. M. (2020). The effect of feedback-informed cognitive behavioral therapy on treatment outcome: A randomized controlled trial. Journal of Consulting and Clinical Psychology, 88(9), 818–828. https://doi.org/https://doi.org/10.1037/ccp0000549
   PubMed Web of Science ®Google Scholar
• Janssen, M. B., Bovendeerd, A. M., & Christenhusz L. (2021). The effect of systematic feedback on drop-out and no-show in forensic psychiatry: A pilot study. Tijdschrift voor Psychotherapie, 2, 4.
   Google Scholar
• Kendrick, T., El-Gohary, M., Stuart, B., Gilbody, S., Churchill, R., Aiken, L., Bhattacharya, A., Gimson, A., Brütt, A. L., Jong, K., & Moore, M. (2016). Routine use of patient reported outcome measures (PROMs) for improving treatment of common mental health disorders in adults. Cochrane Database of Systematic Reviews, 7, 7. Art. No.: CD011119. https://doi.org/https://doi.org/10.1002/14651858.CD011119.pub2.
   Google Scholar
• Keyes, C. L. M. (2002). The mental health continuum: From languishing to flourishing in life. Journal of Health and Social Behavior, 43(2), 207–222. https://doi.org/https://doi.org/10.2307/3090197
   PubMed Web of Science ®Google Scholar
• Knaup, C., Koesters, M., Schoefer, D., Becker, T., & Puschner, B. (2009). Effect of feedback of treatment outcome in specialist mental healthcare: Meta-analysis. The British Journal of Psychiatry, 195(1), 15–22. https://doi.org/https://doi.org/10.1192/bjp.bp.108.053967
   PubMed Web of Science ®Google Scholar
• Lambert, M. J., Morton, J. J., Hatfield, D. R., Harmon, C., Hamilton, S., Shimokawa, K., & Reisinger, C. W. (2004). Administration and scoring manual for the OQ-45.2 (outcome questionnaire). American Professional Credentialing Services LLC.
   Google Scholar
• Lambert, M. J., Whipple, J. L., & Kleinstauber, M. (2018). Collecting and delivering progress feedback: A meta-analysis of routine outcome monitoring. Psychotherapy, 55(4), 520–537. https://doi.org/https://doi.org/10.1037/pst0000167
   PubMed Web of Science ®Google Scholar
• Lamers, S. M. A., Westerhof, G. J., Bohlmeijer, E. T., ten Klooster, P. M., & Keyes, C. L. M. (2011). Evaluating the psychometric properties of the Mental Health Continuum-Short Form (MHCSF). Journal of Clinical Psychology, 67(1), 99–110. https://doi.org/https://doi.org/10.1002/jclp.20741
   PubMed Web of Science ®Google Scholar
• Miller, S. D., Duncan, B. L., Brown, J., Sparks, J., & Claud, D. (2003). The outcome rating scale: A preliminary study of the reliability, validity, and feasibility of a brief visual analog measure. Journal of Brief Therapy, 2, 2., 91–100.
   Google Scholar
• Moerbeek, M., Breukelen, G. J. P., & Berger, M. P. F. (2003). A comparison between traditional methods and multilevel regression for the analysis of multicenter intervention studies. Journal of Clinical Epidemiology, 56(4), 341–350. https://doi.org/https://doi.org/10.1016/S0895-4356(03)00007-6
   PubMed Web of Science ®Google Scholar
• Oenen, F. J., Schipper, S., Van, R., Schoevers, R., Visch, I., Peen, J., & Dekker, J. (2016). Feedback-informed treatment in emergency psychiatry: A randomized controlled trial. BMC Psychiatry, 16(1), 110. https://doi.org/https://doi.org/10.1186/s12888-016-0811-z
   PubMedGoogle Scholar
• Østergård, O. K., Randa, H., & Hougaard, E. (2020). The effect of using the partners for change outcome management system as feedback tool in psychotherapy – A systematic review and meta-analysis. Psychotherapy Research, 30(2), 195–212. https://doi.org/https://doi.org/10.1080/10503307.2018.1517949
   PubMed Web of Science ®Google Scholar
• Schneider, B., Ehrhart, M. G., & Macey, W. H. (2013). Organizational climate and culture. Annual Review of Psychology, 64(1), 361–388. https://doi.org/https://doi.org/10.1146/annurev-psych-113011-143809
   PubMed Web of Science ®Google Scholar
• Seligman, M. E. P. (2011). Flourish. Free Press.
   Google Scholar
• Sembill, A., Vocks, S., Kosfelder, J., & Schöttke, H. (2019). The phase model of psychotherapy outcome: Domain-specific trajectories of change in outpatient treatment. Psychotherapy Research, 29(4), 541–552. https://doi.org/https://doi.org/10.1080/10503307.2017.1405170
   PubMed Web of Science ®Google Scholar
• Shazer, S., Dolan, Y., Korman, H., McCollum, E., Trepper, T., & Berg, I. K. (2007). Haworth brief therapy series. More than miracles: The state of the art of solution-focused brief therapy. Haworth Press.
   Google Scholar
• Thabane, L., Mbuagbaw, L., Zhang, S., Samaan, Z., Marcucci, M., Ye, C., Thabane, M., Giangregorio, L., Dennis, B., Kosa, D., Borg Debono, V., Dillenburg, R., Fruci, V., Bawor, M., Lee, J., Wells, G., & Goldsmith, C. H. (2013). A tutorial on sensitivity analyses in clinical trials: The what, why, when and how. BMC Medical Research Methodology, 13(1), 92. https://doi.org/https://doi.org/10.1186/1471-2288-13-92
   PubMed Web of Science ®Google Scholar
• Tschuschke, V., Crameri, A., Koehler, M., Berglar, J., Muth, K., Staczan, P., Von Wyl, A., Schulthess, P., & Koemeda-Lutz, M. (2015). The role of therapists’ treatment adherence, professional experience, therapeutic alliance, and clients’ severity of psychological problems: Prediction of treatment outcome in eight different psychotherapy approaches. Preliminary results of a naturalistic study. Psychotherapy Research, 25(4), 420–434. https://doi.org/https://doi.org/10.1080/10503307.2014.896055
   PubMed Web of Science ®Google Scholar
• Wells, K. B., Stewart, A., Hays, R. D., Burnam, M. A., Rogers, W., Daniels, M., Berry, S., Greenfield, S., & Ware, J. (1989). The functioning and well-being of depressed patients. Results from the medical outcomes study. Journal of the American Medical Association, 262(7), 914–919. https://doi.org/https://doi.org/10.1001/jama.1989.03430070062031
   PubMed Web of Science ®Google Scholar
• Wijngaarden, B., Meije, D., & Kok, I. (2008). Het onderscheidend vermogen van een Consumer Quality Index voor kortdurende ambulante geestelijke gezondheidszorg en verslavingszorg. [The distinctive character of a consumer quality index for short-term outpatient mental health care and addiction care]. Trimbos-instituut.
   Google Scholar
• Wolpert, M. (2014). Uses and abuses of patient reported outcome measures (PROMs): Potential iatrogenic impact of PROMs implementation and how it can be mitigated. Administration and Policy in Mental Health and Mental Health Services Research, 41(2), 141–145. https://doi.org/https://doi.org/10.1007/s10488-013-0509-1
   PubMed Web of Science ®Google Scholar