Improving the efficiency of cognitive-behavioural therapy by using formal client feedback

References

• Andrews, G., Issakidis, C., Sanderson, K., Corry, J., & Lapsley, H. (2004). Utilising survey data to inform public policy: Utilising survey data to inform public policy: Comparison of the cost-effectiveness of treatment comparison of the cost-effectiveness of treatment of ten mental disorders. The British Journal of Psychiatry, 184, 526–533. doi: 10.1192/bjp.184.6.526
   PubMed Web of Science ®Google Scholar
• Anker, M., Duncan, B. L., & Sparks, J. A. (2009). Using client feedback to improve couple outcomes: A randomized clinical trial in a naturalistic setting. Journal of Consulting and Clinical Psychology, 77, 693–704. doi: 10.1037/a0016062
   PubMed Web of Science ®Google Scholar
• Arrindell, W. A., & Ettema, J. H. M. (2003). SCL-90, Handleiding bij een multidimensionele psychopathologie indicator. [SCL-90, Manual for a multidimensional indicator of psychopathology]. Lisse: Swets & Zeitlinger.
   Google Scholar
• Asmus, F., Crouzen, M., & Van Oenen, F. J. (2004). Session Rating Scale. Retrieved December 10, 2011, from http://scottdmiller.com/purchase-individual-or-group-licenses
   Google Scholar
• Christensen, L., & Mendoza, J. L. (1986). A method of assessing change in a single subject: An alteration of the RC index. Behavior Therapy, 17, 305–308. doi: 10.1016/S0005-7894(86)80060-0
   Web of Science ®Google Scholar
• Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
   Google Scholar
• De Jong, K., Timman, R., Hakkaart-Van Roijen, L., Vermeulen, P., Kooiman, K., Passchier, J., & Van Busschbach, J. (2014). The effect of outcome monitoring feedback to clinicians and clients in short and long-term psychotherapy: A randomized controlled trial. Psychotherapy Research, 24(6), 629–639. doi: 10.1080/10503307.2013.871079
   PubMed Web of Science ®Google Scholar
• Derogatis, L. R. (1994). Symptom checklist 90–R: Administration, scoring, and procedures manual (3rd ed.). Minneapolis, MN: National Computer Systems.
   Google Scholar
• Dijkgraaf-Hartland, W., Brals, C., Verbraak, M., & Van Dijk, M. (2013). Comorbide persoonlijkheidsproblematiek en de effectiviteit van protocollaire behandeling. [Co-morbid personality problems and the effectiveness of manualized treatment]. Directieve Therapie, 33, 14–30.
   Google Scholar
• Duncan, B. L., Miller, S. D., Sparks, J. A., Claud, D. A., Reynolds, L. R., Brown, J., & Johnson, L. D. (2003). The session rating scale: Preliminary psychometric properties of a “working” alliance measure. Journal of Brief Therapy, 3, 3–12.
   Google Scholar
• Duncan, B. L., & Reese, R. J. (2015). The partners for change outcome management system (PCOMS): Revisiting the client's frame of reference. Psychotherapy, 52(4), 391–401. doi: 10.1037/pst0000026
   PubMed Web of Science ®Google Scholar
• Dunlop, W. P., Cortina, J. M., Vaslow, J. B., & Burke, M. J. (1996). Meta-analysis of experiments with matched groups or repeated measures designs. Psychological Methods, 1, 170–177. doi: 10.1037/1082-989X.1.2.170
   Web of Science ®Google Scholar
• Durlak, J. A. (2009). How to select, calculate, and interpret effect sizes. Journal of Pediatric Psychology, 34(9), 917–928. doi: 10.1093/jpepsy/jsp004
   PubMed Web of Science ®Google Scholar
• Elliot, D., Brown, J. Miller, S. D., & Duncan, B. L. (2007). ASIST for agencies—using the outcome and session rating scales (ORS/SRS. Version 3.06) [Computer software]. Santa Cruz, CA: Author.
   Google Scholar
• Flückiger, C., Del Re, A., Wampold, B. E., Znoj, H., Caspar, F., & Jörg, U. (2012). Valuing clients’ perspective and the effects on the therapeutic alliance: A randomized controlled study of an adjunctive instruction. Journal of Counseling Psychology, 59, 18–26. doi: 10.1037/a0023648
   PubMed Web of Science ®Google Scholar
• Graham, J. W., Olchowski A. E., & Gilreath, T. D. (2007). How many imputations are really needed? Some practical clarifications of multiple imputation theory. Prevention Science, 8, 206–213. doi: 10.1007/s11121-007-0070-9
   PubMed Web of Science ®Google Scholar
• Hannan, C., Lambert, M. J., Harmon, C., Nielsen, S. L., Smart, D. W., Shimokowa, K., & Sutton, S. (2005). A lab test and algorithms for identifying clients at risk for treatment failure. Journal of Clinical Psychology, 61, 155–163. doi: 10.1002/jclp.20108
   PubMed Web of Science ®Google Scholar
• Horvath, A. O., & Greenberg, L. S. (1989). Development and validation of the working alliance inventory. Journal of Counseling Psychology, 36, 223–233. doi: 10.1037/0022-0167.36.2.223
   Web of Science ®Google Scholar
• Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59, 12–19. doi: 10.1037/0022-006X.59.1.12
   PubMed Web of Science ®Google Scholar
• Janse, P. D., Boezen-Hilberdink, L., Van Dijk, M. K., Verbraak, M. J. P. M., & Hutschemaekers, G. J. M. (2014). Measuring feedback from clients: The psychometric properties of the Dutch outcome rating scale and session rating scale. European Journal of Psychological Assessment, 30(2), 86–92. doi: 10.1027/1015-5759/a000172
   Web of Science ®Google Scholar
• Keijsers, G., Van Minnen, A., & Hoogduin, K. (Eds.). (2011). Protocollaire behandeling voor volwassenen met psychische klachten 1 & 2. Amsterdam: Uitgeverij Boom.
   Google Scholar
• Keijsers, G. P. J., Verbraak, M., Ten Broeke, E., & Korrelboom, K. (2009). Psychologische behandelingen volgens een protocol. In E. ten Broeke, K. Korrelboom. & M. Verbraak (Ed.), Praktijkboek geïntegreerde cognitieve gedragstherapie. Protocollaire behandelingen op maat. [A practical guide to integrated cognitive and behavioural therapy. Tailor made treatment protocols]. Bussum: Coutinho.
   Google Scholar
• Knaup, C., Koesters, M., Schoefer, D., Becker, T., & Puschner, B. (2009). Effect of feedback of treatment outcome in specialist mental healthcare: Meta-analysis. The British Journal of Psychiatry, 195, 15–22. doi: 10.1192/bjp.bp.108.053967
   PubMed Web of Science ®Google Scholar
• Lambert, M. J. (2010). Prevention of treatment failure: The use of measuring, monitoring, & feedback in clinical practice. Washington, DC: American Psychological Association.
   Google Scholar
• Lambert, M. J. (2013). The efficacy and effectiveness of psychotherapy. In M. J. Lambert (Ed.), Bergin and Garfield's Handbook of psychotherapy and behavior change (6th ed., pp. 169–219). New York: Wiley.
   Google Scholar
• Lambert, M. J., Bailey, R., Kimball, K., Shimokawa, K., Harmon, S. C., & Slade, K. (2007). Clinical support tool manual-brief version-40. Salt Lake City, UT: OQMeasures.
   Google Scholar
• Lambert, M. J., Hansen, N. B., Umphress, V. J., Lunnen, K., Okiishi, J., Burlingame, G., … Reisinger, C. W. (1996). Administration and scoring manual for the outcome questionnaire (OQ 45.2). Wilmington, DE: American Professional Credentialing Services.
   Google Scholar
• Lambert, M. J., Whipple, J. L., Hawkins, E. J., Vermeersch, D. A., Nielsen, S. L., & Smart, D. W. (2003). Is it time for clinicians to routinely track patient outcome? A meta analysis. Clinical Psychology: Science & Practice, 10, 288–301.
   Web of Science ®Google Scholar
• Lambert, M. J., & Shimokawa, K. (2011). Collecting client feedback. Psychotherapy, 48, 72–79. doi: 10.1037/a0022238
   PubMed Web of Science ®Google Scholar
• Lecrubier, Y., Sheehan, D. V., Weiller, E., Amorim, P., Bonora, I., Sheehan, K. H. (1997). The mini international neuropsychiatric interview (MINI). A short diagnostic structured interview: reliability and validity according to the CIDI. European Psychiatry, 12, 224–231. doi: 10.1016/S0924-9338(97)83296-8
   Web of Science ®Google Scholar
• Lewis, C. C., Simons, A. D., & Kim, H. K. (2012). The role of early symptom trajectories and pretreatment variables in predicting treatment response to cognitive behavioral therapy. Journal of Consulting and Clinical Psychology, 80(4), 525–534. doi: 10.1037/a0029131
   PubMed Web of Science ®Google Scholar
• Lutz, W., Stulz, N., Martinovich, Z., Leon, S., & Saunders, S. M. (2009). Methodological background of decision rules and feedback tools for outcomes management in psychotherapy. Psychotherapy Research, 19, 502–510. doi: 10.1080/10503300802688486
   PubMed Web of Science ®Google Scholar
• Miller, S. D., & Duncan, B. L. (2004). The outcome and session rating scale. Administration and scoring manual. Chicago, IL: Institute for the Study of Therapeutic Change.
   Google Scholar
• Miller, S. D., Duncan, B. L., Brown, J., Sorrell, R., & Chalk, M. B. (2006). Using formal client feedback to improve retention and outcome: Making ongoing, real time assessment feasible. Journal of Brief Therapy, 5, 5–22.
   Google Scholar
• Miller, S. D., Duncan, B. L., Brown, J., Sparks, J., & Claud, D. (2003). The outcome rating scale: A preliminary study of the reliability, validity, and feasibility of a brief visual analogue measure. Journal of Brief Therapy, 2, 91–100.
   Google Scholar
• Murphy, K. P., Rashleigh, C. M., & Timulak, L. (2012). The relationship between progress feedback and therapeutic outcome in student counselling: A randomised control trial. Counselling Psychology Quarterly, 25, 1–18. doi: 10.1080/09515070.2012.662349
   Google Scholar
• Norcross, J. C., & Lambert, M. J. (2011). Evidence-based therapy relationships. In J. C. Norcross (Ed.), Psychotherapy relationships that work (2nd ed., pp. 1–5). New York: Oxford University Press.
   Google Scholar
• Okiishi, J., Lambert, M. J., Eggett, D., Nielsen, L., Dayton, D. D., & Vermeersch, D. A. (2006). An analysis of therapist treatment effects: Toward providing feedback to individual therapists on their clients’ psychotherapy outcome. Journal of Clinical Psychology, 62, 1157–1172. doi: 10.1002/jclp.20272
   PubMed Web of Science ®Google Scholar
• Parker, Z. J., & Waller, G. (2015). Factors related to psychotherapists’ self-assessment when treating anxiety and other disorders. Behaviour Research and Therapy, 66, 1–7. doi: 10.1016/j.brat.2014.12.010
   PubMed Web of Science ®Google Scholar
• Probst, T., Lambert, M. J., Dahlbender, R. W., Loew, T. H., & Tritt, K. (2014). Providing patient progress feedback and clinical support tools to therapists: Is the therapeutic process of patients on-track to recovery enhanced in psychosomatic in-patient therapy under the conditions of routine practice? Journal of Psychosomatic Research, 76, 477–484. doi: 10.1016/j.jpsychores.2014.03.010
   PubMed Web of Science ®Google Scholar
• Probst, T., Lambert, M. J., Loew, T. H., Dahlbender, R. W., & Tritt, K. (2015). Extreme deviations from expected recovery curves and their associations with therapeutic alliance, social support, motivation, and life events in psychosomatic in-patient therapy. Psychotherapy Research, 25(6), 714–723.
   PubMed Web of Science ®Google Scholar
• Reese, R., Gillaspy, A., Owen, J., Flora, K., Cunningham, L., Archie, D., & Marsden, T. (2013). The influence of demand characteristics and social desirability on clients’ ratings of the therapeutic alliance. Journal of Clinical Psychology, 69, 696–709. doi: 10.1002/jclp.21946
   PubMed Web of Science ®Google Scholar
• Reese, R. J., Norsworthy, L. A., & Rowlands, S. R. (2009). Does a continuous feedback system improve psychotherapy outcome? Psychotherapy: Theory, Research, Practice, Training, 46, 418–431. doi: 10.1037/a0017901
   PubMed Web of Science ®Google Scholar
• Reese, R. J., Toland, M. D., Slone, N. C., & Norsworthy, L. A. (2010). Effect of client feedback on couple psychotherapy outcomes. Psychotherapy: Theory, Research, Practice, Training, 47, 616–630. doi: 10.1037/a0021182
   PubMed Web of Science ®Google Scholar
• Rise, M. B., Eriksen, L., Grimstad, H., & Steinsbekk, A. (2012). The short-term effect on alliance and satisfaction of using patient feedback scales in mental health out-patient treatment: A randomised controlled trial. BMC Health Services Research, 12, 348. doi: 10.1186/1472-6963-12-348
   PubMed Web of Science ®Google Scholar
• Rubin, D. B. (1987). Multiple imputation for nonresponse in surveys. New York: Wiley.
   Google Scholar
• Schotte, C., & De Doncker, D. (1994). ADP IV questionnaire. Belgium: University Hospital Antwerp: Antwerp.
   Google Scholar
• Schotte, C., & De Doncker, D. (2000). De ADP-IV: een vragenlijst voor therapeutisch georiënteerde diagnostiek van persoonlijkheidsstoornissen. Psychopraxis, 2, 124–130. doi: 10.1007/BF03071865
   Google Scholar
• Schuman, D. L., Slone, N. C. Reese, R. J., & Duncan, B. (2015). Efficacy of client feedback in group psychotherapy with soldiers referred for substance abuse treatment. Psychotherapy Research, 25, 396–407. doi: 10.1080/10503307.2014.900875
   PubMed Web of Science ®Google Scholar
• Shadish, W. R., Matt, G. E., Navarro, A. M., & Philips, G. (2000). The effects of psychological therapies under clinically representative conditions: A meta-analysis. Psychological Bulletin, 126, 512–529. doi: 10.1037/0033-2909.126.4.512
   PubMed Web of Science ®Google Scholar
• Sheehan, D. V., Lecrubier, Y., Sheehan, K. H., Amorim, P., Janavs, J., & Weiler, E. (1998). The mini-international neuropsychiatric interview (M.I.N.I.): The development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. Journal of Clinical Psychiatry, 59, 22–33.
   PubMed Web of Science ®Google Scholar
• Shimokawa, K., Lambert, M. J., & Smart, D. W. (2010). Enhancing treatment outcome of patients at risk of treatment failure: Meta-analytic and mega-analytic review of a psychotherapy quality assurance system. Journal of Consulting and Clinical Psychology, 78, 298–311. doi: 10.1037/a0019247
   PubMed Web of Science ®Google Scholar
• Sinnema, H., Franx, G., & Van ‘t Land, H. (2010). Multidisciplinaire richtlijnen in de GGZ. [Multidisciplinary guidelines in mental health care]. Utrecht: Trimbos-instituut.
   Google Scholar
• Slone, N. C., Reese, R. J., Mathews-Duvall, S., & Kodet, J. (2015). Evaluating the efficacy of client feedback in group psychotherapy. Group Dynamics: Theory, Research, and Practice, 19, 122–136.
   Google Scholar
• Van Ginkel, J. R. (2010). SPSS syntax for applying rules for combining univariate estimates in multiple imputation. Retrieved March 2015, from www.socialsciences. leiden.edu/educationandchildstudies/childandfamilystudies/organisation/staffcfs/van-ginkel.html
   Google Scholar
• Van Vliet, I. M., Leroy, H., & Van Megen, H. J. G. M. (2000). M.I.N.I. international neuropsychiatric interview; Dutch version 5.0.0.-R. Utrecht: Department of Psychiatry University Medical Center Utrecht.
   Google Scholar
• Walfish, S., McAlister, B., O'Donnell, P., & Lambert, M. (2012). An investigation of self-assessment bias in mental health providers. Psychological Reports, 110, 639–644. doi: 10.2466/02.07.17.PR0.110.2.639-644
   PubMed Web of Science ®Google Scholar
• Weinstein, M. C., & Skinner, J. A. (2010). Comparative effectiveness and health care spending: Implications for reform. New England Journal of Medicine, 362, 460–465. doi: 10.1056/NEJMsb0911104
   PubMed Web of Science ®Google Scholar
• Weiss, A. P., Guidi, J., & Fava, M. (2009). Closing the efficacy-effectiveness gap: Translating both the what and the how from randomized controlled trials to clinical practice. The Journal of Clinical Psychiatry, 70, 446–449. doi: 10.4088/JCP.08com04901
   PubMed Web of Science ®Google Scholar
• Westert, G. P., Van den Berg, M. J., Zwakhalse, S. L. N., Heijink, R., De Jong, J. D., & Verkleij, H. (2010). Zorgbalans 2010: de prestaties van de Nederlandse zorg. [Care balance 2010: the performance of Dutch health care]. Houten: Bohn Stafleu van Loghum.
   Google Scholar