804
Views
4
CrossRef citations to date
0
Altmetric
Empirical Papers

Matching research and practice: Prediction of individual patient progress and dropout risk for basic routine outcome monitoring

ORCID Icon, ORCID Icon, ORCID Icon & ORCID Icon
Pages 358-371 | Received 03 Mar 2021, Accepted 07 May 2021, Published online: 21 May 2021

References

  • Aafjes-van Doorn, K., Kamsteeg, C., Bate, J., & Aafjes, M. (2020). A scoping review of machine learning in psychotherapy research. Psychotherapy Research, 31(1), 92–116. https://doi.org/10.1080/10503307.2020.1808729
  • American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (4th ed.).
  • APA Presidential Task Force on Evidence-Based Practice. (2006). Evidence-based practice in psychology. American Psychologist, 61(4), 271–285. https://doi.org/10.1037/0003-066X.61.4.271
  • Barkham, M., & Mellor-Clark, J. (2003). Bridging evidence-based practice and practice-based evidence: Developing a rigorous and relevant knowledge for the psychological therapies. Clinical Psychology & Psychotherapy, 10(6), 319–327. https://doi.org/10.1002/cpp.379
  • Barkham, M., Stiles, W. B., & Shapiro, D. A. (1993). The shape of change in psychotherapy: Longitudinal assessment of personal problems. Journal of Consulting and Clinical Psychology, 61(4), 667–677. https://doi.org/10.1037/0022-006X.61.4.667
  • Barrett, M. S., Chua, W.-J., Crits-Christoph, P., Gibbons, M. B., Casiano, D., & Thompson, D. (2008). Early withdrawal from mental health treatment: Implications for psychotherapy practice. Psychotherapy: Theory, Research, Practice, Training, 45(2), 247–267. https://doi.org/10.1037/0033-3204.45.2.247
  • Bates, D., Maechler, M., Bolker, B., & Walker, S. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67(1), 1–48. https://doi.org/10.18637/jss.v067.i01
  • Beck, A. T., Ward, C. H., Mendelson, M., Mock, J., & Erbaugh, J. (1961). An inventory for measuring depression. Archives of General Psychiatry, 4(6), 561–571. https://doi.org/10.1001/archpsyc.1961.01710120031004
  • Bohart, A. C., & Wade, A. G. (2013). The client in psychotherapy. In M. J. Lambert (Ed.), Bergin and Garfield’s handbook of psychotherapy and behavior change (6th ed., pp. 219–257). Wiley.
  • Bone, C., Simmonds-Buckley, M., Thwaites, R., Sandford, D., Merzhvynska, M., Rubel, J., Deisenhofer, A.-K., Lutz, W., & Delgadillo, J. (2021). Dynamic prediction of psychological treatment outcomes: Development and validation of a prediction model using routinely collected symptom data. The Lancet Digital Health, 3(4), e231–e240. https://doi.org/10.1016/S2589-7500(21)00018-2
  • Boswell, J. F. (2020). Monitoring processes and outcomes in routine clinical practice: A promising approach to plugging the holes of the practice-based evidence colander. Psychotherapy Research, 30(7), 829–842. https://doi.org/10.1080/10503307.2019.1686192
  • Boswell, J. F., Kraus, D. R., Miller, S. D., & Lambert, M. J. (2015). Implementing routine outcome monitoring in clinical practice: Benefits, challenges, and solutions. Psychotherapy Research, 25(1), 6–19. https://doi.org/10.1080/10503307.2013.817696
  • Bronswijk, S. C. V., Bruijniks, S. J. E., Lorenzo-Luaces, L., Derubeis, R. J., Lemmens, L. H. J. M., Peeters, F. P. M. L., & Huibers, M. J. H. (2021). Cross-trial prediction in psychotherapy: External validation of the Personalized Advantage Index using machine learning in two Dutch randomized trials comparing CBT versus IPT for depression. Psychotherapy Research, 31(1), 78–91. https://doi.org/10.1080/10503307.2020.1823029
  • Cahill, J., Barkham, M., Hardy, G., Rees, A., Shapiro, D. A., Stiles, W. B., & Macaskill, N. (2003). Outcomes of patients completing and not completing cognitive therapy for depression. British Journal of Clinical Psychology, 42(2), 133–143. https://doi.org/10.1348/014466503321903553
  • Castonguay, L. G., Barkham, M., Lutz, W., & McAleavey, A. A. (2013). Practice-oriented research: Approaches and applications. In M. J. Lambert (Ed.), Bergin and Garfield’s handbook of psychotherapy and behavior change (6th ed., pp. 85–133). Wiley.
  • Cohen, Z. D., & DeRubeis, R. J. (2018). Treatment selection in depression. Annual Review of Clinical Psychology, 14(1), 209–236. https://doi.org/10.1146/annurev-clinpsy-050817-084746
  • de Jong, K. (2016). Deriving implementation strategies for outcome monitoring feedback from theory, research and practice. Administration and Policy in Mental Health and Mental Health Services Research, 43(3), 292–296. https://doi.org/10.1007/s10488-014-0589-6
  • de Jong, K., van Sluis, P., Nugter, M. A., Heiser, W. J., & Spinhoven, P. (2012). Understanding the differential impact of outcome monitoring: Therapist variables that moderate feedback effects in a randomized clinical trial. Psychotherapy Research, 22(4), 464–474. https://doi.org/10.1080/10503307.2012.673023
  • Delgadillo, J., de Jong, K., Lucock, M., Lutz, W., Rubel, J., Gilbody, S., Ali, S., Aguirre, E., Appleton, M., Nevin, J., O'Hayon, H., Patel, U., Sainty, A., Spencer, P., & McMillan, D. (2018). Feedback-informed treatment versus usual psychological treatment for depression and anxiety: A multisite, open-label, cluster randomised controlled trial. The Lancet Psychiatry, 5(7), 564–572. https://doi.org/10.1016/S2215-0366(18)30162-7
  • Delgadillo, J., Overend, K., Lucock, M., Groom, M., Kirby, N., McMillan, D., Gilbody, S., Lutz, W., Rubel, J. A., & de Jong, K. (2017). Improving the efficiency of psychological treatment using outcome feedback technology. Behaviour Research and Therapy, 99, 89–97. https://doi.org/10.1016/j.brat.2017.09.011
  • Derogatis, L. R. (1992). SCL-9o-R, administration, scoring & procedures manuaL-II for the revised version and other instruments of the PsychopathoLogy Rating Scale Series (2nd ed.). Clinical Psychometrie Research Incorporated.
  • Derogatis, L. R. (1993). Brief Symptom Inventory (BSI), administration, scoring, and procedures manual (3rd ed.). National Computer Services.
  • DeRubeis, R. J., Cohen, Z. D., Forand, N. R., Fournier, J. C., Gelfand, L. A., & Lorenzo-Luaces, L. (2014). The Personalized Advantage Index: Translating research on prediction into individualized treatment recommendations: A demonstration. PloS One, 9(1), e83875. https://doi.org/10.1371/journal.pone.0083875
  • Dyason, K. M., Low-Choy, S., O’Donovan, A., & Shanley, D. C. (2020). Modeling individualized trajectories of symptom change to improve feedback procedures in psychotherapy. Journal of Consulting and Clinical Psychology, 89(1), 34–48. https://doi.org/10.1037/ccp0000614
  • Evans, C., Mellor-Clark, J., Margison, F., Barkham, M., Audin, K., Connell, J., & McGrath, G. (2000). CORE: Clinical outcomes in routine evaluation. Journal of Mental Health, 9(3), 247–255. https://doi.org/10.1080/713680250
  • Finch, A. E., Lambert, M. J., & Schaalje, B. G. (2001). Psychotherapy quality control: The statistical generation of expected recovery curves for integration into an early warning system. Clinical Psychology & Psychotherapy, 8(4), 231–242. https://doi.org/10.1002/cpp.286
  • First, M. B., Gibbon, M., Spritzer, R. L., Williams, J. B., & Benjamin, L. S. (1997). Structured clinical interview for DSM-IV axis II personality disorders, (SCID-II). American Psychiatric Association.
  • Flückiger, C., Meyer, A., Wampold, B. E., Gassmann, D., Messerli-Bürgy, N., & Munsch, S. (2011). Predicting premature termination within a randomized controlled trial for binge-eating patients. Behavior Therapy, 42(4), 716–725. https://doi.org/10.1016/j.beth.2011.03.008
  • Flückiger, C., Wampold, B. E., Delgadillo, J., Rubel, J., Vîslă, A., & Lutz, W. (2020). Is there an evidence-based number of sessions in outpatient psychotherapy? – A comparison of naturalistic conditions across countries. Psychotherapy and Psychosomatics, 89(5), 333–335. https://doi.org/10.1159/000507793
  • Franke, G. H. (2000). BSI. Brief symptom inventory—deutsche version. Manual. Beltz.
  • Friedman, J., Hastie, T., & Tibshirani, R. (2010). Regularization paths for generalized linear models via coordinate descent. Journal of Statistical Software, 33(1), 1–22. https://doi.org/10.1163/ej.9789004178922.i-328.7
  • Fydrich, T., Renneberg, B., Schmitz, B., & Wittchen, H.-U. (1997). SKID II. Strukturiertes Klinisches Interview für DSM-IV, Achse II: Persönlichkeitsstörungen. Interviewheft. Hogrefe.
  • Garland, A. F., Kruse, M., & Aarons, G. A. (2003). Clinicians and outcome measurement: What’s the use? The Journal of Behavioral Health Services & Research, 30(4), 393–405. https://doi.org/10.1007/BF02287427
  • Gilbody, S. M., House, A. O., & Sheldon, T. A. (2002). Outcomes research in mental health: Systematic review. The British Journal of Psychiatry: The Journal of Mental Science, 181(1), 8–16. https://doi.org/10.1192/bjp.181.1.8
  • Gower, J. C. (1971). A general coefficient of similarity and some of its properties. Biometrics, 27(4), 857–871. https://doi.org/10.2307/2528823
  • Guo, P. (2015). Elasso: Enhanced least absolute shrinkage and selection operator regression model. R package version 1.1. https://CRAN.R-project.org/package=elasso
  • Guo, P., Zeng, F., Hu, X., Zhang, D., Zhu, S., Deng, Y., & Hao, Y. (2015). Improved variable selection algorithm using a LASSO-type penalty, with an application to assessing hepatitis B infection relevant factors in community residents. PLoS One, 10(7), e0134151. https://doi.org/10.1371/journal.pone.0134151
  • Hannan, C., Lambert, M. J., Harmon, C., Nielsen, S. L., Smart, D. W., Shimokawa, K., & Sutton, S. W. (2005). A lab test and algorithms for identifying clients at risk for treatment failure. Journal of Clinical Psychology, 61(2), 155–163. https://doi.org/10.1002/jclp.20108
  • Hautzinger, M., Bailer, M., Worall, H., & Keller, F. (1995). Das Beck-Depressions-Inventar (BDI): Überarbeitet und ergänzte Neuauflage. Hans Huber.
  • Hautzinger, M., Keller, F., & Kühner, C. H. (2009). BDI-II. Beck-Depressions-Inventar. Revision (2nd ed.). Pearson Assessment.
  • Hiller, W., Bleichhardt, G., Haaf, B., Legenbauer, T., Mauer-Matzen, K., & Rübler, D. (2006). Zertifizierung einer Psychotherapeutischen Hochschulambulanz nach DIN EN ISO 9001. Zeitschrift für Klinische Psychologie und Psychotherapie, 35(3), 225–233. https://doi.org/10.1026/1616-3443.35.3.225
  • Howard, K. I., Kopta, S. M., Krause, M. S., & Orlinsky, D. E. (1986). The dose–effect relationship in psychotherapy. American Psychologist, 41(2), 159–164. https://doi.org/10.1037/0003-066X.41.2.159
  • Howard, K. I., Lueger, R. J., Maling, M. S., & Martinovich, Z. (1993). A phase model of psychotherapy outcome: Causal mediation of change. Journal of Consulting and Clinical Psychology, 61(4), 678–685. https://doi.org/10.1037/0022-006X.61.4.678
  • Howard, K. I., Moras, K., Brill, P. L., Martinovich, Z., & Lutz, W. (1996). Evaluation of psychotherapy: Efficacy, effectiveness, and patient progress. American Psychologist, 51(10), 1059–1064. doi:10.1037/0003-066X.51.10.1059
  • Hox, J. J. (2010). Multilevel analysis: Techniques and applications (2nd ed.). Routledge/Taylor & Francis Group.
  • Janis, R., Youn, S. J., Xiao, H., Castonguay, L. G., Hayes, J., & Locke, B. (2015, June). Comparison of expected treatment response and nearest neighbor methods for generating expected recovery curves [Conference Paper]. Presented at the 46th International Conference, Society for Psychotherapy Research, Philadelphia, PA, USA. https://www.researchgate.net/publication/279194765_Comparison_of_expected_treatment_response_and_nearest_neighbor_methods_for_generating_expected_recovery_curves
  • Kendrick, T., El-Gohary, M., Stuart, B., Gilbody, S., Churchill, R., Aiken, L., Bhattacharya, A., Gimson, A., Bruett, A. L., de Jong, K., & Moore, M. (2016). Routine use of patient reported outcome measures (PROMs) for improving treatment of common mental health disorders in adults. Cochrane Database of Systematic Reviews, 7, CD011119. https://doi.org/10.1002/14651858.CD011119.pub2
  • Lambert, M. J. (2010). Prevention of treatment failure: The use of measuring, monitoring, and feedback in clinical practice. American Psychological Association.
  • Lambert, M. J. (Ed.). (2013). The efficacy and effectiveness of psychotherapy. In Bergin and Garfield’s handbook of psychotherapy and behavior change (6th ed., pp. 169–218). Wiley.
  • Lambert, M. J. (2017). Maximizing psychotherapy outcome beyond evidence-based medicine. Psychotherapy and Psychosomatics, 86(2), 80–89. https://doi.org/10.1159/000455170
  • Lambert, M. J., Hansen, N. B., & Finch, A. E. (2001). Patient-focused research: Using patient outcome data to enhance treatment effects. Journal of Consulting and Clinical Psychology, 69(2), 159–172. https://doi.org/10.1037//0022-006X.69.2.159
  • Lambert, M. J., & Harmon, K. L. (2018). The merits of implementing routine outcome monitoring in clinical practice. Clinical Psychology: Science and Practice, 25(4), e12268. https://doi.org/10.1111/cpsp.12268
  • Lambert, M. J., & Shimokawa, K. (2011). Collecting client feedback. Psychotherapy, 48(1), 72–79. https://doi.org/10.1037/a0022238
  • Lambert, M. J., Whipple, J. L., Hawkins, E. J., Vermeersch, D. A., Nielsen, S. L., & Smart, D. W. (2003). Is it time for clinicians to routinely track patient outcome? A meta-analysis. Clinical Psychology: Science and Practice, 10(3), 288–301. https://doi.org/10.1093/clipsy.bpg025
  • Lambert, M. J., Whipple, J. L., & Kleinstäuber, M. (2018). Collecting and delivering progress feedback: A meta-analysis of routine outcome monitoring. Psychotherapy, 55(4), 520–537. https://doi.org/10.1037/pst0000167
  • Lilienfeld, S. O., Ritschel, L. A., Lynn, S. J., Cautin, R. L., & Latzman, R. D. (2015). Science–practice gap. In S. O. Lilienfeld & R. L. Cautin (Eds.), The encyclopedia of clinical psychology (1st ed., pp. 1–7). Wiley. https://doi.org/10.1002/9781118625392.wbecp566
  • Locke, B. D., Buzolitz, J. S., Lei, P.-W., Boswell, J. F., McAleavey, A. A., Sevig, T. D., Dowis, J. D., & Hayes, J. A. (2011). Development of the Counseling Center Assessment of Psychological Symptoms-62 (CCAPS-62). Journal of Counseling Psychology, 58(1), 97–109. https://doi.org/10.1037/a0021282
  • Lutz, W. (2002). Patient-focused psychotherapy research and individual treatment progress as scientific groundwork for an empirically based clinical practice. Psychotherapy Research, 12(3), 251–272. https://doi.org/10.1093/ptr/12.3.251
  • Lutz, W., Ehrlich, T., Rubel, J., Hallwachs, N., Röttger, M.-A., Jorasz, C., Mocanu, S., Vocks, S., Schulte, D., & Tschitsaz-Stucki, A. (2013). The ups and downs of psychotherapy: Sudden gains and sudden losses identified with session reports. Psychotherapy Research, 23(1), 14–24. https://doi.org/10.1080/10503307.2012.693837
  • Lutz, W., Lambert, M. J., Harmon, S. C., Tschitsaz, A., Schürch, E., & Stulz, N. (2006). The probability of treatment success, failure and duration—What can be learned from empirical data to support decision making in clinical practice? Clinical Psychology & Psychotherapy, 13(4), 223–232. https://doi.org/10.1002/cpp.496
  • Lutz, W., Leach, C., Barkham, M., Lucock, M., Stiles, W. B., Evans, C., Noble, R., & Iveson, S. (2005). Predicting change for individual psychotherapy clients on the basis of their nearest neighbors. Journal of Consulting and Clinical Psychology, 73(5), 904–913. https://doi.org/10.1037/0022-006X.73.5.904
  • Lutz, W., Rubel, J. A., Schwartz, B., Schilling, V., & Deisenhofer, A.-K. (2019). Towards integrating personalized feedback research into clinical practice: Development of the Trier Treatment Navigator (TTN). Behaviour Research and Therapy, 120, 103438. https://doi.org/10.1016/j.brat.2019.103438
  • Lutz, W., Saunders, S. M., Leon, S. C., Martinovich, Z., Kosfelder, J., Schulte, D., Grawe, K., & Tholen, S. (2006). Empirically and clinically useful decision making in psychotherapy: Differential predictions with treatment response models. Psychological Assessment, 18(2), 133–141. https://doi.org/10.1037/1040-3590.18.2.133
  • Maechler, M., Rousseeuw, P., Struyf, A., Hubert, M., & Hornik, K. (2019). Cluster: Cluster analysis basics and extensions. R package version 2.1.0. https://cran.r-project.org/web/packages/cluster/cluster.pdf
  • McMurran, M., Huband, N., & Overton, E. (2010). Non-completion of personality disorder treatments: A systematic review of correlates, consequences, and interventions. Clinical Psychology Review, 30(3), 277–287. https://doi.org/10.1016/j.cpr.2009.12.002
  • Nagelkerke, N. (1991). A note on a general definition of the coefficient of determination. https://doi.org/10.1093/BIOMET/78.3.691
  • Nordmo, M., Monsen, J. T., Høglend, P. A., & Solbakken, O. A. (2020). Investigating the dose-response effect in open-ended psychotherapy. Psychotherapy Research, 1–11. https://doi.org/10.1080/10503307.2020.1861359
  • R Core Team (2019). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. https://www.R-project.org/.
  • Roos, J., & Werbart, A. (2013). Therapist and relationship factors influencing dropout from individual psychotherapy: A literature review. Psychotherapy Research, 23(4), 394–418. https://doi.org/10.1080/10503307.2013.775528
  • Schreiber-Gregory, D. N. (2018, January). Regulation techniques for multicollinearity: Lasso, ridge, and elastic nets [Conference Paper]. Presented at the Western Users of SAS Software (WUSS), Sacramento, California. https://www.researchgate.net/publication/341355507
  • Sharf, J., Primavera, L. H., & Diener, M. J. (2010). Dropout and therapeutic alliance: A meta-analysis of adult individual psychotherapy. Psychotherapy: Theory, Research, Practice, Training, 47(4), 637–645. https://doi.org/10.1037/a0021175
  • Shimokawa, K., Lambert, M. J., & Smart, D. W. (2010). Enhancing treatment outcome of patients at risk of treatment failure: Meta-analytic and mega-analytic review of a psychotherapy quality assurance system. Journal of Consulting and Clinical Psychology, 78(3), 298–311. https://doi.org/10.1037/a0019247
  • Stulz, N., Lutz, W., Leach, C., Lucock, M., & Barkham, M. (2007). Shapes of early change in psychotherapy under routine outpatient conditions. Journal of Consulting and Clinical Psychology, 75(6), 864–874. https://doi.org/10.1037/0022-006X.75.6.864
  • Swift, J. K., & Greenberg, R. P. (2012). Premature discontinuation in adult psychotherapy: A meta-analysis. Journal of Consulting and Clinical Psychology, 80(4), 547–559. https://doi.org/10.1037/a0028226
  • Tavris, C. (2003). Mind games: Psychological warfare between therapists and scientists. The Chronicle of Higher Education, 49(25), B7.
  • Trauer, T., Gill, L., Pedwell, G., & Slattery, P. (2006). Routine outcome measurement in public mental health—What do clinicians think? Australian Health Review, 30(2), 144–147. https://doi.org/10.1071/AH060144
  • Uckelstam, C.-J., Philips, B., Holmqvist, R., & Falkenström, F. (2019). Prediction of treatment outcome in psychotherapy by patient initial symptom distress profiles. Journal of Counseling Psychology, 66(6), 736–746. https://doi.org/10.1037/cou0000345
  • Webb, C. A., Cohen, Z. D., Beard, C., Forgeard, M., Peckham, A. D., & Björgvinsson, T. (2020). Personalized prognostic prediction of treatment outcome for depressed patients in a naturalistic psychiatric hospital setting: A comparison of machine learning approaches. Journal of Consulting and Clinical Psychology, 88(1), 25–38. https://doi.org/10.1037/ccp0000451
  • Whipple, J. L., Lambert, M. J., Vermeersch, D. A., Smart, D. W., Nielsen, S. L., & Hawkins, E. J. (2003). Improving the effects of psychotherapy: The use of early identification of treatment and problem-solving strategies in routine practice. Journal of Counseling Psychology, 50(1), 59–68. https://doi.org/10.1037/0022-0167.50.1.59
  • Youn, S. J., Kraus, D. R., & Castonguay, L. G. (2012). The treatment outcome package: Facilitating practice and clinically relevant research. Psychotherapy, 49(2), 115–122. https://doi.org/10.1037/a0027932
  • Zimmermann, D., Rubel, J., Page, A. C., & Lutz, W. (2017). Therapist effects on and predictors of non-consensual dropout in psychotherapy. Clinical Psychology & Psychotherapy, 24(2), 312–321. https://doi.org/10.1002/cpp.2022

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.