Individual treatment selection for patients with post-traumatic stress disorder: External validation of a personalised advantage index

References

• Barkham, M. (2023). Smaller effects matter in the psychological therapies: 25 years on from Wampold et al. (1997). Psychotherapy Research, 33(4), 530–532. https://doi.org/10.1080/10503307.2022.2141589
   PubMed Web of Science ®Google Scholar
• Bone, C., Simmonds-Buckley, M., Thwaites, R., Sandford, D., Merzhvynska, M., Rubel, J., Deisenhofer, A.-K., Lutz, W., & Delgadillo, J. (2021). Dynamic prediction of psychological treatment outcomes: Development and validation of a prediction model using routinely collected symptom data. The Lancet Digital Health, 3(4), e231–e240. https://doi.org/10.1016/S2589-7500(21)00018-2
   PubMedGoogle Scholar
• Clark, D. M., Layard, R., Smithies, R., Richards, D. A., Suckling, R., & Wright, B. (2009). Improving access to psychological therapy: Initial evaluation of two UK demonstration sites. Behaviour Research and Therapy, 47(11), 910–920. https://doi.org/10.1016/j.brat.2009.07.010
   PubMed Web of Science ®Google Scholar
• Clark, D. M., & Whittington, A. (2023, January 16). What’s in a name? NHS talking therapies, for anxiety and depression – The new name for IAPT services. NHS England. https://www.england.nhs.uk/blog/whats-in-a-name-nhs-talking-therapies-for-anxiety-and-depression-the-new-name-for-iapt-services/.
   Google Scholar
• Collins, G. S., Ogundimu, E. O., & Altman, D. G. (2016). Sample size considerations for the external validation of a multivariable prognostic model: A resampling study. Statistics in Medicine, 35(2), 214–226. https://doi.org/10.1002/sim.6787
   PubMed Web of Science ®Google Scholar
• D’Agostino, R. B. (1998). Propensity score methods for bias reduction in the comparison of a treatment to a non-randomized control group. Statistics in Medicine, 17(19), 2265–2281. https://doi.org/10.1002/(SICI)1097-0258(19981015)17:19<2265::AID-SIM918>3.0.CO;2-B
   PubMed Web of Science ®Google Scholar
• Deisenhofer, A.-K., Delgadillo, J., Rubel, J. A., Bohnke, J. R., Zimmermann, D., Schwartz, B., & Lutz, W. (2018). Individual treatment selection for patients with posttraumatic stress disorder. Depression and Anxiety, 35(6), 541–550. https://doi.org/10.1002/da.22755
   PubMed Web of Science ®Google Scholar
• Delgadillo, J., Ali, S., Fleck, K., Agnew, C., Southgate, A., Parkhouse, L., Cohen, Z. D., DeRubeis, R. J., & Barkham, M. (2022). Stratified care vs stepped care for depression: A cluster randomized clinical trial. JAMA Psychiatry, 79(2), 101–108. https://doi.org/10.1001/jamapsychiatry.2021.3539
   PubMed Web of Science ®Google Scholar
• Delgadillo, J., & Gonzalez Salas Duhne, P. (2020). Targeted prescription of cognitive–behavioral therapy versus person-centered counseling for depression using a machine learning approach. Journal of Consulting and Clinical Psychology, 88(1), 14–24. https://doi.org/10.1037/ccp0000476
   PubMed Web of Science ®Google Scholar
• Delgadillo, J., Rubel, J., & Barkham, M. (2020). Towards personalized allocation of patients to therapists. Journal of Consulting and Clinical Psychology, 88(9), 799–808. https://doi.org/10.1037/ccp0000507
   PubMed Web of Science ®Google Scholar
• DeRubeis, R. J., Cohen, Z. D., Forand, N. R., Fournier, J. C., Gelfand, L. A., & Lorenzo-Luaces, L. (2014). The personalized advantage index: Translating research on prediction into individualized treatment recommendations. A demonstration. PLoS One, 9(1), e83875. https://doi.org/10.1371/journal.pone.0083875
   PubMed Web of Science ®Google Scholar
• Ehlers, A., Clark, D. M., Hackmann, A., McManus, F., & Fennell, M. (2005). Cognitive therapy for post-traumatic stress disorder: Development and evaluation. Behaviour Research and Therapy, 43(4), 413–431. https://doi.org/10.1016/j.brat.2004.03.006
   PubMed Web of Science ®Google Scholar
• Fear, N. T., Bridges, S., Hatch, S., Hawkins, V., & Wessely, S. (2016). Chapter 4: Posttraumatic stress disorder. In S. McManus, P. Bebbington, R. Jenkins, & T. Brugha (Eds.), Mental health and wellbeing in England: Adult psychiatric morbidity survey 2014 (pp. 106–130). NHS Digital.
   Google Scholar
• Hastie, T., Tibshirani, R., & Friedman, J. H. (2009). The elements of statistical learning: Data mining, inference, and prediction. Springer. https://hastie.su.domains/Papers/ESLII.pdf.
   Google Scholar
• Hehlmann, M. I., Schwartz, B., Moggia, D., Schaffrath, J., & Lutz, W. (2023). Cross-sample validation of affect and rumination as predictors of outcome in psychological therapy [Manuscript in preparation].
   Google Scholar
• Held, P., Schubert, R. A., Pridgen, S., Kovacevic, M., Montes, M., Christ, N. M., Banerjee, U., & Smith, D. L. (2022). Who will respond to intensive PTSD treatment? A machine learning approach to predicting response prior to starting treatment. Journal of Psychiatric Research, 151, 78–85. https://doi.org/10.1016/j.jpsychires.2022.03.066
   PubMed Web of Science ®Google Scholar
• Herzog, P., Voderholzer, U., Gärtner, T., Osen, B., Svitak, M., Doerr, R., Rolvering-Dijkstra, M., Feldmann, M., Rief, W., & Brakemeier, E. L. (2021). Predictors of outcome during inpatient psychotherapy for posttraumatic stress disorder: A single-treatment, multi-site, practice-based study. Psychotherapy Research, 31(4), 468–482. https://doi.org/10.1080/10503307.2020.1802081
   PubMed Web of Science ®Google Scholar
• Hoeboer, C. M., Oprel, D. A. C., De Kleine, R. A., Schwartz, B., Deisenhofer, A. K., Schoorl, M., Van Der Does, W. A. J., van Minnen, A., & Lutz, W. (2021). Personalization of treatment for patients with childhoodabuse-related posttraumatic stress disorder. Journal of Clinical Medicine, 10(19), 4522. https://doi.org/10.3390/jcm10194522
   PubMed Web of Science ®Google Scholar
• Hong, S., & Lynn, H. S. (2020). Accuracy of random-forest-based imputation of missing data in the presence of non-normality, non-linearity, and interaction. BMC Medical Research Methodology, 20(1), 199. https://doi.org/10.1186/s12874-020-01080-1
   PubMed Web of Science ®Google Scholar
• Keefe, J. R., Stirman, S. W., Cohen, Z. D., DeRubeis, R. J., Smith, B. N., & Resick, P. A. (2018). In rape trauma PTSD, patient characteristics indicate which trauma-focused treatment they are most likely to complete. Depression and Anxiety, 35(4), 330–338. https://doi.org/10.1002/da.22731
   PubMed Web of Science ®Google Scholar
• Kessler, R. C., Bossarte, R. M., Luedtke, A., Zaslavsky, A. M., & Zubizarreta, J. R. (2019). Machine learning methods for developing precision treatment rules with observational data. Behaviour Research and Therapy, 120, 103412. https://doi.org/10.1016/j.brat.2019.103412
   PubMed Web of Science ®Google Scholar
• Kessler, R. C., Loo, H. M., Wardenaar, K. J., Bossarte, R. M., Brenner, L. A., Ebert, D. D., Jonge, P., Nierenberg, A. A., Rosellini, A. J., Sampson, N. A., Schoevers, R. A., Wilcox, M. A., & Zaslavsky, A. M. (2017). Using patient self-reports to study heterogeneity of treatment effects in major depressive disorder. Epidemiology and Psychiatric Sciences, 26(1), 22–36. https://doi.org/10.1017/S2045796016000020
   PubMed Web of Science ®Google Scholar
• Kraemer, H. C., & Kupfer, D. J. (2006). Size of treatment effects and their importance to clinical research and practice. Biological Psychiatry, 59(11), 990–996. https://doi.org/10.1016/j.biopsych.2005.09.014
   PubMed Web of Science ®Google Scholar
• Kroenke, K., Spitzer, R. L., & Williams, J. B. (2001). The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine, 16(9), 606–613. https://doi.org/10.1046/j.1525-1497.2001.016009606.x
   PubMed Web of Science ®Google Scholar
• Kyriacou, D. N., & Lewis, R. J. (2016). Confounding by indication in clinical research. Jama, 316(17), 1818–1819. https://doi.org/10.1001/jama.2016.16435. https://jamanetwork.com/journals/jama/article-abstract/2576568.
   Web of Science ®Google Scholar
• Landin-Romero, R., Moreno-Alcazar, A., Pagani, M., & Amann, B. L. (2018). How does eye movement desensitization and reprocessing therapy work? A systematic review on suggested mechanisms of action. Frontiers in Psychology, 9, 1395. https://www.frontiersin.org/articles/10.3389fpsyg.2018.01395.
   PubMed Web of Science ®Google Scholar
• Lenhard, W., & Lenhard, A. (2016). Computation of effect sizes. Psychometrica. https://www.psychometrica.de/effect_size.html.
   Google Scholar
• Luedtke, A., Sadikova, E., & Kessler, R. C. (2019). Sample size requirements for multivariate models to predict between-patient differences in best treatments of major depressive disorder. Clinical Psychological Science, 7(3), 445–461. https://doi.org/10.1177/2167702618815466
   Web of Science ®Google Scholar
• Lutz, W., Deisenhofer, A.-K., Rubel, J., Bennemann, B., Giesemann, J., Poster, K., & Schwartz, B. (2022). Prospective evaluation of a clinical decision support system in psychological therapy. Journal of Consulting and Clinical Psychology, 90(1), 90–106. https://doi.org/10.1037/ccp0000642
   PubMed Web of Science ®Google Scholar
• Meehan, A. J., Lewis, S. J., Fazel, S., Fusar-Poli, P., Steyerberg, E. W., Stahl, D., & Danese, A. (2022). Clinical prediction models in psychiatry: A systematic review of two decades of progress and challenges. Molecular Psychiatry, 27(6), 2700–2708. https://doi.org/10.1038/s41380-022-01528-4
   PubMed Web of Science ®Google Scholar
• Minami, T., Serlin, R. C., Wampold, B. E., Kircher, J. C., & Brown, G. (2008). Using clinical trials to benchmark effects produced in clinical practice. Quality and Quantity, 42(4), 513–525. https://doi.org/10.1007/s11135-006-9057-z
   Web of Science ®Google Scholar
• Mitchell, M. (1998). An introduction to genetic algorithms. MIT Press.
   Google Scholar
• Moggia, D., Saxon, D., Lutz, W., Hardy, G. E., & Barkham, M. (2023). Applying precision methods to treatment selection for moderate/severe depression in person-centered experiential therapy or cognitive behavioral therapy. Psychotherapy Research, 1–16. https://doi.org/10.1080/10503307.2023.2269297
   PubMed Web of Science ®Google Scholar
• Mundt, J. C., Marks, I. M., Shear, M. K., & Greist, J. M. (2002). The work and social adjustment scale: A simple measure of impairment in functioning. British Journal of Psychiatry, 180(5), 461–464. https://doi.org/10.1192/bjp.180.5.461
   PubMed Web of Science ®Google Scholar
• Murray, H., Grey, N., Warnock-Parkes, E., Kerr, A., Wild, J., Clark, D. M., & Ehlers, A. (2022). Ten misconceptions about trauma-focused CBT for PTSD. The Cognitive Behaviour Therapist, 15, e33. https://doi.org/10.1017/S1754470X22000307
   Web of Science ®Google Scholar
• National Collaborating Centre for Mental Health. (2018). The NHS talking therapies manual. https://www.england.nhs.uk/publication/the-improving-access-to-psychological-therapies-manual/.
   Google Scholar
• National Institute for Health and Care Excellence [NICE]. (2018). Post-traumatic stress disorder (NICE guideline [NG116]). NICE. https://www.nice.org.uk/guidance/ng116.
   Google Scholar
• NHS Digital. (2022, September 29). Psychological therapies, annual report on the use of IAPT services, 2021-22. NDRS. https://digital.nhs.uk/data-and-information/publications/statistical/psychological-therapies-annual-reports-on-the-use-of-iapt-services/annual-report-2021-22.
   Google Scholar
• Nye, A., Delgadillo, J., & Barkham, M. (2023). Efficacy of personalized psychological interventions: A systematic review and meta-analysis. Journal of Consulting and Clinical Psychology, 91(7), 389–397. https://doi.org/10.1037/ccp0000820
   PubMed Web of Science ®Google Scholar
• Office for National Statistics. (n.d.). Ethnic group, national identity and religion. Retrieved May 17, 2023, from https://www.ons.gov.uk/methodology/classificationsandstandards/measuringequality/ethnicgroupnationalidentityandreligion.
   Google Scholar
• Richards, D. A., & Borglin, G. (2011). Implementation of psychological therapies for anxiety and depression in routine practice: Two year prospective cohort study. Journal of Affective Disorders, 133(1-2), 51–60. https://doi.org/10.1016/j.jad.2011.03.024
   PubMed Web of Science ®Google Scholar
• Robinson, L., Kellett, S., & Delgadillo, J. (2020). Dose-response patterns in low and high intensity cognitive behavioral therapy for common mental health problems. Depression and Anxiety, 37(3), 285–294. https://doi.org/10.1002/da.22999
   PubMed Web of Science ®Google Scholar
• Rosenbaum, P. R., & Rubin, D. B. (1983). The central role of the propensity score in observational studies for causal effects. Biometrika, 70(1), 41–55. https://doi.org/10.1093/biomet/70.1.41
   Web of Science ®Google Scholar
• Salazar de Pablo, G., Studerus, E., Vaquerizo-Serrano, J., Irving, J., Catalan, A., Oliver, D., Baldwin, H., Danese, A., Fazel, S., Steyerberg, E. W., Stahl, D., & Fusar-Poli, P. (2021). Implementing precision psychiatry: A systematic review of individualized prediction models for clinical practice. Schizophrenia Bulletin, 47(2), 284–297. https://doi.org/10.1093/schbul/sbaa120
   PubMed Web of Science ®Google Scholar
• Schwartz, B., Cohen, Z. D., Rubel, J. A., Zimmermann, D., Wittmann, W. W., & Lutz, W. (2021). Personalized treatment selection in routine care: Integrating machine learning and statistical algorithms to recommend cognitive behavioral or psychodynamic therapy. Psychotherapy Research, 31(1), 33–51. https://doi.org/10.1080/10503307.2020.1769219
   PubMed Web of Science ®Google Scholar
• Shapiro, F. (2001). Eye movement desensitization and reprocessing (EMDR): Basic principles, protocols, and procedures. Guilford Press.
   Google Scholar
• Siontis, G. C. M., Tzoulaki, I., Castaldi, P. J., & Ioannidis, J. P. A. (2015). External validation of new risk prediction models is infrequent and reveals worse prognostic discrimination. Journal of Clinical Epidemiology, 68(1), 25–34. https://doi.org/10.1016/j.jclinepi.2014.09.007
   PubMed Web of Science ®Google Scholar
• Spitzer, R. L., Kroenke, K., Williams, J. B., & Löwe, B. (2006). A brief measure for assessing generalized anxiety disorder: The GAD-7. Archives of Internal Medicine, 166(10), 1092–1097. https://doi.org/10.1001/archinte.166.10.1092
   PubMed Web of Science ®Google Scholar
• Stekhoven, D. J., & Bühlmann, P. (2012). MissForest—Non-parametric missing value imputation for mixed-type data. Bioinformatics, 28(1), 112–118. https://doi.org/10.1093/bioinformatics/btr597
   PubMed Web of Science ®Google Scholar
• Steyerberg, E. W. (2019). Clinical prediction models: A practical approach to development, validation, and updating. Springer Nature.
   Google Scholar
• Steyerberg, E. W., Bleeker, S. E., Moll, H. A., Grobbee, D. E., & Moons, K. G. M. (2003). Internal and external validation of predictive models: A simulation study of bias and precision in small samples. Journal of Clinical Epidemiology, 56(5), 441–447. https://doi.org/10.1016/S0895-4356(03)00047-7
   PubMed Web of Science ®Google Scholar
• Steyerberg, E. W., Harrell, F. E., Borsboom, G. J. J. M., Eijkemans, M. J. C., Vergouwe, Y., & Habbema, J. D. F. (2001). Internal validation of predictive models: Efficiency of some procedures for logistic regression analysis. Journal of Clinical Epidemiology, 54(8), 774–781. https://doi.org/10.1016/S0895-4356(01)00341-9
   PubMed Web of Science ®Google Scholar
• Stuart, E. A., King, G., Imai, K., & Ho, D. (2011). MatchIt: Nonparametric preprocessing for parametric causal inference. Journal of Statistical Software, 42(8), 1–28. https://doi.org/10.18637/jss.v042.i08
   Web of Science ®Google Scholar
• Stuke, H., Schoofs, N., Johanssen, H., Bermpohl, F., Ülsmann, D., Schulte-Herbrüggen, O., & Priebe, K. (2021). Predicting outcome of daycare cognitive behavioural therapy in a naturalistic sample of patients with PTSD: a machine learning approach. European Journal of Psychotraumatology, 12(1), 1958471. https://doi.org/10.1080/20008198.2021.1958471
   PubMed Web of Science ®Google Scholar
• Van Bronswijk, S. C., Bruijniks, S. J., Lorenzo-Luaces, L., Derubeis, R. J., Lemmens, L. H., Peeters, F. P., & Huibers, M. J. (2021). Cross-trial prediction in psychotherapy: External validation of the Personalized Advantage Index using machine learning in two Dutch randomized trials comparing CBT versus IPT for depression. Psychotherapy Research, 31(1), 78–91. https://doi.org/10.1080/10503307.2020.1823029
   PubMed Web of Science ®Google Scholar
• Vieira, S., Liang, X., Guiomar, R., & Mechelli, A. (2022). Can we predict who will benefit from cognitive-behavioural therapy? A systematic review and meta-analysis of machine learning studies. Clinical Psychology Review, 102193. https://doi.org/10.1016/j.cpr.2022.102193
   PubMed Web of Science ®Google Scholar
• Wampold, B. E. (2019). A smorgasbord of PTSD treatments: What does this say about integration? Journal of Psychotherapy Integration, 29(1), 65–71. https://doi.org/10.1037/int0000137
   Web of Science ®Google Scholar
• Weiss, D. S. (2007). The impact of event scale: Revised. In J. P. Wilson, & C. Tang (Eds.), Cross-Cultural assessment of psychological trauma and PTSD (pp. 219–238). Springer. https://doi.org/10.1007/978-0-387-70990-1_10
   Google Scholar
• World Health Organization [WHO]. (2019). F43.1 Post-traumatic stress disorder. In International Statistical Classification of Diseases and Related Health Problems. https://icd.who.int/browse10/2019/en#/F43.
   Google Scholar
• Zou, H., & Hastie, T. (2005). Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society Series B: Statistical Methodology, 67(2), 301–320. https://doi.org/10.1111/j.1467-9868.2005.00503.x
   Web of Science ®Google Scholar