Effects and experiences of idiographic patient-reported outcome measures for feedback in psychotherapy: A systematic review and secondary analysis of the empirical literature

References

• Alves, P. C. G., Sales, C. M. D., & Ashworth, M. (2016). “It is not just about the alcohol”: Service users’ views about individualised and standardised clinical assessment in a therapeutic community for alcohol dependence. Substance Abuse Treatment, Prevention, and Policy, 11. https://doi.org/10.1186/s13011-016-0070-5
   PubMed Web of Science ®Google Scholar
• Antunes, R. P., Sales, C. M. D., & Elliott, R. (2020). The clinical utility of the Personal Questionnaire (PQ): A mixed methods study. Counselling Psychology Quarterly, 33(1), 25–45. https://doi.org/10.1080/09515070.2018.1439451
   Web of Science ®Google Scholar
• Ashworth, M., Evans, C., & Clement, S. (2009). Measuring psychological outcomes after cognitive behaviour therapy in primary care: A comparison between a new patient-generated measure “PSYCHLOPS” (Psychological Outcome Profiles) and “HADS” (Hospital Anxiety and Depression Scale). Journal of Mental Health, 18(2), 169–177. https://doi.org/10.1080/09638230701879144
   Web of Science ®Google Scholar
• Ashworth, M., Guerra, D., & Kordowicz, M. (2019). Individualised or standardised outcome measures: A co-habitation? Administration and Policy in Mental Health and Mental Health Services Research, 46(4), 425–428. https://doi.org/10.1007/s10488-019-00928-z
   PubMed Web of Science ®Google Scholar
• Ashworth, M., Robinson, S. I., Godfrey, E., Parmentier, H., Shepherd, M., Christey, J., Wright, K., & Matthews, V. (2005). The experiences of therapists using a new client-centred psychometric instrument, PSYCHLOPS (Psychological Outcome Profiles). Counselling and Psychotherapy Research, 5(1), 37–42. https://doi.org/10.1080/14733140512331343886
   Google Scholar
• Barkham, M., De Jong, K., Delgadillo, J., & Lutz, W. (2023). Routine outcome monitoring (ROM) and feedback: Research review and recommendations. Psychotherapy Research, 33(7), 841–855. https://doi.org/10.1080/10503307.2023.2181114
   PubMed Web of Science ®Google Scholar
• Bergman, H., Kornør, H., Nikolakopoulou, A., Hanssen-Bauer, K., Soares-Weiser, K., Tollefsen, T. K., & Bjørndal, A. (2018). Client feedback in psychological therapy for children and adolescents with mental health problems. Cochrane Database of Systematic Reviews, 8. https://doi.org/10.1002/14651858.CD011729.pub2
   PubMedGoogle Scholar
• Borjesson, S., & Bostrom, P. K. (2020). “I want to know what it is used for”: Clients’ perspectives on completing a routine outcome measure (ROM) while undergoing psychotherapy. Psychotherapy Research, 30(3), 337–347. https://doi.org/10.1080/10503307.2019.1630780
   PubMed Web of Science ®Google Scholar
• Boswell, J. F. (2020). Monitoring processes and outcomes in routine clinical practice: A promising approach to plugging the holes of the practice-based evidence colander. Psychotherapy Research, 30(7), 829–842. https://doi.org/10.1080/10503307.2019.1686192
   PubMed Web of Science ®Google Scholar
• Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/10.1191/1478088706qp063oa
   Google Scholar
• Brooks Holliday, S., Hepner, K. A., Farmer, C. M., Mahmud, A., Kimerling, R., Smith, B. N., & Rosen, C. (2021). Discussing measurement-based care with patients: An analysis of clinician-patient dyads. Psychotherapy Research, 31(2), 211–223. https://doi.org/10.1080/10503307.2020.1776413
   PubMed Web of Science ®Google Scholar
• Bugatti, M., & Boswell, J. F. (2022). Clinician perceptions of nomothetic and individualized patient-reported outcome measures in measurement-based care. Psychotherapy Research, 32(7), 898–909. https://doi.org/10.1080/10503307.2022.2030497
   PubMed Web of Science ®Google Scholar
• Campbell, J., Sellen, J. L., & McMurran, M. (2010). Personal aspirations and concerns inventory for offenders: Developments in the measurement of offenders’ motivation. Criminal Behaviour and Mental Health, 20(2), 144–157. https://doi.org/10.1002/cbm.761
   PubMed Web of Science ®Google Scholar
• Castonguay, L. G., Barkham, M., Lutz, W., & McAleavey, A. A. (2013). Practice-oriented research: Approaches and application. In M. J. Lambert & A. E. Bergin (Eds.), Bergin and Garfield’s handbook of psychotherapy and behavior change (6th ed., pp. 85–133). John Wiley and Sons, Incorporated.
   Google Scholar
• Cooper, M., & Xu, D. (2023). Goals form: Reliability, validity, and clinical utility of an idiographic goal-focused measure for routine outcome monitoring in psychotherapy. Journal of Clinical Psychology, 79(3), 641–666. https://doi.org/10.1002/jclp.23344
   PubMed Web of Science ®Google Scholar
• Critical Appraisal Skills Programme. (2018a). CASP Cohort study checklist. Retrieved March 8, from https://casp-uk.net/images/checklist/documents/CASP-Cohort-Study-Checklist/CASP-Cohort-Study-Checklist-2018_fillable_form.pdf
   Google Scholar
• Critical Appraisal Skills Programme. (2018b). CASP qualitative studies checklist. Retrieved March 8, from https://casp-uk.net/images/checklist/documents/CASP-Qualitative-Studies-Checklist/CASP-Qualitative-Checklist-2018_fillable_form.pdf
   Google Scholar
• de Jong, K., Conijn, J. M., Gallagher, R. A. V., Reshetnikova, A. S., Heij, M., & Lutz, M. C. (2021). Using progress feedback to improve outcomes and reduce drop-out, treatment duration, and deterioration: A multilevel meta-analysis. Clinical Psychology Review, 85, Article 102002. https://doi.org/10.1016/j.cpr.2021.102002
   PubMed Web of Science ®Google Scholar
• Di Malta, G., Cooper, M., Bond, J., Raymond-Barker, B., Oza, M., & Pauli, R. (2023). The Patient-Perceived Helpfulness of Measures Scale: Development and validation of a scale to assess the helpfulness of using measures in psychological treatment. Assessment. DOI: 10.1177/10731911231195837
   PubMedGoogle Scholar
• Di Malta, G., Oddli, H. W., & Cooper, M. (2019). From intention to action: A mixed methods study of clients’ experiences of goal-oriented practices. Journal of Clinical Psychology, 75(10), 1770–1789. https://doi.org/10.1002/jclp.22821
   PubMed Web of Science ®Google Scholar
• Duncan, B. L., & Sparks, J. A. (2020). When meta-analysis misleads: A critical case study of a meta-analysis of client feedback. Psychological Services, 17(4), 487–496. https://doi.org/10.1037/ser0000398
   PubMed Web of Science ®Google Scholar
• Duong, M. T., Lyon, A. R., Ludwig, K., Wasse, J. K., & McCauley, E. (2016). Student perceptions of the acceptability and utility of standardized and idiographic assessment in school mental health. International Journal of Mental Health Promotion, 18(1), 49–63. https://doi.org/10.1080/14623730.2015.1079429
   Web of Science ®Google Scholar
• Fornells-Ambrojo, M., Johns, L., Onwumere, J., Garety, P., Milosh, C., Iredale, C., Peters, E., Webster, A., & Jolley, S. (2017). Experiences of outcome monitoring in service users with psychosis: Findings from an Improving Access to Psychological Therapies for people with Severe Mental Illness (IAPT-SMI) demonstration site. British Journal of Clinical Psychology, 56(3), 253–272. https://doi.org/10.1111/bjc.12136
   PubMed Web of Science ®Google Scholar
• Green, D. (2016). Making the case for using personalised outcome measures to track progress in psychotherapy. European Journal of Psychotherapy & Counselling, 18(1), 39–57. https://doi.org/10.1080/13642537.2015.1130075
   Web of Science ®Google Scholar
• Hawkins, E. J., Lambert, M. J., Vermeersch, D. A., Slade, K. L., & Tuttle, K. C. (2004). The therapeutic effects of providing patient progress information to therapists and patients. Psychotherapy Research, 14(3), 308–327. https://doi.org/10.1093/ptr/kph027.
   Web of Science ®Google Scholar
• Hovland, R. T., Ytrehus, S., Mellor-Clark, J., & Moltu, C. (2020). How patients and clinicians experience the utility of a personalized clinical feedback system in routine practice. Journal of Clinical Psychology, 79(3). https://doi.org/10.1002/jclp.22992
   PubMed Web of Science ®Google Scholar
• Jacob, J., De Francesco, D., Deighton, J., Law, D., Wolpert, M., & Edbrooke-Childs, J. (2017). Goal formulation and tracking in child mental health settings: When is it more likely and is it associated with satisfaction with care? European Child & Adolescent Psychiatry, 26(7), 759–770. https://doi.org/10.1007/s00787-016-0938-y
   PubMed Web of Science ®Google Scholar
• Jacob, J., Edbrooke-Childs, J., Law, D., & Wolpert, M. (2017). Measuring what matters to patients: Using goal content to inform measure choice and development. Clinical Child Psychology and Psychiatry, 22(2), 170–186. https://doi.org/10.1177/1359104515615642
   PubMed Web of Science ®Google Scholar
• Jensen-Doss, A., Smith, A. M., Becker-Haimes, E. M., Mora Ringle, V., Walsh, L. M., Nanda, M., Walsh, S. L., Maxwell, C. A., & Lyon, A. R. (2018). Individualized progress measures are more acceptable to clinicians than standardized measures: Results of a national survey. Administration and Policy in Mental Health and Mental Health Services Research, 45(3), 392–403. https://doi.org/10.1007/s10488-017-0833-y
   PubMed Web of Science ®Google Scholar
• Kagan, N. I., & Kagan, H. (1991). Interpersonal process recall. In P.W. Dowrick (Ed.), Practical guide to using video in the behavioral sciences (pp. 221–230). John Wiley & Sons.
   Google Scholar
• Kelly, V., Holttum, S., Evans, C., & Shepherd, M. (2012). A discourse analysis of power in relation to PSYCHLOPS (Psychological Outcome Profiles) in the context of CBT for psychosis. Counselling & Psychotherapy Research, 12(4), 247–256. https://doi.org/10.1080/14733145.2012.672439
   Google Scholar
• Kendrick, T., El-Gohary, M., Stuart, B., Gilbody, S., Churchill, R., Aiken, L., Bhattacharya, A., Gimson, A., Brütt, A. L., de Jong, K., & Moore, M. (2016). Routine use of patient reported outcome measures (PROMs) for improving treatment of common mental health disorders in adults. Cochrane Database of Systematic Reviews, 7. https://doi.org/10.1002/14651858.CD011119.pub2
   PubMedGoogle Scholar
• Kiresuk, T. J., & Sherman, R. E. (1968). Goal attainment scaling: A general method for evaluating comprehensive community mental health programs. Community Mental Health Journal, 4(6), 443–453. https://doi.org/10.1007/BF01530764
   PubMed Web of Science ®Google Scholar
• Krause, K. R., Edbrooke-Childs, J., Singleton, R., & Wolpert, M. (2022). Are we comparing apples with oranges? Assessing improvement across symptoms, functioning, and goal progress for adolescent anxiety and depression. Child Psychiatry & Human Devevelopment, 53(4), 737–753. https://doi.org/10.1007/s10578-021-01149-y
   PubMed Web of Science ®Google Scholar
• Lambert, M. J., & Harmon, K. L. (2018). The merits of implementing routine outcome monitoring in clinical practice. Clinical Psychology: Science and Practice, 25(4), e12268. https://doi.org/10.1111/cpsp.12268
   Web of Science ®Google Scholar
• Lambert, M. J., Whipple, J. L., & Kleinstäuber, M. (2018). Collecting and delivering progress feedback: A meta-analysis of routine outcome monitoring. Psychotherapy, 55(4), 520–537. https://doi.org/10.1037/pst0000167
   PubMed Web of Science ®Google Scholar
• Lambert, M. J., Whipple, J. L., Smart, D. W., Vermeersch, D. A., Nielsen, S. L., & Hawkins, E. J. (2001). The effects of providing therapists with feedback on patient progress during psychotherapy: Are outcomes enhanced? Psychotherapy Research, 11(1), 49–68. https://doi.org/10.1080/713663852
   PubMed Web of Science ®Google Scholar
• Lambert, M. J., Whipple, J. L., Vermeersch, D. A., Smart, D. W., Hawkins, E. J., Nielsen, S. L., & Goates, M. (2002). Enhancing psychotherapy outcomes via providing feedback on client progress: A replication. Clinical Psychology & Psychotherapy, 9(2), 91–103. https://doi.org/10.1002/cpp.324
   Web of Science ®Google Scholar
• Låver, J., McAleavey, A., Valaker, I., Castonguay, L. G., & Moltu, C. (2023). Therapists’ and patients’ experiences of using patients’ self-reported data in ongoing psychotherapy processes—a systematic review and meta-synthesis of qualitative studies [submitted for review].
   Google Scholar
• Lloyd, C. E. M., Duncan, C., & Cooper, M. (2019). Goal measures for psychotherapy: A systematic review of self-report, idiographic instruments. Clinical Psychology: Science and Practice, 26(3), e12281. https://doi.org/10.1111/cpsp.12281
   Web of Science ®Google Scholar
• Luborsky, L., Diguer, L., Seligman, D. A., Rosenthal, R., Krause, E. D., Johnson, S., Halperin, G., Bishop, M., Berman, J. S., & Schweizer, E. (1999). The researcher's own therapy allegiances: A “wild card” in comparisons of treatment efficacy. Clinical Psychology: Science and Practice, 6(1), 95–106. https://doi.org/10.1093/clipsy.6.1.95
   Web of Science ®Google Scholar
• Miller, S. D., Hubble, M. A., Chow, D., & Seidel, J. (2015). Beyond measures and monitoring: Realizing the potential of feedback-informed treatment. Psychotherapy, 52(4), 449–457. https://doi.org/10.1037/pst0000031
   PubMed Web of Science ®Google Scholar
• Østergård, O. K., Randa, H., & Hougaard, E. (2020). The effect of using the Partners for Change Outcome Management System as feedback tool in psychotherapy—a systematic review and meta-analysis. Psychotherapy Research, 30(2), 195–212. https://doi.org/10.1080/10503307.2018.1517949
   PubMed Web of Science ®Google Scholar
• Ouzzani, M., Hammady, H., Fedorowicz, Z., & Elmagarmid, A. (2016). Rayyan—a web and mobile app for systematic reviews. Systematic Reviews, 5(1), 210. https://doi.org/10.1186/s13643-016-0384-4
   PubMedGoogle Scholar
• Richardson, W. S., Wilson, M. C., Nishikawa, J., & Hayward, R. S. (1995). The well-built clinical question: A key to evidence-based decisions. ACP Journal Club, 123(3), A12–A13. https://doi.org/10.7326/ACPJC-1995-123-3-A12
   PubMedGoogle Scholar
• Roe, D., Drake, R. E., & Slade, M. (2015). Routine outcome monitoring: An international endeavour. International Review of Psychiatry, 27(4), 257–260. https://doi.org/10.3109/09540261.2015.1070552. http://ovidsp.ovid.com/ovidweb.cgi?T = JS&CSC = Y&NEWS = N&PAGE = fulltext&D = psyc11&AN = 2015-37980-001
   PubMed Web of Science ®Google Scholar
• Sales, C., Goncalves, S., Fragoeiro, A., Noronha, S., & Elliott, R. (2007). Psychotherapists openness to routine naturalistic idiographic research? Mental Health and Learning Disabilities Research and Practice, 4(2), 145–161. https://doi.org/10.5920/mhldrp.2007.42145
   Google Scholar
• Sales, C. M. D., Ashworth, M., Ayis, S., Barkham, M., Edbrooke-Childs, J., Faísca, L., Jacob, J., Xu, D., & Cooper, M. (2023). Idiographic patient reported outcome measures (I-PROMs) for routine outcome monitoring in psychological therapies: Position paper. Journal of Clinical Psychology, 79(3), 596–621. https://doi.org/10.1002/jclp.23319
   PubMed Web of Science ®Google Scholar
• Sales, C. M. D., & Cooper, M. (2023). Special section: Idiographic tools for routine outcome monitoring in psychotherapy. Journal of Clinical Psychology, 79(3), 593–595. https://doi.org/10.1002/jclp.23489
   PubMed Web of Science ®Google Scholar
• Sales, C. M. D., Neves, I. T. D., Alves, P. G., & Ashworth, M. (2018). Capturing and missing the patient's story through outcome measures: A thematic comparison of patient-generated items in PSYCHLOPS with CORE-OM and PHQ-9. Health Expectations, 21(3), 615–619. https://doi.org/10.1111/hex.12652
   PubMed Web of Science ®Google Scholar
• Solstad, S. M., Castonguay, L. G., & Moltu, C. (2019). Patients’ experiences with routine outcome monitoring and clinical feedback systems: A systematic review and synthesis of qualitative empirical literature. Psychotherapy Research, 29(2), 157–170. https://doi.org/10.1080/10503307.2017.1326645
   PubMed Web of Science ®Google Scholar
• Solstad, S. M., Kleiven, G. S., Castonguay, L. G., & Moltu, C. (2021). Clinical dilemmas of routine outcome monitoring and clinical feedback: A qualitative study of patient experiences. Psychotherapy Research, 31(2), 200–210. https://doi.org/10.1080/10503307.2020.1788741
   PubMed Web of Science ®Google Scholar
• Tollefsen, T. K., Darrow, S. M., Lohne, V., & Berg-Nielsen, T. S. (2020). Experiences with using an idiographic assessment procedure in primary mental health care services for adolescents. International Journal of Qualitative Studies on Health and Well-Being, 15(1). https://doi.org/10.1080/17482631.2020.1763741
   PubMed Web of Science ®Google Scholar
• Tollefsen, T. K., Neumer, S.-P., & Berg-Nielsen, T. S. (2020). “What matters to you?”: A randomized controlled effectiveness trial, using systematic idiographic assessment as an intervention to increase adolescents’ perceived control of their mental health. Journal of Adolescence, 78(1), 53–61. https://doi.org/10.1016/j.adolescence.2019.11.006
   PubMedGoogle Scholar
• Trujols, J., Solà, I., Iraurgi, I., Campins, M. J., Ribalta, E., & Duran-Sindreu, S. (2020). Individualized and standardized outcome measures: Further arguments in favor of cohabitation. Administration and Policy in Mental Health and Mental Health Services Research, 47(3), 339–343. https://doi.org/10.1007/s10488-019-00981-8
   PubMed Web of Science ®Google Scholar
• Wampold, B. E. (2015). Routine outcome monitoring: Coming of age—with the usual developmental challenges. Psychotherapy, 52(4), 458–462. https://doi.org/10.1037/pst0000037
   PubMed Web of Science ®Google Scholar
• Weisz, J. R., Chorpita, B. F., Frye, A., Ng, M. Y., Lau, N., Bearman, S. K., Ugueto, A. M., Langer, D. A., & Hoagwood, K. E. (2011). Youth top problems: Using idiographic, consumer-guided assessment to identify treatment needs and to track change during psychotherapy. Journal of Consulting and Clinical Psychology, 79(3), 369–380. https://doi.org/10.1037/a0023307
   PubMed Web of Science ®Google Scholar