Patients’ experiences with routine outcome monitoring and clinical feedback systems: A systematic review and synthesis of qualitative empirical literature

References

• Alves, P. C. G., Sales, C. M. D., & Ashworth, M. (2016). It is not just about the alcohol”: Service users’ views about individualised and standardised clinical assessment in a therapeutic community for alcohol dependence. Substance Abuse Treatment, Prevention, and Policy, 11), Article No. 25. doi:10.1186/s13011-016-0070-5
   PubMed Web of Science ®Google Scholar
• Beresford, P., & Branfield, F. (2006). Developing inclusive partnerships: User-defined outcomes, networking and knowledge − a case study. Health and Social Care in the Community, 14(5), 436–444. doi: 10.1111/j.1365-2524.2006.00654.x
   PubMed Web of Science ®Google Scholar
• Binder, P.-E., Holgersen, H., & Moltu, C. (2012). Staying close and reflexive: An explorative and reflexive approach to qualitative research on psychotherapy. Nordic Psychology, 64(2), 103–117.
   Web of Science ®Google Scholar
• Black, J., Lewis, T., McIntosh, P., Callaly, T., Coombs, T., Hunter, A., & Moore, L. (2009). It’s not that bad: The views of consumers and carers about routine outcome measurement in mental health. Australian Health Review, 33(1), 93–99.
   PubMed Web of Science ®Google Scholar
• Bondas, T., & Hall, E. O. (2007). Challenges in approaching metasynthesis research. Qualitative Health Research, 17(1), 113–121. doi: 10.1177/1049732306295879
   PubMed Web of Science ®Google Scholar
• Boswell, J. F., Kraus, D. R., Miller, S. D., & Lambert, M. J. (2015). Implementing routine outcome monitoring in clinical practice: Benefits, challenges, and solutions. Psychotherapy Research, 25(1), 6–19. doi: 10.1080/10503307.2013.817696
   PubMed Web of Science ®Google Scholar
• Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. doi: 10.1191/1478088706qp063oa
   Google Scholar
• Callaly, T., & Hallebone, E. L. (2001). Introducing the routine use of outcomes measurement to mental health services. Australian Health Review, 24(1), 43–50.
   PubMedGoogle Scholar
• Carlier, I. V., Meuldijk, D., Van Vliet, I. M., Van Fenema, E., Van der Wee, N. J., & Zitman, F. G. (2012). Routine outcome monitoring and feedback on physical or mental health status: Evidence and theory. Journal of Evaluation in Clinical Practice, 18(1), 104–110.
   PubMed Web of Science ®Google Scholar
• Castonguay, L. G., Barkham, M., Lutz, W., & McAleavey, A. A. (2013). Practice-oriented research: Approaches and application. In M. J. Lambert (Ed.), Bergin and Garfield’s handbook of psychotherapy and behavior change (6th ed., pp. 85–133). New York, NY: Wiley.
   Google Scholar
• Crawford, M. J., Robotham, D., Thana, L., Patterson, S., Weaver, T., Barber, R., … Rose, D. (2011). Selecting outcome measures in mental health: The views of service users. Journal of Mental Health, 20(4), 336–346. doi: 10.3109/09638237.2011.577114
   PubMed Web of Science ®Google Scholar
• Davidson, K., Perry, A., & Bell, L. (2015). Would continuous feedback of patient’s clinical outcomes to practitioners improve NHS psychological therapy services? Critical analysis and assessment of quality of existing studies. Psychology and Psychotherapy: Theory, Research and Practice, 88(1), 21–37. doi: 10.1111/papt.12032
   PubMed Web of Science ®Google Scholar
• De Saeger, H., Bartak, A., Eder, E.-E., & Kamphuis, J. H. (2016). Memorable experiences in therapeutic assessment: Inviting the patient’s perspective following a pretreatment randomized controlled trial. Journal of Personality Assessment, 98(5), 472–479. doi: 10.1080/00223891.2015.1136314
   PubMed Web of Science ®Google Scholar
• Drake, G., Csipke, E., & Wykes, T. (2013). Assessing your mood online: Acceptability and use of Moodscope. Psychological Medicine, 43(7), 1455–1464. doi: 10.1017/S0033291712002280
   PubMed Web of Science ®Google Scholar
• Duong, M. T., Lyon, A. R., Ludwig, K., Wasse, J. K., & McCauley, E. (2016). Student perceptions of the acceptability and utility of standardized and idiographic assessment in school mental health. International Journal of Mental Health Promotion, 18(1), 49–63. doi: 10.1080/14623730.2015.1079429
   Web of Science ®Google Scholar
• Edbrooke-Childs, J., Wolpert, M., & Deighton, J. (2016). Introduction to the special section on implementing feedback from outcome measures in child and adult mental health services. Administration and Policy in Mental Health and Mental Health Services Research, 43(3), 277–278. doi: 10.1007/s10488-016-0726-5
   PubMed Web of Science ®Google Scholar
• Elliott, R. (2008). Research on client experiences of therapy: Introduction to the special section. Psychotherapy Research, 18(3), 239–242.
   PubMed Web of Science ®Google Scholar
• Elliott, R., Fischer, C. T., & Rennie, D. L. (1999). Evolving guidelines for publication of qualitative research studies in psychology and related fields. British Journal of Clinical Psychology, 38, 215–229. doi: 10.1348/014466599162782
   PubMed Web of Science ®Google Scholar
• Elliott, R., & Shapiro, D. A. (1988). Brief structured recall: A more efficient method for studying significant therapy events. British Journal of Medical Psychology, 61(2), 141–153.
   PubMed Web of Science ®Google Scholar
• Goodman, J. D., McKay, J. R., & DePhilippis, D. (2013). Progress monitoring in mental health and addiction treatment: A means of improving care. Professional Psychology: Research and Practice, 44(4), 231–246.
   Web of Science ®Google Scholar
• Gordon, S., Ellis, P., Haggerty, C., Pere, L., Platz, G., & McLaren, K. (2004). Preliminary work towards the development of a self-assessed measure of consumer outcome. Auckland, New Zealand: Mental Health Research & Development Strategy.
   Google Scholar
• Graham, C., Coombs, T., Buckingham, W., Eagar, K., Trauer, T., & Callaly, T. (2001). The Victorian mental health outcomes measurement strategy: Consumer perspectives on future directions for outcome self-assessment. Report of the Consumer Consultation Project (V. Department of Human Services, Trans.). Victoria, Australia: Department of Human Services, Victoria.
   Google Scholar
• Grissom, G., & Lyons, J. S. (2006). Pragmatic case studies and evidence-based treatment: Research and clinical applications of a computerized outcomes management system. Pragmatic Case Studies in Psychotherapy, 2(3), 1–28. doi: 10.14713/pcsp.v2i3.877
   Google Scholar
• Guthrie, D., McIntosh, M., Callaly, T., Trauer, T., & Coombs, T. (2008). Consumer attitudes towards the use of routine outcome measures in a public mental health service: A consumer-driven study. International Journal of Mental Health Nursing, 17(2), 92–97. doi: 10.1111/j.1447-0349.2008.00516.x
   PubMed Web of Science ®Google Scholar
• Hall, C., Taylor, J., Moldavsky, M., Marriott, M., Pass, S., Newell, K., & Hollis, C. (2014). A qualitative process evaluation of electronic session-by-session outcome measurement in child and adolescent mental health services. BMC Psychiatry, 14), Article No. 113. doi:10.1186/1471-244X-14-113
   Web of Science ®Google Scholar
• Happell, B. (2008). Meaningful information or a bureaucratic exercise? Exploring the value of routine outcome measurement in mental health. Issues in Mental Health Nursing, 29(10), 1098–1114. doi: 10.1080/01612840802319852
   PubMedGoogle Scholar
• Hetrick, S. E., Dellosa, M. K., Simmons, M. B., & Phillips, L. (2015). Development and pilot testing of an online monitoring tool of depression symptoms and side effects for young people being treated for depression. Early Intervention in Psychiatry, 9(1), 66–69. doi: 10.1111/eip.12127
   PubMed Web of Science ®Google Scholar
• Hill, C. E. (2012). Consensual qualitative research: A practical resource for investigating social science phenomena. In Consensual qualitative research: A practical resource for investigating social science phenomena (pp. viii, 330). Washington, DC: American Psychological Association.
   Google Scholar
• Howard, K. I., Moras, K., Brill, P. L., Martinovich, Z., & Lutz, W. (1996). Evaluation of psychotherapy: Efficacy, effectiveness, and patient progress. American Psychologist, 51(10), 1059–1064.
   PubMed Web of Science ®Google Scholar
• Hoy, J. (2014). The space between: Making room for the unique voices of mental health consumers within a standardized measure of mental health recovery. Administration and Policy in Mental Health and Mental Health Services Research, 41(2), 158–176. doi: 10.1007/s10488-012-0446-4
   PubMed Web of Science ®Google Scholar
• Kagan, N. I., & Kagan, H. (1991). Interpersonal process recall. In Practical guide to using video in the behavioral sciences (pp. 221–230). Oxford: John Wiley & Sons.
   Google Scholar
• Krageloh, C. U., Czuba, K. J., Billington, D., Kersten, P., & Siegert, R. J. (2015). Using feedback from patient-reported outcome measures in mental health services: A scoping study and typology. Psychiatric Services, 66(3), 224–241. doi: 10.1176/appi.ps.201400141
   PubMed Web of Science ®Google Scholar
• Kraus, D. R., Seligman, D. A., & Jordan, J. R. (2005). Validation of a behavioral health treatment outcome and assessment tool designed for naturalistic settings: The treatment outcome package. Journal of Clinical Psychology, 61(3), 285–314. doi: 10.1002/jclp.20084
   PubMed Web of Science ®Google Scholar
• Lambert, M. J. (2013). Outcome in psychotherapy: The past and important advances. Psychotherapy, 50(1), 42–51.
   PubMed Web of Science ®Google Scholar
• Lambert, M. J. (2015). Progress feedback and the OQ-system: The past and the future. Psychotherapy, 52(4), 381–390. doi: 10.1037/pst0000027
   PubMed Web of Science ®Google Scholar
• Lambert, M. J., Hansen, N. B., & Harmon, S. C. (2010). Outcome Questionnaire system (The OQ System): Development and practical applications in healthcare settings. In M. Barkham, G. E. Hardy, & J. Mellor-Clark (Eds.), Developing and delivering practice-based evidence: A guide for the psychological therapies (pp. 141–154). Chichester: Wiley-Blackwell.
   Google Scholar
• Lambert, M. J., & Shimokawa, K. (2011). Collecting client feedback. Psychotherapy, 48(1), 72–79.
   PubMed Web of Science ®Google Scholar
• Levitt, H. M. (2015). Qualitative psychotherapy research: The journey so far and future directions. Psychotherapy, 52(1), 31–37. doi: 10.1037/a0037076
   PubMed Web of Science ®Google Scholar
• Levitt, H. M., Motulsky, S. L., Wertz, F. J., Morrow, S. L., & Ponterotto, J. G. (2016a). Recommendations for designing and reviewing qualitative research in psychology: Promoting methodological integrity. Qualitative Psychology, No Pagination Specified. doi: 10.1037/qup0000082
   PubMedGoogle Scholar
• Levitt, H. M., Pomerville, A., & Surace, F. I. (2016b). A qualitative meta-analysis examining clients’ experiences of psychotherapy: A new agenda. Psychological Bulletin, 142(8), 801–830. doi: 10.1037/bul0000057
   PubMed Web of Science ®Google Scholar
• Lutz, W., De Jong, K., & Rubel, J. (2015). Patient-focused and feedback research in psychotherapy: Where are we and where do we want to go? Psychotherapy Research, 25(6), 625–632. doi: 10.1080/10503307.2015.1079661
   PubMed Web of Science ®Google Scholar
• Malterud, K. (2001). Qualitative research: Standards, challenges, and guidelines. The Lancet, 358(9280), 483–488.
   PubMed Web of Science ®Google Scholar
• McLeod, J. (2013). Qualitative research: Methods and contributions. In M. J. Lambert (Ed.), Bergin and Garfield’s handbook of psychotherapy and behavior change (6th ed. ed., pp. 49–84). Hoboken, NJ: John Wiley & Sons.
   Google Scholar
• Miller, M., Siggins, I., Kavanagh, D., & Donald, M. (2003). Consumer self-rated outcome measures in mental health. Melbourne: Mental Health Branch, Victorian Department of Human Services.
   Google Scholar
• Moran, P., Kelesidi, K., Guglani, S., Davidson, S., & Ford, T. (2012). What do parents and carers think about routine outcome measures and their use? A focus group study of CAMHS attenders. Clinical Child Psychology and Psychiatry, 17(1), 65–79. doi: 10.1177/1359104510391859
   PubMed Web of Science ®Google Scholar
• Newnham, E. A., & Page, A. C. (2010). Bridging the gap between best evidence and best practice in mental health. Clinical Psychology Review, 30(1), 127–142. doi: 10.1016/j.cpr.2009.10.004
   PubMed Web of Science ®Google Scholar
• Omer, S., Golden, E., Priebe, S., & Bearden, C. E. (2016). Exploring the mechanisms of a patient-centred assessment with a solution focused approach (DIALOG+) in the community treatment of patients with psychosis: A process evaluation within a cluster-randomised controlled trial [ Randomized Controlled Trial. Research Support, Non-U.S. Gov’t]. PLOS ONE, 11(2), e0148415. doi: 10.1371/journal.pone.0148415
   PubMed Web of Science ®Google Scholar
• Overington, L., & Ionita, G. (2012). Progress monitoring measures: A brief guide. Canadian Psychology/Psychologie canadienne, 53(2), 82–92.
   Web of Science ®Google Scholar
• Pascual-Leone, A., Greenberg, L. S., & Pascual-Leone, J. (2014). Task analysis: New developments for programmatic research on the process of change. In Quantitative and qualitative methods in psychotherapy research (pp. 249–273). New York, NY: Routledge/Taylor & Francis Group; US.
   Google Scholar
• Perry, T., Barkham, M., & Evans, C. (2013). The CORE-OM and CORE-OM (SV) in secure settings: A template analysis of the experiences of Male patients and their staff. The Journal of Forensic Practice, 15(1), 32–43. doi: 10.1108/14636641311299068
   Google Scholar
• Roe, D., Drake, R. E., & Slade, M. (2015). Routine outcome monitoring: An international endeavour. International Review of Psychiatry, 27(4), 257–260.
   PubMed Web of Science ®Google Scholar
• Stasiak, K., Parkin, A., Seymour, F., Lambie, I., Crengle, S., Pasene-Mizziebo, E., & Merry, S. (2013). Measuring outcome in child and adolescent mental health services: Consumers’ views of measures. Clinical Child Psychology and Psychiatry, 18(4), 519–535. doi: 10.1177/1359104512460860
   PubMed Web of Science ®Google Scholar
• Stedman, T., Yellowlees, P., Drake, S., Chant, D., Clarke, R., & Chapple, B. (2000). The perceived utility of six selected measures of consumer outcomes proposed for routine use in Australian mental health services. Australian and New Zealand Journal of Psychiatry, 34(5), 842–849. doi: 10.1046/j.1440-1614.2000.00803.x
   PubMed Web of Science ®Google Scholar
• Stige, B., Malterud, K., & Midtgarden, T. (2009). Toward an agenda for evaluation of qualitative research. Qualitative Health Research, 19(10), 1504–1516. doi: 10.1177/1049732309348501
   PubMed Web of Science ®Google Scholar
• Sundet, R. (2014). Patient-focused research supported practices in an intensive family therapy unit. Journal of Family Therapy, 36(2), 195–216. doi: 10.1111/j.1467-6427.2012.00613.x
   Web of Science ®Google Scholar
• Timulak, L. (2009). Meta-analysis of qualitative studies: A tool for reviewing qualitative research findings in psychotherapy. Psychotherapy Research, 19(4–5), 591–600. doi: 10.1080/10503300802477989
   PubMed Web of Science ®Google Scholar
• Timulak, L. (2010). Significant events in psychotherapy: An update of research findings. Psychology and Psychotherapy: Theory, Research and Practice, 83(4), 421–447.
   PubMed Web of Science ®Google Scholar
• Unsworth, G., Cowie, H., & Green, A. (2012). Therapists’ and clients’ perceptions of routine outcome measurement in the NHS: A qualitative study. Counselling and Psychotherapy Research, 12(1), 71–80. doi: 10.1080/14733145.2011.565125
   Google Scholar
• Wampold, B. E. (2015). Routine outcome monitoring: Coming of age—with the usual developmental challenges. Psychotherapy, 52(4), 458–462.
   PubMed Web of Science ®Google Scholar
• Wolpert, M. (2014). Uses and abuses of patient reported outcome measures (PROMs): Potential iatrogenic impact of proms implementation and how it can be mitigated. Administration and Policy in Mental Health and Mental Health Services Research, 41(2), 141–145. doi: 10.1007/s10488-013-0509-1
   PubMed Web of Science ®Google Scholar
• Wolpert, M., Curtis-Tyler, K., & Edbrooke-Childs, J. (2016). A qualitative exploration of patient and clinician views on patient reported outcome measures in child mental health and diabetes services. Administration and Policy in Mental Health and Mental Health Services Research, 43(3), 309–315. doi: 10.1007/s10488-014-0586-9
   PubMed Web of Science ®Google Scholar