Developing practice-based evidence: Benefits, challenges, and tensions

References

• Baekeland, F., & Lundwall, L. (1975). Dropping out of treatment: A critical review. Psychological Bulletin, 82, 738–783. doi:doi:10.1037/h0077132
   PubMed Web of Science ®Google Scholar
• Baldwin, S. A., Berkeljon, A., Atkins, D. C., Olsen, J. A., & Nielsen, S. L. (2009). Rates of change in naturalistic psychotherapy: Contrasting dose-effect and good-enough level models of change. Journal of Consulting and Clinical Psychology, 77, 203–211. doi:10.1037/a0015235
   PubMed Web of Science ®Google Scholar
• Baldwin, S. A., & Imel, Z. E. (2013). Therapist effects: Findings and methods. In M. J. Lambert (Ed.), Bergin & Garfield's handbook of psychotherapy and behavior change (6th ed., pp. 258–297). Hoboken, NJ: Wiley.
   Google Scholar
• Barkham, M., Connell, J., Stiles, W. B., Miles, J. N. V., Margison, J., Evans, C., & Mellor-Clark, J. (2006). Dose-effect relations and responsive regulation of treatment duration: The good enough level. Journal of Consulting and Clinical Psychology, 74, 160–167. doi:10.1037/0022-006X.74.1.160
   PubMed Web of Science ®Google Scholar
• Barkham, M., Hardy, G. E., & Mellor-Clark, J. (2010a). Developing and delivering practice-based evidence: A guide for the psychological therapies. Oxford: Wiley-Blackwell.
   Google Scholar
• Barkham, M., & Margison, F. (2007). Practice-based evidence as a complement to evidence-based practice: From dichotomy to chiasmus. In C. Freeman & M. Power (Eds.), Handbook of evidence-based psychotherapies: A guide for research and practice (pp. 443–476). Chichester: Wiley.
   Google Scholar
• Barkham, M., Margison, F., Leach, C., Lucock, M., Mellor-Clark, J., Evans, C., … & McGrath, G. (2001). Service profiling and outcomes benchmarking using the CORE-OM: Towards practice-based evidence in the psychological therapies. Journal of Consulting and Clinical Psychology, 69, 184–196. doi:10.1037/0022-006X.69.2.184
   PubMed Web of Science ®Google Scholar
• Barkham, M., & Mellor-Clark, J. (2003). Bridging evidence-based practice and practice-based evidence: Developing a rigorous and relevant knowledge for the psychological therapies. Clinical Psychology & Psychotherapy, 10, 319–327. doi:10.1002/cpp.379
   Web of Science ®Google Scholar
• Barkham, M., Mellor-Clark, J., Connell, J., Evans, R., Evans, C., & Margison, F. (2010b). The CORE measures & CORE system: Measuring, monitoring, and managing quality evaluation in the psychological therapies. In M. Barkham, G. E. Hardy, & J. Mellor-Clark (Eds.), Developing and delivering practice-based evidence: A guide for the psychological therapies (pp. 175–219). Chichester: Wiley.
   Google Scholar
• Barkham, M., Stiles, W. B., Connell, J., & Mellor-Clark, J. (2012). The meaning of treatment effectiveness in routine NHS primary care psychological therapy services. Psychology and Psychotherapy: Theory, Research and Practice, 85, 1–16. doi:10.1111/j.2044-8341.2011.02019.x
   PubMed Web of Science ®Google Scholar
• Barkham, M., Stiles, W. B., Lambert, M. J., & Mellor-Clark, J. (2010). Building a rigorous and relevant knowledge-base for the psychological therapies. In M. Barkham, G. E. Hardy, & J. Mellor-Clark (Eds.), Developing and delivering practice-based evidence: A guide for the psychological therapies (pp. 21–61). Chichester: Wiley.
   Google Scholar
• Barrett, M. S., Chua, W, Crits-Christoph, P., Gibbons, M. B., & Thompson, D. (2008). Early withdrawal from mental health treatment: Implications for psychotherapy practice. Psychotherapy Theory, Research, Practice, Training, 45, 247–267. doi:10.1037/0033-3204.45.2.247
   PubMed Web of Science ®Google Scholar
• Bickman, L. (2008). A measurement feedback system (MFS) is necessary to improve mental health outcomes. Journal of the American Association of Child and Adolescent Psychiatry, 47, 1114–1119. doi:10.1097/CHI.0b013e3181825af8
   PubMed Web of Science ®Google Scholar
• Bickman, L., Kelley, S., Breda, C., Vides de Andrade, A. R., & Riemer, M. (2011). Effects of routine feedback to clinicians on youth mental health outcomes: A randomized cluster design. Psychiatric Services, 62, 1423–1429. doi:10.1176/appi.ps.002052011
   PubMed Web of Science ®Google Scholar
• Brown, J., Dreis, S., & Nace, D. K. (1999). What really makes a difference in psychotherapy outcome? Why does managed care want to know? In M. A. Hubble, B. L. Duncan, & S. D. Miller (Eds.), The heart and soul of change. Washington DC: American Psychological Association.
   Google Scholar
• Budge, S., Baardseth, T. P., Wampold, B. E., & Fluckiger, C. (2010). Researcher allegiance and supportive therapy: Pernicious effects on results of randomized clinical trials. European Journal of Psychotherapy & Counselling, 12, 23–39. doi:10.1080/13642531003637742
   Google Scholar
• Cahill, J., Barkham, M., & Stiles, W. B. (2010). Systematic review of practice-based research on psychological therapies in routine clinic settings. British Journal of Clinical Psychology, 49, 421–454. doi:10.1348/014466509X470789
   PubMed Web of Science ®Google Scholar
• Castonguay, L. G., Barkham, M., Lutz, W., & McAleavy, A. (2013). Practice-oriented research: Approaches and applications. In. M. J. Lambert (Ed.), Bergin & Garfield's handbook of psychotherapy and behavior change (6th ed., pp. 85–133). Hoboken, NJ: Wiley.
   Google Scholar
• Chiesa, M., Wright, M., & Neeld, R. (2003). A description of an audit cycle of early dropouts from an inpatient psychotherapy unit. Psychoanalytic Psychotherapy, 17, 138–149. doi:10.1080/1474973031000105294
   Google Scholar
• Clarkin, J. F., Levy, K. N., Lenzenweger, M. F., & Kernberg, O. F. (2004). The Personality Disorder Institute/Borderline Personality Disorder Research Foundation randomized control trial for borderline personality disorder: Rationale, methods, and patient characteristics. Journal of Personality Disorders, 18, 52–72. doi:10.1521/pedi.18.1.52.32769
   PubMed Web of Science ®Google Scholar
• Crawford, M. J., Robotham, D., Thana, L., Patterson, S., Weaver, T., Barber, R., Wykes, T., & Roze, D. (2011). Selecting outcome measures in mental health: The views of service users. Journal of Mental Health, 20, 336–346. doi:10.3109/09638237.2011.577114
   PubMed Web of Science ®Google Scholar
• Crits-Christoph, P., Baranckie, K., Kurcias, J., Beck, A., Carroll, K., Perry, K., … & Zitrin, C. (1991). Meta-analysis of therapist effects in psychotherapy outcome studies. Psychotherapy Research, 1, 81–91. doi:10.1080/10503309112331335511
   Google Scholar
• Elfström, M. L., Evans, C., Lundgren, J., Johansson, B., Hakeberg, M., & Carlsson, S. G. (2013). Validation of the Swedish version of the Clinical Outcomes in Routine Evaluation Outcome Measure (CORE-OM). Clinical Psychology & Psychotherapy, 20, 447–455.
   PubMed Web of Science ®Google Scholar
• Elkin, I., Falconnier, L., Martinovitch, Z., & Mahoney, C. (2006). Therapist effects in the National Institute of Mental Health Treatment of Depression Collaborative Research program. Psychotherapy Research, 16, 144–160. doi:10.1080/10503300500268540
   Web of Science ®Google Scholar
• EuroQol Group. (1990). EuroQol - a new facility for the measurement of health-related quality of life. Health Policy, 16, 199–208. doi:10.1016/0168-8510(90)90421-9
   PubMed Web of Science ®Google Scholar
• Evans, C., Connell, J., Barkham, M., Margison, F., Mellor-Clark, J., McGrath, G., & Audin, K. (2002). Towards a standardised brief outcome measure: Psychometric properties and utility of the CORE-OM. British Journal of Psychiatry, 180, 51–60. doi:10.1192/bjp.180.1.51
   PubMed Web of Science ®Google Scholar
• Evans, C., Connell, J., Barkham, M., Marshall, C., & Mellor-Clark, J. (2003). Practice-based evidence: Benchmarking NHS primary care counselling services at national and local levels. Clinical Psychology & Psychotherapy, 10, 374–388. doi:10.1002/cpp.384
   Web of Science ®Google Scholar
• Falkenström, F., Granström, F., & Holmqvist, R. (2013a). Therapeutic alliance predicts symptomatic improvement session by session. Journal of Counseling Psychology, 60, 317–328. doi:10.1037/a0032258
   PubMed Web of Science ®Google Scholar
• Falkenström, F., Granström, F., Holmqvist, R., & Psychotherapy Research. (2013b). Working alliance predicts psychotherapy outcome even while controlling for prior symptom improvement. Psychotherapy Research. Online publication. doi:10.1080/10503307.2013.847985
   Web of Science ®Google Scholar
• Gilbody, S., Richards, D. A., & Barkham, M. (2007). Diagnosing depression in primary care using self-completed instruments: a UK validation of the PHQ-9 and CORE-OM. British Journal of General Practice, 57, 650–652.
   PubMed Web of Science ®Google Scholar
• Hatcher, R. L., & Gillaspy, J. A. (2006). Development and validation of a revised short version of the Working Alliance Inventory. Psychotherapy Research, 16, 12–25. doi:10.1080/10503300500352500
   Web of Science ®Google Scholar
• Hellerstein, D. J., & Markowitz, J. C. (2008). Developing supportive psychotherapy as evidence-based treatment. American Journal of Psychiatry, 165, 1355–1356. doi:10.1176/appi.ajp.2008.08040565
   PubMed Web of Science ®Google Scholar
• Hoffman, J. J. (1985). Client factors related to premature termination of psychotherapy. Psychotherapy: Theory, Research, Practice, Training, 22, 83–85. doi:10.1037/h0088530
   Web of Science ®Google Scholar
• Holmqvist, R., Philips, B., & Mellor-Clark, J. (2013). Client and therapist congruence about the client's problems, treatment alliance, and outcome. Manuscript.
   Google Scholar
• Holmqvist, R., Ström, T., & Foldemo, A. (2013). The effects of psychological treatment in primary care. Nordic Journal of Psychiatry, 64, 1–9.
   Google Scholar
• Howard, K. I., Kopta, S. M., Krause, M. S., & Orlinsky, D. E. (1986). The dose-effect relationship in psychotherapy. American Psychologist, 41, 159–164. doi:10.1037/0003-066X.41.2.159
   PubMed Web of Science ®Google Scholar
• Hunsley, J., & Lee, C. M. (2007). Research-informed benchmarks for psychological treatments. Efficacy studies, effectiveness studies, and beyond. Professional Psychology: Research and Practice, 38, 21–33. doi:10.1037/0735-7028.38.1.21
   Web of Science ®Google Scholar
• Kazdin, A. E. (2008). Evidence-based treatment and practice: New opportunities to bridge clinical research and practice, enhance the knowledge base, and improve patient care. American Psychologist, 63, 146–159. doi:10.1037/0003-066X.63.3.146
   PubMed Web of Science ®Google Scholar
• Kazdin, A. E., & Mazurick, J. L. (1994). Dropping out of child psychotherapy: Distinguishing early and late dropouts over the course of treatment. Journal of Consulting and Clinical Psychology, 62, 1069–1075. doi:10.1037/0022-006X.62.5.1069
   PubMed Web of Science ®Google Scholar
• Kim, D.-M., Wampold, B. E., & Bolt, D. M. (2006). Therapist effects in psychotherapy: A random-effects modeling of the National Institute of Mental Health Treatment of Depression Collaborative Research Program data. Psychotherapy Research, 16, 161–172. doi:10.1080/10503300500264911
   Web of Science ®Google Scholar
• Klein, E. B., Stone, W. N., Hicks, M. W., & Pritchard, I. L. (2003). Understanding dropouts. Journal of Mental Health Counseling, 25, 89–100.
   Google Scholar
• Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001). The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine, 16, 606–613. doi:10.1046/j.1525-1497.2001.016009606.x
   PubMed Web of Science ®Google Scholar
• Lambert, M. J. (2010). Prevention of treatment failure: The use of measuring, monitoring, and feedback in clinical practice. Washington DC: American Psychologist Association.
   Google Scholar
• Larsson, M., Andersson, G., & Holmqvist, R. (2013). Rupture-repair events in psychological treatments in primary care. Manuscript.
   Google Scholar
• Larsson, B. P. M., Kaldo, V., & Broberg, A. G. (2009). Similarities and differences between practitioners of psychotherapy in Sweden: A comparison of attitudes between psychodynamic, cognitive, cognitive-behavioral, and integrative therapists. Journal of Psychotherapy Integration, 19, 43–66.
   Google Scholar
• Larsson, M., Andersson, G., & Holmqvist, R. (2013). Rupture-repair events in psychological treatments in primary care. Manuscript.
   Google Scholar
• Leach, C., Lucock, M., Barkham, M., Stiles, W. B., Noble, R., & Iveson, S. (2006). Transforming between Beck Depression Inventory and CORE-OM scores in routine clinical practice. British Journal of Clinical Psychology, 45, 153–166. doi:10.1348/014466505X35335
   PubMed Web of Science ®Google Scholar
• Luborsky, L., McLellan, A. T., Diguer, L., Woody, G., & Seligman, D. A. (1997). The psychotherapist matters: Comparison of outcomes across twenty-two therapists and seven patient samples. Clinical Psychology: Science and Practice, 4, 53–65. doi:10.1111/j.1468-2850.1997.tb00099.x
   Google Scholar
• Lutz, W., Leach, C., Barkham, M., Lucock, M., Stiles, W. B., Evans, C., … & Iveson, S. (2005). Predicting rate and shape of change for individual clients receiving psychological therapy: Using growth curve modeling and nearest neighbor technologies. Journal of Consulting and Clinical Psychology, 73, 904–913. doi:10.1037/0022-006X.73.5.904
   PubMed Web of Science ®Google Scholar
• Mavranezouli, I., Brazier, J., Rowan, D., & Barkham, M. (2013). Estimating a preference-based index from the Clinical Outcomes in Routine Evaluation—Outcome Measure (CORE-OM): valuation of CORE-6D. Medical Decision Making, 33, 381–395. doi:10.1177/0272989X12464431
   PubMed Web of Science ®Google Scholar
• Mavranezouli, I., Brazier, J., Young, T., & Barkham, M. (2011). Using Rasch analysis to form plausible health states amenable to valuation: the development of CORE-6D and CORE-Utility from CORE-OM in order to elicit preferences for common mental health problems. Quality of Life Research, 20, 321–333. doi:10.1007/s11136-010-9768-4
   PubMed Web of Science ®Google Scholar
• McHugh, R. K., & Barlow, D. H. (2012). Dissemination and implementation of evidence-based psychological interventions. New York: Oxford University Press.
   Google Scholar
• McMuran, M., Huband, N., & Overton, E. (2010). Non-completion of personality disorder treatments: A systematic review of correlates, consequences, and interventions. Clinical Psychology Review, 30, 277–287. doi:10.1016/j.cpr.2009.12.002
   PubMed Web of Science ®Google Scholar
• Mellor-Clark, J., & Barkham, M. (2012). Using the CORE System to support service development. In C. Feltham & I. Horton (Eds.), Handbook of counselling and psychotherapy (3rd ed.). London: Sage.
   Google Scholar
• Mundt, J. C., Marks, I. M., Shear, M. K., & Greist, J. H. (2002). The Work and Social Adjustment Scale: A simple measure of impairment in functioning. British Journal of Psychiatry, 180, 461–464. doi:10.1192/bjp.180.5.461
   PubMed Web of Science ®Google Scholar
• Novalis, P. N., Rojcewicz, S. J., & Peele, R. (1993). Clinical manual of supportive psychotherapy. Washington DC: American Psychiatric Publishing.
   Google Scholar
• O'Brien, A., Fahmy, R., & Singh, S. P. (2009). Disengagement from mental health services: A literature review. Journal of Social Psychiatry and Psychiatric Epidemiology, 44, 558–568. doi:10.1007/s00127-008-0476-0
   PubMed Web of Science ®Google Scholar
• O'Donovan, A., Bain, J. D., & Dyck, M. J. (2005). Does clinical psychology education enhance the clinical competence of practitioners? Professional Psychology: Research and Practice, 36, 104–111. doi:10.1037/0735-7028.36.1.104
   Web of Science ®Google Scholar
• Philips, B. (2009). Comparing apples and oranges: How do patient characteristics and treatment goals vary between different forms of psychotherapy? Psychology and Psychotherapy, 82, 323–336. doi:10.1348/147608309X431491
   PubMed Web of Science ®Google Scholar
• Pingitore, D. P., Scheffler, R. M., Schwalm, D., Zarin, D. A., &. West, J. C. (2002). Variation in routine psychiatric workload: The role of financing source, managed care participation, and mental health workforce competition. Mental Health Services Research, 4, 141–150. doi:10.1023/A:1019759029241
   PubMedGoogle Scholar
• Pinsker, H. A. (1997). Primer of supportive therapy. Hillside, NJ: Analytic Press.
   Google Scholar
• Reis, B. F., & Brown, L. G. (2006). Preventing therapy dropout in the real world: The clinical utility of videotape preparation and client estimate of treatment duration. Professional Psychology: Research and Practice, 37, 311–316. doi:10.1037/0735-7028.37.3.311
   Web of Science ®Google Scholar
• Royal College of Psychiatrists. (2011). National Audit of Psychological Therapies for Anxiety and Depression. National Report.
   Google Scholar
• Saxon, D., & Barkham, M. (2012). Patterns of therapist variability: Therapist effects and the contribution of patient severity and risk. Journal of Consulting and Clinical Psychology, 80, 535–546. doi:10.1037/a0028898
   PubMed Web of Science ®Google Scholar
• Sinclair, M., & Holmqvist, R. (2013). Congruence in the therapists' and clients' ratings of the therapeutic alliance does not predict outcome in psychological treatment. Manuscript.
   Google Scholar
• Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006). A brief measure for assessing generalized anxiety disorder: The GAD-7. Archives of Internal Medicine, 22, 1092–1097. doi:10.1001/archinte.166.10.1092
   Web of Science ®Google Scholar
• Stiles, W. B., Barkham, M., Connell, J., & Mellor-Clark, J. (2008). Responsive regulation of treatment duration in routine practice in United Kingdom primary care settings: Replication in a larger sample. Journal of Consulting and Clinical Psychology, 76, 298–305. doi:10.1037/0022-006X.76.2.298
   PubMed Web of Science ®Google Scholar
• Stiles, W. B., Barkham, M., Mellor-Clark, J., & Connell, J. (2008). Effectiveness of cognitive-behavioural, person-centred, and psychodynamic therapies in UK primary care routine practice: Replication in a larger sample. Psychological Medicine, 38, 677–688.
   PubMed Web of Science ®Google Scholar
• Stiles, W. B., Barkham, M., Twigg, E., Mellor-Clark, J., & Cooper, M. (2006). Effectiveness of cognitive-behavioural, person-centred, and psychodynamic therapies as practiced in UK National Health Service settings. Psychological Medicine, 36, 555–566. doi:10.1017/S0033291706007136
   PubMed Web of Science ®Google Scholar
• Stiles, W. B., Leach, C., Barkham, M., Lucock, M., Iveson, S., Shapiro, D. A., Iveson, M., & Hardy, G. E. (2003). Early sudden gains in psychotherapy under routine clinic conditions: Practice-based evidence. Journal of Consulting and Clinical Psychology, 71, 14–21. doi:10.1037/0022-006X.71.1.14
   PubMed Web of Science ®Google Scholar
• Stirman, S. W., DeRubeis, R. J., Crits-Christoph, P., & Brody, P. E. (2003). Are samples in randomized controlled trials of psychotherapy representative of community outpatients? A new methodology and initial findings. Journal of Consulting and Clinical Psychology, 71, 963–972. doi:10.1037/0022-006X.71.6.963
   PubMed Web of Science ®Google Scholar
• Street, L. L., Niederehe, G., & Lebowitz, B. D. (2000). Toward greater public health relevance for psychotherapeutic intervention research: An NIMH workshop report. Clinical Psychology: Science and Practice, 7, 127–137. doi:10.1093/clipsy.7.2.127
   Web of Science ®Google Scholar
• Strupp, H. H., Horowitz, L., & Lambert, M. J. (Eds.). (1997). Measuring patient changes in mood, anxiety, and personality disorders: Toward a core battery. Washington DC: American Psychological Association
   Google Scholar
• Stulz, N., Lutz, W., Leach, C., Lucock, M., & Barkham, M. (2007). Shapes of early change in psychotherapy under routine outpatient conditions. Journal of Consulting and Clinical Psychology, 75, 864–874. doi:10.1037/0022-006X.75.6.864
   PubMed Web of Science ®Google Scholar
• Tanielian, T. L., Marcus, S. C., Suarez, A. P., & Pincus, H. A. (2001). Trends in psychiatric practice. 1988–1998: II. Caseload and treatment characteristics. Psychiatric Services, 52, 880. doi:10.1176/appi.ps.52.7.880
   PubMed Web of Science ®Google Scholar
• Tennant, R., Hiller, L., Fishwick, R., Platt, S., Joseph, S., Weich, S., … & Stewart-Brown, S. (2009). The Warwick-Edinburgh Mental Well-being Scale (WEMWBS): Development and UK validation. Health and Quality of Life Outcomes, 5, 63. doi:10.1186/1477-7525-5-63
   Web of Science ®Google Scholar
• Waller, G. (2009). Evidenced-based treatment and therapist drift. Behaviour Research and Therapy, 47, 119–127. doi:10.1016/j.brat.2008.10.018
   PubMed Web of Science ®Google Scholar
• Wampold, B. E., & Brown, G. S. (2005). Estimating variability in outcomes attributable to therapists: A naturalistic study of outcomes in managed care. Journal of Consulting and Clinical Psychology, 73, 914–923. doi:10.1037/0022-006X.73.5.914
   PubMed Web of Science ®Google Scholar
• Waskow, I. E., & Parloff, M. B. (1975). Psychotherapy change measures. Washington DC: US Government Printing Office.
   Google Scholar
• Wierzbicki, M., & Pekarik, G. (1993). A meta-analysis of psychotherapy dropout. Professional Psychology: Research and Practice, 24, 190–195. doi:10.1037/0735-7028.24.2.190
   Web of Science ®Google Scholar
• Winston, A., Rosenthal, R., & Pinsker, H. (2012). Learning supportive therapy. An illustrated guide. Arlington, VA: American Psychiatric Association.
   Google Scholar
• Young, A. S., Grusky, O., Jordan, D., & Belin, T. R. (2000). Routine outcome monitoring in a public mental health system: The impact of patients who leave care. Psychiatric Services, 51, 85–91.
   Google Scholar