The Psychotherapy Outcome Problem: The Development of the Outcome Stability Index

References

• Aderka, I. M., Nickerson, A., Bøe, H. J., & Hofmann, S. G. (2012). Sudden gains during psychological treatments of anxiety and depression: A meta-analysis. Journal of Consulting and Clinical Psychology, 80, 93–101. doi: 10.1037/a0026455
   PubMed Web of Science ®Google Scholar
• Baldwin, S. A., Berkeljon, A., Atkins, D. C., Olsen, J. A., & Nielsen, S. L. (2009). Rates of change in naturalistic psychotherapy: Contrasting dose-effect and good-enough level models of change. Journal of Consulting and Clinical Psychology, 77, 203–211. doi: 10.1037/a0015235
   PubMed Web of Science ®Google Scholar
• Baldwin, S. A., Imel, Z. E., & Atkins, D. C. (2012). The influence of therapist variance on the dependability of therapists’ alliance scores: A brief comment on The dependability of alliance assessments: The alliance-outcome correlation is larger than you think (Crits-Christoph et al., 2011). Journal of Consulting and Clinical Psychology, 80, 947–951. doi: 10.1037/a0027935
   PubMed Web of Science ®Google Scholar
• Bell, E. C., Marcus, D. K., & Goodlad, J. K. (2013). Are the parts as good as the whole? A meta-analysis of component treatment studies. Journal of Consulting and Clinical Psychology, 81, 722–736. Advance online publication. doi: 10.1037/a0033004
   PubMed Web of Science ®Google Scholar
• Blais, M. A., Lenderking, W. R., Baer, L., deLorell, A., Peets, K., Leahy, L., & Burns, C. (1999). Development and initial validation of a brief mental health outcome measure. Journal of Personality Assessment, 73, 359–373. doi: 10.1207/S15327752JPA7303_5
   PubMed Web of Science ®Google Scholar
• Boswell, J. F., Gallagher, M. W., Gorman, J. M., Sauer-Zavala, S. E., Bullis, J., Shear, M. K., … Barlow, D. H. (2013). Patient characteristics and variability in adherence and competence in cognitive-behavioral therapy for panic disorder. Journal of Consulting and Clinical Psychology, 81, 443–454. doi: 10.1037/a0031437
   PubMed Web of Science ®Google Scholar
• Bryan, C. J., Kopta, S. M., & Lowes, B. D. (2012). The CelestHealth system. Integrating Science and Practice, 2, 7–11.
   Google Scholar
• Chapman, C. L., Burlingame, G. M., Rees, F., Gleave, R., Beecher, M., & Porter, G. S. (2012). Clinical prediction in group psychotherapy. Psychotherapy Research, 22, 673–681. doi: 10.1080/10503307.2012.702512
   PubMed Web of Science ®Google Scholar
• Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 155–159. doi: 10.1037/0033-2909.112.1.155
   PubMed Web of Science ®Google Scholar
• Crits-Christoph, P., Connolly Gibbons, M. B., Hamilton, J., Ring-Kurtz, S., & Gallop, R. (2011). The dependability of alliance assessments: The alliance–outcome correlation is larger than you might think. Journal of Consulting and Clinical Psychology, 79, 267–278. doi: 10.1037/a0023668
   PubMed Web of Science ®Google Scholar
• Cuijpers, P., Smit, F., Bohlmeijer, E., Hollon, S. D., & Andersson, G. (2010). Efficacy of cognitive–behavioural therapy and other psychological treatments for adult depression: Meta-analytic study of publication bias. The British Journal of Psychiatry, 196, 173–178. doi: 10.1192/bjp.bp.109.066001
   PubMed Web of Science ®Google Scholar
• Dennhag, I., Connolly Gibbons, M. B., Barber, J. P., Gallop, R., & Crits-Christoph, P. (2012). How many treatment sessions and patients are needed to create a stable score of adherence and competence in the treatment of cocaine dependence?. Psychotherapy Research, 22, 475–488. doi: 10.1080/10503307.2012.674790
   PubMed Web of Science ®Google Scholar
• Derogatis, L. R., & Savitz, K. L. The SCL-90-R, Brief Symptom Inventory, and matching clinical rating scales. In M. Maruish (Ed.), The use of psychological testing for treatment planning and outcomes assessment (2nd ed., pp. 679–724). Mahwah, NJ: Lawrence Erlbaum Associates.
   Google Scholar
• Eisen, S. V., Wilcox, M., Leff, H. S., Schaefer, E., & Culhane, M. A. (1999). Assessing behavioral health outcomes in outpatient programs: Reliability and validity of the BASIS-32. Journal of Behavior Health Services Research, 26, 5–17. doi: 10.1007/BF02287790
   PubMed Web of Science ®Google Scholar
• Gallagher, R. P. (2014). National survey of college counseling centers. International Association of Counseling Services, Inc.
   Google Scholar
• Greenberg, L. S., & Pinsof, W. M. (1986). The psychotherapeutic process: A research handbook. New York, NY: Guilford press.
   Google Scholar
• Hannan, C., Lambert, M. J., Harmon, C., Nielson, S. L., Smart, D. W., Shimokawa, K., & Sutton, S. W. (2005). A lab test and algorithms for identifying patients at risk for treatment failure. Journal of Clinical Psychology: In Session, 61, 155–163. doi: 10.1002/jclp.20108
   PubMed Web of Science ®Google Scholar
• Heppner, P., Wampold, B. E., Owen, J., Thompson, M., & Wang, K. (2015). Research in counseling (4th ed.). New York, NY: Cengage.
   Google Scholar
• Howard, K. L., Brill, P. L., Lueger, R. J., & O’Mahoney, M. T. (1992). Integra outpatient tracking assessment. Evanston, IL: Integra.
   Google Scholar
• Imel, Z. E., Baer, J. S., Martino, S., Ball, S. A., & Carroll, K. M. (2011). Mutual influence in therapist competence and adherence to motivational enhancement therapy. Drug and Alcohol Dependence, 115, 229–236. doi: 10.1016/j.drugalcdep.2010.11.010
   PubMed Web of Science ®Google Scholar
• Imel, Z. E., Wampold, B. E., Miller, S. D., & Fleming, R. R. (2008). Distinctions without a difference: Direct comparisons of psychotherapies for alcohol use disorders. Psychology of Addictive Behaviors, 22, 533–543. doi: 10.1037/a0013171
   PubMed Web of Science ®Google Scholar
• Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59, 12–19. doi: 10.1037/0022-006X.59.1.12
   PubMed Web of Science ®Google Scholar
• Kopta, S. M., & Lowry, J. L. (2002). Psychometric evaluation of the Behavioral Health Questionnaire-20: A brief instrument for assessing global mental health and the three phases of psychotherapy outcome. Psychotherapy Research, 12, 413–426. doi: 10.1093/ptr/12.4.413
   Web of Science ®Google Scholar
• Lambert, M. J. (2013). Outcome in psychotherapy: The past and important advances. Psychotherapy, 50, 42–51. doi: 10.1037/a0030682
   PubMed Web of Science ®Google Scholar
• Lambert, M. J., Burlingame, G. M., Umphress, V., Hansen, N. B., Vermeersch, D. A., Clouse, G. C., & Yanchar, S. C. (1996). The reliability and validity of the Outcome Questionnaire. Clinical Psychology and Psychotherapy, 3, 249–258. doi: 10.1002/(SICI)1099-0879(199612)3:4<249::AID-CPP106>3.0.CO;2-S
   Web of Science ®Google Scholar
• Lambert, M. J., Hansen, N. B., Umphress, V., Lunnen, K., Okiishi, J., & Burlingame, G., … Reisinger, C. (1996). Administration and scoring manual for the OQ 45.2. Stevenson, MD: American Professional Credentialing Services.
   Google Scholar
• Liechsenring, F., Rabung, S., & Leibing, E. (2004). The efficacy of short-term psychodynamic psychotherapy in specific psychiatric disorders: A meta-analysis. Archives of General Psychiatry, 61, 1208–1216. doi: 10.1001/archpsyc.61.12.1208
   PubMed Web of Science ®Google Scholar
• Marcus, D. K., O’Connell, D. O., Norris, A. L., & Sawaqdeh, A. (2014). Is the dodo bird endangered in the 21st century? A meta-analysis of treatment comparison studies. Clinical Psychology Review, 34, 519–530. doi: 10.1016/j.cpr.2014.08.001
   PubMed Web of Science ®Google Scholar
• Miller, S. D., Duncan, B. L., Brown, J., Sparks, J., & Claud, D. (2003). The outcome rating scale: A preliminary study of the reliability, validity, and feasibility of a brief visual analog measure. Journal of Brief Therapy, 2, 91–100.
   Google Scholar
• Minami, T., Wampold, B. E., Serlin, R. C., Hamilton, E., Brown, G. S., & Kircher, J. (2008). Benchmarking the effectiveness of psychotherapy treatment for adult depression in a managed care environment: A preliminary study. Journal of Consulting and Clinical Psychology, 76, 116–124. doi: 10.1037/0022-006X.76.1.116
   PubMed Web of Science ®Google Scholar
• Owen, J., & Hilsenroth, M. J. (2014). Treatment adherence: The importance of therapist flexibility in relation to therapy outcomes. Journal of Counseling Psychology, 61, 280–288. doi: 10.1037/a0035753
   PubMed Web of Science ®Google Scholar
• Owen, J., Adelson, J., Budge, S., Wampold, B., & Kopta, M. (2015). Latent class trajectories of change in psychotherapy. Journal of Clinical Psychology, 71, 817–827. doi: 10.1002/jclp.22191
   PubMed Web of Science ®Google Scholar
• Owen, J. J., Adelson, J., Budge, S., Kopta, S. M., & Reese, R. J. (2016). Good enough level and dose-effect models: Variation among outcomes and therapists. Psychotherapy Research, 26, 22–30. doi: 10.1080/10503307.2014.966346
   PubMed Web of Science ®Google Scholar
• Raudenbush, S. W., Bryk, A. S., Cheong, Y. F., & Congdon, R. T. (2005). HLM 6: Hierarchical linear and nonlinear modeling. Lincolnwood, IL: Scientific Software International.
   Google Scholar
• Reese, R. J., Toland, M. D., & Hopkins, N. B. (2011). Replicating and extending the good-enough level model of change: Considering session frequency. Psychotherapy Research, 21, 608–619. doi: 10.1080/10503307.2011.598580
   PubMed Web of Science ®Google Scholar
• Sharpless, B. A., & Barber, J. P. (2009). A conceptual and empirical review of the meaning, measurement, development, and teaching of intervention competence in clinical psychology. Clinical Psychology Review, 29, 47–56. doi: 10.1016/j.cpr.2008.09.008
   PubMed Web of Science ®Google Scholar
• Stultz, N., & Lutz, W. (2007). Multidimensional patterns of change in outpatient psychotherapy: The phase model revisited. Journal of Clinical Psychology, 63, 817–833. doi: 10.1002/jclp.20397
   PubMed Web of Science ®Google Scholar
• Tang, T. Z., & DeRubeis, R. J. (1999). Sudden gains and critical sessions in cognitive-behavioral therapy for depression. Journal of Consulting and Clinical Psychology, 67, 894–904. doi: 10.1037/0022-006X.67.6.894
   PubMed Web of Science ®Google Scholar
• Wampold, B. E., & Imel, Z. E. (2015). The great psychotherapy debate (2nd ed.). New York: Routledge.
   Google Scholar
• Wampold, B. E., Mondin, G. W., Moody, M., Stich, F., Benson, K., & Ahn, H. (1997). A meta-analysis of outcome studies comparing bona fide psychotherapies: Empirically, “All must have prizes”. Psychological Bulletin, 122, 203–215. doi: 10.1037/0033-2909.122.3.203
   Web of Science ®Google Scholar