Presidential address: What we have learned from a decade of research aimed at improving psychotherapy outcome in routine care

References

• Agras , W. S. , Crow , S. J. , Halami , K. A. , Mitchell , J. E. , Wilson , G. T. and Kraemer , H. C. 2000 . A multicenter comparison of cognitive-behavioral therapy and interpersonal psychotherapy for bulimia nervosa . American Journal of Psychiatry , 157 : 1302 – 1308 .
   PubMed Web of Science ®Google Scholar
• Anderson , E. M. and Lambert , M. J. 2001 . A survival analysis of clinically significant change in outpatient psychotherapy . Journal of Clinical Psychology , 57 : 875 – 888 .
   PubMed Web of Science ®Google Scholar
• Bauer , S. , Lambert , M. J. and Nielsen , S. L. 2004 . Clinical significance methods: A comparison of statistical techniques . Journal of Personality Assessment , 82 : 60 – 70 .
   PubMed Web of Science ®Google Scholar
• Beck , A. T. , Ward , C. H. , Mendelson , M. , Mock , J. and Erbaugh , J. 1961 . An inventory for measuring depression . Archives of General Psychiatry , 4 : 561 – 571 .
   PubMed Web of Science ®Google Scholar
• Beckstead , D. J. , Hatch , A. L. , Lambert , M. J. , Eggett , D. L. , Goates , M. K. and Vermeersch , D. A. 2003 . Clinical significance of the Outcome Questionnaire (OQ-45.2) . The Behavior Analyst Today , 4 : 79 – 90 .
   Google Scholar
• Berking , M. , Orth , U. and Lutz , W. 2006 . Wie effekiv sind systematische Ruckmeldungen des therapieverlaufs an den therapeuten? Eine empirishe studie in einem stationar-verhaltenstherapeutischen setting [How affective is systematic feedback of treatment progress to therapist? An empirical study in a cognitive behavioural inpatient setting] . Zeitschrift fur Klinishe Psychologie und Psychotherapie , 35 : 21 – 29 .
   Web of Science ®Google Scholar
• Clarkin , J. F. and Levy , K. N. 2004 . “ The influence of client variables on psychotherapy ” . In Bergin & Garfield's handbook of psychotherapy and behavior change , Edited by: Lambert , M. J. 194 – 226 . New York : Wiley .
   Google Scholar
• de Jong , K. , Nugter , M. A. , Polak , M. G. , Wagenborg , J. E. A. , Spinhoven , P. , & Heiser , W. J. ( in press ). The Outcome Questionnaire (OQ-45) in a Dutch population: A cross-cultural validation . Clinical Psychology and Psychotherapy .
   Web of Science ®Google Scholar
• Derogatis , L. R. 1983 . The SCL-90: Administration, scoring, and procedures for the SCL-90 , Baltimore, MD : Clinical Psychometric Research .
   Google Scholar
• Durham , C. J. , McGrath , L. D. , Burlingame , G. M. , Schaalje , G. B. , Lambert , M. J. and Davies , D. R. 2002 . The effects of repeated administrations on self report and parent report scales . Journal of Psychoeducational Assessment , 20 : 240 – 257 .
   Web of Science ®Google Scholar
• Ellsworth , J. R. , Lambert , M. J. , & Johnson , J. ( 2006 ). A comparison of the Outcome Questionnaire-45 and Outcome Questionnaire-30 in classification and prediction of treatment outcome . Clinical Psychology and Psychotherapy , 13 , xxx–xxx .
   Web of Science ®Google Scholar
• Fennel , M. J. V. and Teasdale , J. D. 1987 . Cognitive therapy for depression: Individual differences and the process of change . Cognitive Therapy and Research , 11 : 253 – 271 .
   Web of Science ®Google Scholar
• Finch , A. E. , Lambert , M. J. and Schaalje , B. G. 2001 . Psychotherapy quality control: The statistical generation of expected recovery curves for integration into an early warning system . Clinical Psychology and Psychotherapy , 8 : 231 – 242 .
   Web of Science ®Google Scholar
• Gawande , A. 2004 . The bell curve: What happens when patients find out how good their doctors really are? . The New Yorker , 12 : 82 – 91 .
   Google Scholar
• Haas , E. , Hill , R. , Lambert , M. J. and Morrell , B. 2002 . Do early responders to psychotherapy maintain treatment gains? . Journal of Clinical Psychology , 58 : 1157 – 1172 .
   PubMed Web of Science ®Google Scholar
• Hannan , C. , Lambert , M. J. , Harmon , C. , Nielsen , S. L. , Smart , D. W. , Shimokawa , K. and Sutton , S. W. 2005 . A lab test and algorithms for identifying clients at risk for treatment failure . Journal of Clinical Psychology: In Session , 61 : 155 – 163 .
   PubMed Web of Science ®Google Scholar
• Hansen , N. B. and Lambert , M. J. 2003 . An evaluation of the dose-response relationship in naturalistic treatment settings using survival analysis . Mental Health Services Research , 5 : 1 – 12 .
   PubMedGoogle Scholar
• Hansen , N. B. , Lambert , M. J. and Forman , E. V. 2002 . The psychotherapy dose-response effect and its implications for treatment delivery services . Clinical Psychology: Science and Practice , 9 : 329 – 343 .
   Web of Science ®Google Scholar
• Harmon , S. C. , Lambert , M. J. , Smart , D. W. , Hawkins , E. J. , Nielsen , S. L. , Slade , K. , & Lutz , W. ( 2006 ). Enhancing outcome for potential treatment failures: Therapist/client feedback and clinical support tools . Psychotherapy Research .
   Web of Science ®Google Scholar
• Hatfield , D. R. , & Ogles , B. M. ( 2004 ). The use of outcome measures use in clinical practice by psychologists . Research & Practice , 35 , 485 – 491 .
   Web of Science ®Google Scholar
• Hawkins , E. J. , Lambert , M. J. , Vermeersch , D. A. , Slade , K. and Tuttle , K. 2004 . The effects of providing patient progress information to therapists and patients . Psychotherapy Research , 14 : 308 – 327 .
   Web of Science ®Google Scholar
• Horowitz , L. M. , Rosenberg , S. E. , Baer , B. A. , Ureño , G. and Villaseñor , V. S. 1988 . Inventory of Interpersonal Problems: Psychometric properties and clinical applications . Journal of Consulting and Clinical Psychology , 56 : 885 – 892 .
   PubMed Web of Science ®Google Scholar
• Howard , K. I. , Kopta , S. M. , Krause , M. S. and Orlinsky , D. E. 1986 . The dose–effect relationship in psychotherapy . American Psychologist , 41 : 159 – 164 .
   PubMed Web of Science ®Google Scholar
• Ilardi , H. H. and Craighead , W. E. 1994 . The role of non-specific factors in cognitive-behavioral therapy for depression . Clinical Psychology: Science and Practice , 1 : 138 – 156 .
   Web of Science ®Google Scholar
• Jacobson , N. S. and Truax , P. 1991 . Clinical significance: A statistical approach to defining meaningful change in psychotherapy research . Journal of Consulting and Clinical Psychology , 59 : 12 – 19 .
   PubMed Web of Science ®Google Scholar
• Kadera , S. W. , Lambert , M. J. and Andrews , A. A. 1996 . A session-by-session analysis of the psychotherapy dose-effect relationship . Journal of Psychotherapy Practice and Research , 5 : 132 – 151 .
   PubMedGoogle Scholar
• Krupnick , J. L. , Sotsky , S. M. , Elkin , I. , Simmens , S. , Moyer , J. , Watkins , J. and Pilkonis , P. A. 1996 . The role of the therapeutic alliance in psychotherapy and pharmacotherapy outcome. Findings in the National Institute of Mental Health Depression Collaborative Research Program . Journal of Consulting and Clinical Psychology , 64 : 532 – 539 .
   PubMed Web of Science ®Google Scholar
• Lambert , M. J. and Anderson , E. M. 1996 . Assessment for time-limited psychotherapies . Annual Review of Psychiatry , 15 : 23 – 47 .
   Google Scholar
• Lambert , M. J. , Bergin , A. E. , & Garfield , S. L. ( 2004 ). Introduction and overview . In M. J. Lambert ( Ed .), Bergin & Garfield's handbook of psychotherapy and behavior change ( 5th ed ., pp. 3 – 15 ). New York : Wiley .
   Google Scholar
• Lambert , M. J. , Burlingame , G. M. , Umphress , V. J. , Hansen , N. B. , Vermeersch , D. , Clouse , G. and Yanchar , S. 1996 . The reliability and validity of the Outcome Questionnaire . Clinical Psychology and Psychotherapy , 3 : 106 – 116 .
   Web of Science ®Google Scholar
• Lambert , M. J. , Morton , J. J. , Hatfield , D. , Harmon , C. , Hamilton , S. Reid , R. C. 2004 . Administration and scoring manual for the Outcome Questionnaire–45 , Salt Lake City, UT : OQ Measures .
   Google Scholar
• Lambert , M. J. , & Ogles , B. M. ( 2004 ). The efficacy and effectiveness of psychotherapy . In M. J. Lambert ( Ed .), Bergin and Garfield's handbook of psychotherapy and behavior change ( 5th ed. , pp. 139 – 193 ). New York : Wiley .
   Google Scholar
• Lambert , M. J. , Whipple , J. L. , Bishop , M. J. , Vermeersch , D. A. , Gray , G. V. and Finch , A. E. 2002 . Comparison of empirically derived and rationally derived methods for identifying clients at risk for treatment failure . Clinical Psychology and Psychotherapy , 9 : 149 – 164 .
   Web of Science ®Google Scholar
• Lambert , M. J. , Whipple , J. L. , Harmon , C. , Shimokawa , K. , Slade , K. and Christofferson , C. 2004 . Clinical support tools manual , Provo, UT : Department of Psychology, Brigham Young University .
   Google Scholar
• Lambert , M. J. , Whipple , J. L. , Hawkins , E. J. , Vermeersch , D. A. , Nielsen , S. L. and Smart , D. W. 2003 . Is it time for clinicians to routinely track patient outcome? A meta-analysis . Clinical Psychology: Science and Practice , 10 : 288 – 301 .
   Web of Science ®Google Scholar
• Lambert , M. J. , Whipple , J. L. , Smart , D. W. , Vermeersch , D. A. , Nielsen , S. L. and Hawkins , E. J. 2001 . The effects of providing therapists with feedback on client progress during psychotherapy: Are outcomes enhanced? . Psychotherapy Research , 11 : 49 – 68 .
   PubMed Web of Science ®Google Scholar
• Lambert , M. J. , Whipple , J. L. , Vermeersch , D. A. , Smart , D. W. , Hawkins , E. J. , Nielsen , S. L. and Goates , M. K. 2002 . Enhancing psychotherapy outcomes via providing feedback on client progress: A replication . Clinical Psychology and Psychotherapy , 9 : 91 – 103 .
   Web of Science ®Google Scholar
• Lunnen , K. M. and Ogles , B. M. 1998 . A multiperspective, multivariable evaluation of reliable change . Journal of Consulting and Clinical Psychology , 66 : 400 – 410 .
   PubMed Web of Science ®Google Scholar
• Lutz , W. , Lambert , M. J. , Harmon , S. C. , Stulz , N. , Tschitsaz , A. , & Schürch , E. ( 2006 ). The probability of treatment success, failure and duration—What can be learned from empirical data to support decision making in clinical practice? Clinical Psychology and Psychotherapy , 13 , 223 – 232 .
   Web of Science ®Google Scholar
• Meehl , P. E. 1954 . Clinical versus statistical prediction , Minneapolis : University of Minnesota Press .
   Google Scholar
• Mueller , R. M. , Lambert , M. J. and Burlingame , G. M. 1998 . Construct validity of the Outcome Questionnaire: A confirmatory factor analysis . Journal of Personality Assessment , 70 : 248 – 262 .
   Web of Science ®Google Scholar
• Nielsen , S. L. , & Lambert , M. J. ( 2006 ). Psychotherapeutic treatment as usual at a large university counseling center: Dose effect or Goldilocks response? Manuscript submitted for publication .
   Google Scholar
• Okiishi , J. C. , Lambert , M. J. , Eggett , D. , Nielsen , S. L. , Dayton , D. D. and Vermeersch , D. A. 2006 . An analysis of therapist treatment effects: Toward providing feedback to individual therapists on their patients’ psychotherapy outcome . Journal of Clinical Psychology , 62 : 1157 – 1172 .
   PubMed Web of Science ®Google Scholar
• Okiishi , J. C. , Lambert , M. J. , Nielsen , S. L. and Ogles , B. M. 2003 . In search of supershrink: Using patient outcome to identify effective and ineffective therapists . Clinical Psychology and Psychotherapy , 10 : 361 – 373 .
   Web of Science ®Google Scholar
• Orlinsky , D. E. , Grawe , K. , & Parks , B. K. ( 1994 ). Process and outcome in psychotherapy—Noch einmal . In S. L. Garfield & A. E. Bergin ( Eds .), Handbook of psychotherapy & behavior change ( 4th ed. , pp. 270 – 376 ). New York : Wiley
   Google Scholar
• Otto , M. W. , Pollack , M. H. and Maki , K. M. 2000 . Empirically supported treatments for panic disorder: Costs, benefits, and stepped care . Journal of Consulting and Clinical Psychology , 68 : 556 – 563 .
   PubMed Web of Science ®Google Scholar
• Percevic , R. , Lambert , M. J. and Kordy , H. 2006 . What is the predictive value of responses to psychotherapy for its future course? Empirical explorations and consequences for outcome monitoring . Psychotherapy Research , 16 : 364 – 373 .
   Web of Science ®Google Scholar
• Renaud , J. , Brent , D. A. , Baugher , M. , Birmaher , B. , Kolko , D. J. and Bridge , J. 1998 . Rapid response to psychosocial treatment for adolescent depression: A two-year follow-up . Journal of the American Academy of Child and Adolescent Psychiatry , 37 : 1184 – 1191 .
   PubMed Web of Science ®Google Scholar
• Shapiro , D. A. , Barkham , M. , Stiles , W. B. , Hardy , G. E. , Rees , A. , Reynolds , S. and Stantup , M. 2003 . Time is of the essence: A selective review of the fall and rise of brief therapy research . Psychology & Psychotherapy: Theory, Research & Practice , 76 : 211 – 235 .
   PubMed Web of Science ®Google Scholar
• Snell , M. N. , Mallinckrodt , B. , Hill , R. D. and Lambert , M. J. 2001 . Predicting counseling center clients’ response to counseling: A 1-year follow-up . Journal of Counseling Psychology , 48 : 463 – 473 .
   Web of Science ®Google Scholar
• Spielmans , G. I. , Masters , K. S. and Lambert , M. J. 2006 . A comparison of rational versus empirical methods in prediction of negative psychotherapy outcome . Clinical Psychology and Psychotherapy , 13 : 202 – 214 .
   Web of Science ®Google Scholar
• Stone , G. L. and McMichael , J. 1996 . Thinking about mental health policy in university and college counseling centers . Journal of College Student Psychotherapy , 10 : 3 – 27 .
   Google Scholar
• Streiner , D. L. 2003 . Diagnostic testing: Using and misusing diagnostic and screening tests . Journal of Personality Assessment , 81 : 209 – 219 .
   PubMed Web of Science ®Google Scholar
• Tang , T. Z. and DeRubeis , R. J. 1999 . Sudden gains and critical sessions in cognitive–behavioral psychotherapy for depression . Journal of Consulting and Clinical Psychology , 67 : 894 – 904 .
   PubMed Web of Science ®Google Scholar
• Taylor , S. and McLean , P. 1993 . Outcome profiles in the treatment of unipolar depression . Behavioral Research Therapy , 31 : 325 – 330 .
   PubMed Web of Science ®Google Scholar
• Umphress , V. J. , Lambert , M. J. , Smart , D. W. , Barlow , S. H. and Clouse , G. 1997 . Concurrent and construct validity of the Outcome Questionnaire . Journal of Psychoeducational Assessment , 15 : 40 – 55 .
   Web of Science ®Google Scholar
• Vermeersch , D. A. , Lambert , M. J. and Burlingame , G. M. 2002 . Outcome Questionnaire: Item sensitivity to change . Journal of Personality Assessment , 74 : 242 – 261 .
   Web of Science ®Google Scholar
• Vermeersch , D. A. , Whipple , J. L. , Lambert , M. J. , Hawkins , E. J. , Burchfield , C. M. and Okiishi , J. C. 2004 . Outcome Questionnaire: Is it sensitive to changes in counseling center clients? . Journal of Counseling Psychology , 51 : 38 – 49 .
   Web of Science ®Google Scholar
• Weissman , M. M. and Bothwell , S. 1976 . Assessment of social adjustment by patient self-report . Archives of General Psychology , 33 : 1111 – 1115 .
   PubMed Web of Science ®Google Scholar
• Whipple , J. L. , Lambert , M. J. , Vermeersch , D. A. , Smart , D. W. , Nielsen , S. L. and Hawkins , E. J. 2003 . Improving the effects of psychotherapy: The use of early identification of treatment failure and problem solving strategies in routine practice . Journal of Counseling Psychology , 58 : 59 – 68 .
   Web of Science ®Google Scholar
• Wolgast , B. M. , Lambert , M. J. and Puschner , B. 2003 . The dose-response relationship in a college counseling center: Implications for setting session limits . Journal of College Student Psychotherapy , 8 : 15 – 29 .
   Google Scholar
• Yalom , I. D. and Lieberman , M. A. 1971 . A study of encounter group casualties . Archives of General Psychiatry , 25 : 16 – 30 .
   PubMed Web of Science ®Google Scholar