A meta-analysis of the effect of therapist experience on outcomes for clients with internalizing disorders

References

• *Articles included in study.
   Google Scholar
• Agresti, A. (2002). Categorical data analysis (2nd ed.). New York, NY: Wiley.
   Google Scholar
• American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Arlington, VA: American Psychiatric Publishing.
   Google Scholar
• *Andersson, G., Carlbring, P., Furmark, T., & the S.O.F.I.E Research Group. (2012). Therapist experience and knowledge acquisition in internet-delivered CBT for social anxiety disorder: A randomized controlled trial. PloS One, 7(5), 1–10.
   Web of Science ®Google Scholar
• Barnett, M. L., Lau, A. S., & Miranda, J. (2018). Lay health worker involvement in evidence-based treatment delivery: A conceptual model to address disparities in care. Annual Review of Clinical Psychology, 63(1), 1–11.
   Google Scholar
• Beck, A. T., Steer, R. A., & Brown, G. K. (1996). Beck depression inventory-II. San Antonio, TX: Psychological Corporation.
   Google Scholar
• Berman, J. S., & Norton, N. C. (1985). Does professional training make a therapist more effective? Psychological Bulletin, 98(2), 401–407.
   PubMed Web of Science ®Google Scholar
• Beutler, L. E. (1997). The psychotherapist as a neglected variable in psychotherapy: An illustration by reference to the role of therapist experience and training. Clinical Psychology: Science and Practice, 4(1), 44–52.
   Web of Science ®Google Scholar
• *Bisbey, L. B. (1995). No longer a victim: A treatment outcome study for crime victims with post-traumatic stress disorder. San Diego: UMI Proquest.
   Google Scholar
• Boden, J. M., Fergusson, D. M., & Horwood, L. J. (2007). Anxiety disorders and suicidal behaviours in adolescence and young adulthood: Findings from a longitudinal study. Psychological Medicine, 37(3), 431–440.
   PubMed Web of Science ®Google Scholar
• Borenstein, M., Hedges, L. V., Higgins, J., & Rothstein, H. R. (2009). Subgroup analyses. In M. Borenstein, L. V. Hedges, J. P. T. Higgins, & H. R. Rothstein (Eds.), Introduction to meta-analysis (pp. 149–186). West Sussex: John Wiley & Sons.
   Google Scholar
• *Bright, J. I., Baker, K. D., & Neimeyer, R. A. (1999). Professional and paraprofessional group treatments for depression: A comparison of cognitive-behavioral and mutual support interventions. Journal of Consulting and Clinical Psychology, 67(4), 491–501.
   PubMed Web of Science ®Google Scholar
• Budge, S. L., Owen, J. J., Kopta, S. M., Minami, T., Hanson, M. R., & Hirsch, G. (2013). Differences among trainees in client outcomes associated with the phase model of change. Psychotherapy, 50(2), 150–157.
   PubMed Web of Science ®Google Scholar
• Buttorff, C., Hock, R. S., Weiss, H. A., Naik, S., Araya, R., Kirkwood, B. R., … Patel, V. (2012). Economic evaluation of a task-shifting intervention for common mental disorders in India. Bulletin of the World Health Organization, 90(11), 813–821.
   PubMed Web of Science ®Google Scholar
• Calleo, J. S., Bush, A. L., Cully, J. A., Wilson, N. L., Kraus-Schuman, C., Rhoades, H. M., … Kunik, M. E. (2013). Treating late-life GAD in primary care: An effectiveness pilot study. The Journal of Nervous and Mental Disease, 201(5), 414–420.
   PubMed Web of Science ®Google Scholar
• Chibanda, D., Mesu, P., Kajawu, L., Cowan, F., Araya, R., & Abas, M. A. (2011). Problem-solving therapy for depression and common mental disorders in Zimbabwe: Piloting a task-shifting primary mental health care intervention in a population with a high prevalence of people living with HIV. BMC Public Health, 11(1), 3117.
   Web of Science ®Google Scholar
• Clark, D. M. (2012). The English improving access to psychological therapies (IAPT) program. In R. K. McHugh & D. H. Barlow (Eds.), Dissemination and implementation of evidence-based psychological interventions (pp. 61–77). New York, NY: Oxford University Press.
   Google Scholar
• Cohen, J. (1968). Weighted kappa: Nominal scale agreement with provisions for scaled disagreement or partial credit. Psychological Bulletin, 70, 213–220.
   PubMed Web of Science ®Google Scholar
• Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
   Google Scholar
• Cooper, H., Hedges, L. V., & Valentine, J. C. (2009). The handbook of research synthesis and meta-analysis. New York, NY: Russell Sage Foundation.
   Google Scholar
• Cuijpers, P., Berking, M., Andersson, G., Quigley, L., Kleiboer, A., & Dobson, K. S. (2013). A meta-analysis of cognitive-behavioural therapy for adult depression, alone and in comparison with other treatments. The Canadian Journal of Psychiatry, 58(7), 376–385.
   PubMed Web of Science ®Google Scholar
• Del Re, A. C. (2015). A practical tutorial on conducting meta-analysis in R. The Quantitative Methods for Psychology, 11(1), 37–50.
   Web of Science ®Google Scholar
• Durlak, J. A. (1979). Comparative effectiveness of paraprofessional and professional helpers. Psychological Bulletin, 86(1), 80–92.
   PubMed Web of Science ®Google Scholar
• Ehlers, A., Grey, N., Wild, J., Stott, R., Liness, S., Deale, A., … Clark, D. M. (2013). Implementation of cognitive therapy for PTSD in routine clinical care: Effectiveness and moderators of outcome in a consecutive sample. Behaviour Research and Therapy, 51(11), 742–752.
   PubMed Web of Science ®Google Scholar
• Firth, N., Barkham, M., Kellett, S., & Saxon, D. (2015). Therapist effects and moderators of effectiveness and efficiency in psychological wellbeing practitioners: A multilevel modelling analysis. Behaviour Research and Therapy, 69, 54–62.
   PubMed Web of Science ®Google Scholar
• *Franklin, M. E., Abramowitz, J. S., Furr, J. M., Kalsy, S., & Riggs, D. S. (2003). A naturalistic examination of therapist experience and outcome of exposure and ritual prevention for OCD. Psychotherapy Research, 13(2), 153–167.
   Web of Science ®Google Scholar
• *Freshour, J. S., Amspoker, A. B., Yi, M., Kunik, M. E., Wilson, N., Kraus-Schuman, C., … Stanley, M. (2016). Cognitive behavior therapy for late-life generalized anxiety disorder delivered by lay and expert providers has lasting benefits. International Journal of Geriatric Psychiatry, 31(11), 1225–1232.
   PubMed Web of Science ®Google Scholar
• Fricchione, G. L., Borba, C. P., Alem, A., Shibre, T., Carney, J. R., & Henderson, D. C. (2012). Capacity building in global mental health: Professional training. Harvard Review of Psychiatry, 20(1), 47–57.
   PubMed Web of Science ®Google Scholar
• Fulton, B. D., Scheffler, R. M., Sparkes, S. P., Auh, E. Y., Vujicic, M., & Soucat, A. (2011). Health workforce skill mix and task shifting in low income countries: A review of recent evidence. Human Resources for Health, 9(1), 1136.
   Web of Science ®Google Scholar
• Gersh, E., Hallford, D. J., Rice, S. M., Kazantzis, N., Gersh, H., Gersh, B., & McCarty, C. A. (2017). Systematic review and meta-analysis of dropout rates in individual psychotherapy for generalized anxiety disorder. Journal of Anxiety Disorders, 52, 25–33.
   PubMed Web of Science ®Google Scholar
• Goldberg, S. B., Hoyt, W. T., Nissen-Lie, H. A., Nielsen, S. L., & Wampold, B. E. (2016). Unpacking the therapist effect: Impact of treatment length differs for high-and low-performing therapists. Psychotherapy Research, 48, 1–13. doi:10.1080/10503307.2016.1216625
   Web of Science ®Google Scholar
• Goldberg, S. B., Rousmaniere, T., Miller, S. D., Whipple, J., Nielsen, S. L., Hoyt, W. T., & Wampold, B. E. (2016). Do psychotherapists improve with time and experience? A longitudinal analysis of outcomes in a clinical setting. Journal of Counseling Psychology, 63(1), 1–11.
   PubMed Web of Science ®Google Scholar
• Goodwin, G. M. (2015). The overlap between anxiety, depression, and obsessive-compulsive disorder. Dialogues in Clinical Neuroscience, 17(3), 249.
   PubMed Web of Science ®Google Scholar
• Greco, T., Zangrillo, A., Biondi-Zoccai, G., & Landoni, G. (2013). Meta-analysis: Pitfalls and hints. Heart, Lung and Vessels, 5(4), 219.
   PubMedGoogle Scholar
• Greenhouse, J. B., & Inyengar, S. (2009). Sensitivity analysis and diagnostics. In H. Cooper, L. V. Hegdes, & J. C. Valentine (Eds.), The handbook of research synthesis and meta-analysis (pp. 417–433). New York, NY: Russell Sage Foundation.
   Google Scholar
• Hahlweg, K., Fiegenbaum, W., Frank, M., Schroeder, B., & von Witzleben, I. (2001). Short-and long-term effectiveness of an empirically supported treatment for agoraphobia. Journal of Consulting and Clinical Psychology, 69(3), 375–382.
   PubMed Web of Science ®Google Scholar
• Hattie, J. A., Sharpley, C. F., & Rogers, H. F. (1984). Comparative effectiveness of professional and paraprofessional helpers. Psychological Bulletin, 95, 534–541.
   PubMed Web of Science ®Google Scholar
• Hedges, L. V., & Olkin, L. (1985). Statistical methods for meta-analysis. Orlando, FL: Academic Press.
   Google Scholar
• Higgins, J., & Green, S. (2011). Recommendations on testing for funnel plot asymmetry. BMJ, 5, 343.
   Google Scholar
• Hoeft, T. J., Fortney, J. C., Patel, V., & Unützer, J. (2018). Task-sharing approaches to improve mental health care in rural and other low-resource settings: A systematic review. The Journal of Rural Health, 34(1), 48–62.
   PubMed Web of Science ®Google Scholar
• Hooley, C., Gopalan, G., & Lucienne, T. (2017). Barriers to task-shifting evidence based treatments in child welfare settings: Qualitative findings from an implementation trial. Paper presented at the annual meeting of the Association for Behavioral and Cognitive Therapies, Sand Diego, CA.
   Google Scholar
• *Howard, R. C. (1999). Treatment of anxiety disorders: Does specialty training help? Professional Psychology: Research and Practice, 30(5), 470–473.
   Web of Science ®Google Scholar
• *Huppert, J. D., Bufka, L. F., Barlow, D. H., Gorman, J. M., Shear, M. K., & Woods, S. W. (2001). Therapists, therapist variables, and cognitive-behavioral therapy outcome in a multicenter trial for panic disorder. Journal of Consulting and Clinical Psychology, 69(5), 747–755.
   PubMed Web of Science ®Google Scholar
• Johnsen, T. J., & Friborg, O. (2015). The effects of cognitive behavioral therapy as an anti-depressive treatment is falling: A meta-analysis. Psychological Bulletin, 141(4), 747–768.
   PubMed Web of Science ®Google Scholar
• Kessler, R. C., Angermeyer, M., Anthony, J. C., De Graaf, R. O. N., Demyttenaere, K., Gasquet, I., … Kawakami, N. (2007). Lifetime prevalence and age-of-onset distributions of mental disorders in the World Health Organization’s World Mental Health Survey Initiative. World Psychiatry, 6(3), 168.
   PubMed Web of Science ®Google Scholar
• Kessler, R. C., Berglund, P. A., Demler, O., Jin, R., Merikangas, K. R., & Walters, E. E. (2005). Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the national comorbidity survey replication (NCS-R). Archives of General Psychiatry, 62(6), 593–602.
   PubMed Web of Science ®Google Scholar
• Kessler, R. C., Demler, O., Frank, R. G., Olfson, M., Pincus, H. A., Walters, E. E., … Zaslavsky, A. M. (2005). Prevalence and treatment of mental disorders, 1990 to 2003. New England Journal of Medicine, 352(24), 2515–2523.
   PubMed Web of Science ®Google Scholar
• *Konuk, E., Knipe, J., Eke, I., Yuksek, H., Yurtsever, A., & Ostep, S. (2006). The effects of eye movement desensitization and reprocessing (EMDR) therapy on posttraumatic stress disorder in survivors of the 1999 marmara, Turkey, earthquake. International Journal of Stress Management, 13(3), 291–308.
   Google Scholar
• *Kraus-Schuman, C., Wilson, N. L., Amspoker, A. B., Wagener, P. D., Calleo, J. S., Diefenbach, G., … Stanley, M. A (2015). Enabling lay providers to conduct CBT for older adults: Key steps for expanding treatment capacity. Translational Behavioral Medicine, 5(3), 247–253.
   PubMed Web of Science ®Google Scholar
• *Lewis, C. C. (2011). Understanding patterns of change: Predictors of response profiles for clients treated in a CBT training clinic (Doctor of Philosophy). University of Oregon.
   Google Scholar
• Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. Thousand Oaks, CA: Sage.
   Google Scholar
• Mason, L., Grey, N., & Veale, D. (2016). My therapist is a student? The impact of therapist experience and client severity on cognitive behavioural therapy outcomes for people with anxiety disorders. Behavioural and Cognitive Psychotherapy, 44(2), 193–202.
   PubMed Web of Science ®Google Scholar
• McHugh, M. L. (2012). Interrater reliability: The kappa statistic. Biochemia Medica, 22(3), 276–282.
   PubMed Web of Science ®Google Scholar
• McLay, R. N., Graap, K., Spira, J., Perlman, K., Johnston, S., Rothbaum, B. O., … Rizzo, A. (2012). Development and testing of virtual reality exposure therapy for post-traumatic stress disorder in active duty service members who served in Iraq and Afghanistan. Military Medicine, 177(6), 635–642.
   PubMed Web of Science ®Google Scholar
• McLean, P. D., & Hakstian, A. R. (1979). Clinical depression: Comparative efficacy of outpatient treatments. Journal of Consulting and Clinical Psychology, 47(5), 818–836.
   PubMed Web of Science ®Google Scholar
• Merikangas, K. R., He, J. P., Burstein, M., Swendsen, J., Avenevoli, S., Case, B., … Olfson, M. (2011). Service utilization for lifetime mental disorders in U.S. Adolesents: Results of the national comorbidity survey – adolescent supplement (NCS-A). Journal of the American Academy of Child & Adolscent Psychiatry, 50(1), 32–45.
   PubMed Web of Science ®Google Scholar
• Michael, K. D., Huelsman, T. J., & Crowley, S. L. (2005). Interventions for child and adolescent depression: Do professional therapists produce better results? Journal of Child and Family Studies, 14(2), 223–236.
   Google Scholar
• Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & Prisma Group. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Medicine, 6(7), e1000097.
   PubMed Web of Science ®Google Scholar
• Murray, L. K., Dorsey, S., Skavenski, S., Kasoma, M., Imasiku, M., Bolton, P., … Cohen, J. A. (2013). Identification, modification, and implementation of an evidence-based psychotherapy for children in a low-income country: The use of TF-CBT in Zambia. International Journal of Mental Health Systems, 7(1), 24.
   PubMed Web of Science ®Google Scholar
• Norton, P. J., Little, T. E., & Wetterneck, C. T. (2014). Does experience matter? Trainee experience and outcomes during transdiagnostic cognitive-behavioral group therapy for anxiety. Cognitive Behaviour Therapy, 43(3), 230–238.
   PubMed Web of Science ®Google Scholar
• *Nyman, S. J., Nafziger, M. A., & Smith, T. B. (2010). Client outcomes across counselor training level within a multitiered supervision model. Journal of Counseling & Development, 88(2), 204–209.
   Web of Science ®Google Scholar
• Ollendick, T. H., & King, N. J. (1994). Diagnosis, assessment, and treatment of internalizing problems in children: The role of longitudinal data. Journal of Consulting and Clinical Psychology, 62(5), 918–927.
   PubMed Web of Science ®Google Scholar
• Ong, C. W., Clyde, J. W., Bluett, E. J., Levin, M. E., & Twohig, M. P. (2016). Dropout rates in exposure with response prevention for obsessive-compulsive disorder: What do the data really say? Journal of Anxiety Disorders, 40, 8–17.
   PubMed Web of Science ®Google Scholar
• Owen, J., Wampold, B. E., Kopta, M., Rousmaniere, T., & Miller, S. D. (2016). As good as it gets? Therapy outcomes of trainees over time. Journal of Counseling Psychology, 63(1), 12–19.
   PubMed Web of Science ®Google Scholar
• Petersen, I., Hancock, J. H., Bhana, A., & Govender, K. (2014). A group-based counselling intervention for depression comorbid with HIV/AIDS using a task shifting approach in South Africa: A randomized controlled pilot study. Journal of Affective Disorders, 158, 78–84.
   PubMed Web of Science ®Google Scholar
• Pigott, T. D. (2012). Planning a meta-analysis in a systematic review. In T. D. Pigott (Ed.), Advances in meta-analysis (pp. 13–32). New York, NY: Springer.
   Google Scholar
• *Podell, J. L., Kendall, P. C., Gosch, E. A., Compton, S. N., March, J. S., Albano, A. M., … Piacentini, J. C. (2013). Therapist factors and outcomes in CBT for anxiety in youth. Professional Psychology: Research and Practice, 44(2), 89–98.
   PubMed Web of Science ®Google Scholar
• *Propst, A., Paris, J., & Rosberger, Z. (1994). Do therapist experience, diagnosis and functional level predict outcome in short term psychotherapy? The Canadian Journal of Psychiatry, 39(3), 168–176.
   PubMed Web of Science ®Google Scholar
• Raudenbush, S. W., Cooper, B. S., Hedges, L. V., & Valentine, J. C. (2009). Analyzing effect sizes: Random-effects models. In H. Cooper, L. V. Hedges, & J. C. Valentine (Eds.), The handbook of research synthesis and meta-analysis (pp. 295–316). New York, NY: Russell Sage Foundation.
   Google Scholar
• Regier, D. A., Kuhl, E. A., & Kupfer, D. J. (2013). The DSM-5: Classification and criteria changes. World Psychiatry, 12(2), 92–98.
   PubMed Web of Science ®Google Scholar
• Roos, J., & Werbart, A. (2013). Therapist and relationship factors influencing dropout from individual psychotherapy: A literature review. Psychotherapy Research, 23(4), 394–418.
   PubMed Web of Science ®Google Scholar
• Rosenberg, M. S. (2005). The file-drawer problem revisited: A general weighted method for calculating fail-safe numbers in meta-analysis. Evolution, 59(2), 464–468.
   PubMed Web of Science ®Google Scholar
• *Russell, R. K., & Wise, F. (1976). Treatment of speech anxiety by cue-controlled relaxation and desensitization with professional and paraprofessional counselors. Journal of Counseling Psychology, 23(6), 583–586.
   Web of Science ®Google Scholar
• Saraceno, B., van Ommeren, M., Batniji, R., Cohen, A., Gureje, O., Mahoney, J., … Underhill, C. (2007). Barriers to improvement of mental health services in low-income and middle-income countries. The Lancet, 370(9593), 1164–1174.
   PubMed Web of Science ®Google Scholar
• Scammacca, N., Roberts, G., & Stuebing, K. K. (2014). Meta-analysis with complex research designs dealing with dependence from multiple measures and multiple group comparisons. Review of Educational Research, 84(3), 328–364.
   PubMed Web of Science ®Google Scholar
• Shelton, J. L., & Madrazo-Peterson, R. (1978). Treatment outcome and maintenance in systematic desensitization: Professional versus paraprofessional effectiveness. Journal of Counseling Psychology, 25(4), 331–335.
   Web of Science ®Google Scholar
• *Stanley, M. A., Wilson, N. L., Amspoker, A. B., Kraus-Schuman, C., Wagener, P. D., Calleo, J. S., … Kunik, M. E. (2014). Lay providers can deliver effective cognitive behavior therapy for older adults with generalized anxiety disorder: A randomized trial. Depression and Anxiety, 31(5), 391–401.
   PubMed Web of Science ®Google Scholar
• Stegenga, J. (2011). Is meta-analysis the platinum standard of evidence? Studies in History and Philosophy of Science Part C: Studies in History and Philosophy of Biological and Biomedical Sciences, 42(4), 497–507.
   PubMedGoogle Scholar
• Stein, D. M., & Lambert, M. J. (1984). On the relationship between therapist experience and psychotherapy outcome. Clinical Psychology Review, 4, 127–142.
   Web of Science ®Google Scholar
• Stein, D. M., & Lambert, M. J. (1995). Graduate training in psychotherapy: Are therapy outcomes enhanced? Journal of Consulting and Clinical Psychology, 63(2), 182–196.
   PubMed Web of Science ®Google Scholar
• Sutton, A. J. (2009). Publication bias. In H. Cooper, L. V. Hedges, & J. C. Valentine (Eds.), The handbook of research synthesis and meta-analysis (pp. 435–454). New York, NY: Russell Sage Foundation.
   Google Scholar
• *Thompson, L. W., Gallagher, D., Nies, G., & Epstein, D. (1983). Evaluation of the effectiveness of professionals and nonprofessionals as instructors of “coping with depression” classes for elders. The Gerontologist, 23(4), 390–396.
   PubMed Web of Science ®Google Scholar
• van Ameringen, M., Mancini, C., & Farvolden, P. (2003). The impact of anxiety disorders on educational achievement. Journal of Anxiety Disorders, 17(5), 561–571.
   PubMed Web of Science ®Google Scholar
• *van Oppen, P., van Balkom, A. J., Smit, J. H., Schuurmans, J., van Dyck, R., & Emmelkamp, P. M. (2010). Does the therapy manual or the therapist matter most in treatment of obsessive-compulsive disorder? A randomized controlled trial of exposure with response or ritual prevention in 118 patients. Journal of Clinical Psychiatry, 71(9), 1158–1167.
   PubMed Web of Science ®Google Scholar
• Viechtbauer, W. (2010). Conducting meta-analyses in R with the metafor package. Journal of Statistical Software, 36(3), 1–48.
   Web of Science ®Google Scholar
• Wampold, B. E., Mondin, G. W., Moody, M., Stich, F., Benson, K., & Ahn, H. (1997). A meta-analysis of outcome studies comparing bona fide psychotherapies: Empiricially, “all must have prizes”. Psychological Bulletin, 122(3), 203–215.
   Web of Science ®Google Scholar
• Wei, Y., & Higgins, J. P. (2013). Estimating within-study covariances in multivariate meta-analysis with multiple outcomes. Statistics in Medicine, 32, 1191–1205.
   PubMed Web of Science ®Google Scholar
• Weisz, J. R., Kuppens, S., Ng, M. Y., Eckshtain, D., Ugueto, A. M., Vaughn-Coaxum, R., … Fordwood, S. R. (2017). What five decades of research tells us about the effects of youth psychological therapy: A multilevel meta-analysis and implications for science and practice. American Psychologist, 72(2), 79–117.
   PubMed Web of Science ®Google Scholar
• Weisz, J. R., Weiss, B., Alicke, M. D., & Klotz, M. (1987). Effectiveness of psychotherapy with children and adolescents: A meta-analysis for clinicians. Journal of Consulting and Clinical Psychology, 55(4), 542–549.
   PubMed Web of Science ®Google Scholar
• Weisz, J. R., Weiss, B., Han, S. S., Granger, D. A., & Morton, T. (1995). Effects of psychotherapy with children and adolescents revisited: A meta-analysis of treatment outcome studies. Psychological Bulletin, 117(3), 450–468.
   PubMed Web of Science ®Google Scholar
• Wu, P., Hoven, C. W., Bird, H. R., Moore, R. E., Cohen, P., Alegria, M., … Roper, M. T. (1999). Depressive and disruptive disorders and mental health service utilization in children and adolescents. Journal of the American Academy of Child & Adolescent Psychiatry, 38(9), 1081–1090.
   PubMed Web of Science ®Google Scholar