Inclusion and exclusion strategies for conducting meta-analyses

References

• Ahn, H., & Wampold, B. E. (2001). Where oh where are the specific ingredients? A meta-analysis of component studies in counseling and psychotherapy. Journal of Counseling Psychology, 48, 251–257. doi: 10.1037/0022-0167.48.3.251
   Web of Science ®Google Scholar
• American Psychological Association Publications and Communications Board. (2008). Reporting standards for research in psychology: Why do we need them? What might they be? American Psychologist, 63, 839–851. doi: 10.1037/0003-066X.63.9.839
   PubMed Web of Science ®Google Scholar
• Andrews, G., & Harvey, R. (1981). Does psychotherapy benefit neurotic patients? A reanalysis of the Smith, Glass, and Miller data. Archives of General Psychiatry, 38, 1203–1208. doi: 10.1001/archpsyc.1981.01780360019001
   PubMed Web of Science ®Google Scholar
• Baardseth, T. P., Goldberg, S. B., Pace, B. T., Wislocki, A. P., Frost, N. D., Siddiqui, J. R., … Wampold, B. E. (2013). Cognitive-behavioral therapy versus other therapies: Redux. Clinical Psychology Review, 33, 395–405. doi: 10.1016/j.cpr.2013.01.004
   PubMed Web of Science ®Google Scholar
• Baldwin, S. A., & Del Re, A. C. (2016). Open access meta-analysis for psychotherapy research. Journal of Counseling Psychology, 63, 249–260. doi: 10.1037/cou0000091
   PubMed Web of Science ®Google Scholar
• Bell, E. C., Marcus, D. K., & Goodlad, J. K. (2013). Are the parts as good as the whole? A meta-analysis of component treatment studies. Journal of Consulting and Clinical Psychology, 81, 722–736. doi: 10.1037/a0033004
   PubMed Web of Science ®Google Scholar
• Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2009). Introduction to meta-analysis. Chichester: Wiley.
   Google Scholar
• Borkovec, T. D. (1990). Control groups and comparison groups in psychotherapy outcome research. National Institute on Drug Abuse Research Monograph, 104, 50–65.
   PubMedGoogle Scholar
• Colman, D. E., Echon, R., Lemay, M. S., McDonald, J., Smith, K. R., Spencer, J., & Swift, J. K. (2016). The efficacy of self-care for graduate students in professional psychology: A meta-analysis. Training and Education in Professional Psychology, 10, 188–197. doi: 10.1037/tep0000130
   Web of Science ®Google Scholar
• Cooper, H., Hedges, L. V., & Valentine, J. C. (Eds.). (2009). The handbook of research synthesis and meta-analysis (2nd ed.). New York, NY: Russel Sage Foundation.
   Google Scholar
• Cuijpers, P., Driessen, E., Hollon, S. D., van Oppen, P., Barth, J., & Andersson, G. (2012). The efficacy of non-directive supportive therapy for adult depression: A meta-analysis. Clinical Psychology Review, 32, 280–291. doi: 10.1016/j.cpr.2012.01.003
   PubMed Web of Science ®Google Scholar
• Cuijpers, P., van Straten, A., Warmerdam, L., & Andersson, G. (2008). Psychological treatment of depression: A meta-analytic database of randomized studies. BMC Psychiatry, 8, 1139. ArtID:36. doi: 10.1186/1471-244X-8-36
   Web of Science ®Google Scholar
• Dickersin, K., Manheimer, E., Wieland, S., Robinson, K. A., Lefebvre, C., & McDonald, S. (2002). Development of the Cochrane Collaboration’s CENTRAL register of controlled clinical trials. Evaluation & the Health Professions, 2, 38–64. doi: 10.1177/016327870202500104
   Google Scholar
• Eysenck, H. J. (1978). An exercise in mega-silliness. American Psychologist, 33, 517–517. doi: 10.1037/0003-066x.33.5.517.a
   Web of Science ®Google Scholar
• Glass, G. V., & Kliegl, R. M. (1983). An apology for research integration in the study of psychotherapy. Journal of Consulting and Clinical Psychology, 51, 28–41. doi: 10.1037/0022-006x.51.1.28
   PubMed Web of Science ®Google Scholar
• Glass, G. V., & Smith, M. L. (1978). “An exercise in mega-silliness”: Reply. American Psychologist, 33, 517–519. doi: 10.1037/0003-066X.33.5.517.b
   Web of Science ®Google Scholar
• Greenberg, L. S. (2010). Emotion-focused therapy. Washington, DC: American Psychological Association.
   Google Scholar
• Hedges, L. V., & Pigott, T. D. (2001). The power of statistical tests in meta-analysis. Psychological Methods, 3, 203–217. doi: 10.1037/1082-989X.6.3.203
   Web of Science ®Google Scholar
• Honyashiki, M., Furukawa, T. A., Noma, H., Tanaka, S., Chen, P., Ichikawa, K., … Caldwell, D. M. (2014). Specificity of CBT for depression: A contribution from multiple treatments meta-analyses. Cognitive Therapy and Research, 38, 249–260. doi: 10.1007/s10608-014-9599-7
   Web of Science ®Google Scholar
• Horvath, A. O., Del Re, A. C., Flückiger, C., & Symonds, D. (2011). Alliance in individual psychotherapy. Psychotherapy, 48, 9–16. doi: 10.1037/a0022186
   PubMed Web of Science ®Google Scholar
• Jackson, D., & Turner, R. (2017). Power analysis for random-effects meta-analysis. Research Synthesis Methods, 8, 290–302. doi: 10.1002/jrsm.1240
   PubMed Web of Science ®Google Scholar
• Johnsen, T. J., & Friborg, O. (2015). The effects of cognitive behavioral therapy as anti-depressive treatment is falling: A meta-analysis. Psychological Bulletin, 141, 747–768. doi: 10.1037/bul0000015
   PubMed Web of Science ®Google Scholar
• Kirsch, I. (2005). Placebo psychotherapy: Synonym or oxymoron? Journal of Clinical Psychology, 61, 791–803. doi: 10.1002/jclp.20126
   PubMed Web of Science ®Google Scholar
• Kirsch, I., Wampold, B., & Kelley, J. M. (2016). Controlling for the placebo effect in psychotherapy: Noble quest or tilting at windmills? Psychology of Consciousness: Theory, Research, and Practice, 3, 121–131. doi: 10.1037/cns0000065
   Google Scholar
• Kivlighan, D. M., Goldberg, S. B., Abbas, M., Pace, B. T., Yulish, N. E., Thomas, J. G., … Wampold, B. E. (2015). The enduring effects of psychodynamic treatments vis-à-vis alternative treatments: A multilevel longitudinal meta-analysis. Clinical Psychology Review, 40, 1–14. doi: 10.1016/j.cpr.2015.05.003
   PubMed Web of Science ®Google Scholar
• Lambert, M. J., & Bergin, A. E. (1994). The effectiveness of psychotherapy. In A. E. Bergin & S. L. Garfield (Eds.), Handbook of psychotherapy and behavior change (4th ed., pp. 143–189). New York, NY: Wiley.
   Google Scholar
• Landman, J. T., & Dawes, R. M. (1982). Psychotherapy outcome: Smith and Glass’ conclusions stand up under scrutiny. American Psychologist, 37, 504–516. doi: 10.1037/0003-066X.37.5.504
   PubMed Web of Science ®Google Scholar
• Marcus, D. K., O’Connell, D., Norris, A. L., & Sawaqdeh, A. (2014). Is the dodo bird endangered in the 21st century? A meta-analysis of treatment comparison studies. Clinical Psychology Review, 34, 519–530. doi: 10.1016/j.cpr.2014.08.001
   PubMed Web of Science ®Google Scholar
• Mayo-Wilson, E., Dias, S., Mavranezouli, I., Kew, K., Clark, D. M., & Pilling, S. (2014). Psychological and pharmacological interventions for social anxiety disorder in adults: A systematic review and network meta-analysis. Lancet Pyschiatry, 1, 368–376. doi: 10.1016/S2215-0366(14)70329-3
   PubMed Web of Science ®Google Scholar
• Norcross, J. C, & Lambert, M. J. (Eds.). (2018). Psychotherapy relationships that work: Volume 1: Evidence-based therapist contributions (3rd ed.). New York, NY: Oxford University Press.
   Google Scholar
• Norcross, J. C., & Wampold, B. E.. (Eds.) (2018). Psychotherapy relationships that work: Volume 2: Evidence-based transdiagnostic responsiveness (3rd ed.). New York, NY: Oxford University Press.
   Google Scholar
• Orwin, R. G., & Vevea, J. L. (2009). Evaluating coding decisions. In H. Cooper, L. V. Hedges, & J. C. Valentine (Eds.), The handbook of research synthesis and meta-analysis (2nd ed., pp. 177–204). New York, NY: Russell Sage Foundation.
   Google Scholar
• Rosenthal, R. (1979). The file drawer problem and tolerance for null results. Psychological Bulletin, 86, 638–641. doi: 10.1037/0033-2909.86.3.638
   Web of Science ®Google Scholar
• Serfaty, M., Csipke, E., Haworth, D., Murad, S., & King, M. (2011). A talking control for use in evaluating the effectiveness of cognitive-behavioral therapy. Behaviour Research and Therapy, 49, 433–440. doi: 10.1016/j.brat.2011.05.005
   PubMed Web of Science ®Google Scholar
• Shear, M. K., Houck, P., Greeno, C., & Masters, S. (2001). Emotion-focused psychotherapy for patients with panic disorder. The American Journal of Psychiatry, 158, 1993–1998. doi: 10.1176/appi.ajp.158.12.1993
   PubMed Web of Science ®Google Scholar
• Siev, J., & Chambless, D. L. (2007). Specificity of treatment effects: Cognitive therapy and relaxation for generalized anxiety and panic disorders. Journal of Consulting and Clinical Psychology, 75, 513–522. doi: 10.1037/0022-006X.75.4.513
   PubMed Web of Science ®Google Scholar
• Siev, J., Huppert, J. D., & Chambless, D. L. (2009). The dodo bird, treatment technique, and disseminating empirically supported treatments. The Behavior Therapist, 32, 69–76.
   Google Scholar
• Smith, M. L., & Glass, G. V. (1977). Meta-analysis of psychotherapy outcome studies. American Psychologist, 32, 752–760. doi: 10.1037/0003-066X.32.9.752
   PubMed Web of Science ®Google Scholar
• Smits, J. A. J., & Hofmann, S. G. (2009). A meta-analytic review of the effects of psychotherapy control conditions for anxiety disorders. Psychological Medicine, 39, 229–239. doi: 10.1017/S0033291708003498
   PubMed Web of Science ®Google Scholar
• Sutton, A. J. (2009). Publication bias. In H. Cooper, L. V. Hedges, & J. C. Valentine (Eds.), The hanbook of research synthesis and meta-analysis (2nd ed., pp. 435–454). New York, NY: Russell Sage Foundation.
   Google Scholar
• Swift, J. K., & Greenberg, R. P. (2012). Premature discontinuation in adult psychotherapy: A meta-analysis. Journal of Consulting and Clinical Psychology, 80, 547–559. doi: 10.1037/a0028226
   PubMed Web of Science ®Google Scholar
• Swift, J. K., Greenberg, R. P., Tompkins, K. A., & Parkin, S. R. (2017). Treatment refusal and premature termination in psychotherapy, pharmacotherapy, and their combination: A meta-analysis of head-to-head comparisons. Psychotherapy, 54, 47–57. doi: 10.1037/pst0000104
   PubMed Web of Science ®Google Scholar
• Thoma, N. C., McKay, D., Gerber, A. J., Milrod, B. L., & Kocsis, J. H. (2012). A quality-based review of randomized controlled trials of cognitive-behavioral therapy for depression: An assessment and metaregression. The American Journal of Psychiatry, 169, 22–30. doi: 10.1176/appi.ajp.2011.11030433
   PubMed Web of Science ®Google Scholar
• Tolin, D. F. (2010). Is cognitive–behavioral therapy more effective than other therapies? A meta-analytic review. Clinical Psychology Review, 30, 710–720. doi: 10.1016/j.cpr.2010.05.003
   PubMed Web of Science ®Google Scholar
• Tolin, D. F. (2014). Beating a dead dodo bird: Looking at signal vs. noise in cognitive-behavioral therapy for anxiety disorders. Clinical Psychology: Science and Practice, 21, 351–362. doi: 10.1111/cpsp.12080
   Web of Science ®Google Scholar
• Tolin, D. F. (2015). Corrigendum to “Beating a dead dodo bird: Looking at signal vs. noise in cognitive-behavioral therapy for anxiety disorders”. Clinical Psychology: Science and Practice, 22, 315–316. doi: 10.1111/cpsp.12109
   Web of Science ®Google Scholar
• Wampold, B. E., Flückiger, C., Del Re, A. C., Yulish, N. E., Frost, N. D., Pace, B. T., … Hilsenroth, M. J. (2017). In pursuit of truth: A critical examination of meta-analyses of cognitive behavior therapy. Psychotherapy Research, 27, 14–32. doi: 10.1080/10503307.2016.1249433
   PubMed Web of Science ®Google Scholar
• Wampold, B. E., Frost, N. D., & Yulish, N. E. (2016). Placebo effects in psychotherapy: A flawed concept and a contorted history. Psychology of Consciousness: Theory, Research, and Practice, 3, 108–120. doi: 10.1037/cns0000045
   Google Scholar
• Wampold, B. E., & Imel, Z. E. (2015). The great psychotherapy debate: The research evidence for what works in psychotherapy (2nd ed.). New York, NY: Routledge.
   Google Scholar
• Wampold, B. E., Mondin, G. W., Moody, M., Stich, F., Benson, K., & Ahn, H. (1997). A meta-analysis of outcome studies comparing bona fide psychotherapies: Empirically, “All must have prizes”. Psychological Bulletin, 122, 203–215. doi: 10.1037/0033-2909.122.3.203
   Web of Science ®Google Scholar
• Wilson, D. B. (2009). Systematic coding. In H. Cooper, L. V. Hedges, & J. C. Valentine (Eds.), The handbook of research synthesis and meta-analysis (2nd ed, pp. 159–176). New York, NY: Russell Sage Foundation.
   Google Scholar
• Wu, Y. P., Aylward, B. S., Roberts, M. C., & Evans, S. C. (2012). Searching the scientific literature: Implications for quantitative and qualitative reviews. Clinical Psychology Review, 32, 553–557. doi: 10.1016/j.cpr.2012.06.007
   PubMed Web of Science ®Google Scholar