Clinicians’ prediction and recall of therapeutic interventions: practice research network study

References

• Ægisdóttir, S., White, M. J., Spengler, P. M., Maugherman, A. S., Anderson, L. A., Cook, R., … Rush, J. D. (2006). The meta-analysis of clinical judgment project: Fifty-six years of accumulated research on clinical versus statistical prediction. The Counseling Psychologist, 34, 341–382.
   Web of Science ®Google Scholar
• Barkham, M., Stiles, W. B., Lambert, M. J., & Mellor-Clark, J. (2010). Building a rigorous and relevant knowledge base for psychological therapies. In M. Barkham, G. E. Hardy, & J. Mellor-Clark (Eds.), Developing and delivering practice-based evidence (pp. 21–61). Chichester: Wiley.10.1002/9780470687994
   Google Scholar
• Borkovec, T. D., Echemendia, R. J., Ragusea, S. A., & Ruiz, M. (2001). The Pennsylvania practice research network and future possibilities for clinically meaningful and scientifically rigorous psychotherapy research. Clinical Psychology: Science and Practice, 8, 155–168.
   Web of Science ®Google Scholar
• Boswell, J. F., Castonguay, L. G., & Wasserman, R. H. (2010). Effects of psychotherapy training and intervention use on session outcome. Journal of Consulting and Clinical Psychology, 78, 717–723.10.1037/a0020088
   PubMed Web of Science ®Google Scholar
• Brown, J., Scholle, S. H., & Azur, M. (2014). Strategies for measuring the quality of psychotherapy: A white paper to inform measure development and implementation. Report submitted to the Assistant Secretary for Planning and Evaluation, U.S. Department of Health and Human Services. Contract number HHSP23320095642WC and task order number HHSP 23320100019WI. Washington, DC: Mathematica Policy Research. Retrieved from http://aspe.hhs.gov/daltcp/reports/2014/QualPsy.cfm
   Google Scholar
• Castonguay, L. G. (2011). Psychotherapy, psychopathology, research and practice: Pathways of connections and integration. Psychotherapy Research, 21, 125–140.10.1080/10503307.2011.563250
   PubMed Web of Science ®Google Scholar
• Castonguay, L. G., Boswell, J. F., Zack, S., Baker, S., Boutselis, M., Chiswick, N., … Grosse Holtforth, M. (2010). Helpful and hindering events in psychotherapy: A practice research network study. Psychotherapy: Theory, Research, Practice, and Training, 47, 327–344.10.1037/a0021164
   PubMed Web of Science ®Google Scholar
• Castonguay, L., Nelson, D., Boutselis, M., Chiswick, N., Damer, D., Hemmelstein, N., … Borkovec, T. (2010). Psychotherapists, researchers, or both? A qualitative analysis of psychotherapists’ experiences in a practice research network. Psychotherapy: Theory, Research, Practice, and Training, 47, 345–354.10.1037/a0021165
   PubMed Web of Science ®Google Scholar
• Castonguay, L. G., Barkham, M., Lutz, W., & McAleavey, A. A. (2013). Practice-oriented research: Approaches and application. In M. J. Lambert (Ed.), Bergin and Garfield’s handbook of psychotherapy and behavior change (6th ed., pp. 85–133). New York, NY: Wiley.
   Google Scholar
• Chow, D. L., Miller, S. D., Seidel, J. A., Kane, R. T., Thornton, J. A., & Andrews, W. P. (2015). The role of deliberate practice in the development of highly effective psychotherapists. Psychotherapy, 52, 337–345. doi:10.1037/pst0000015
   PubMed Web of Science ®Google Scholar
• Dawes, R. M. (1994). House of cards: Psychology and psychotherapy built on myth. New York, NY: Free Press.
   Google Scholar
• Elliott, R., & Morrow-Bradley, C. (1994). Developing a working marriage between psychotherapists and psychotherapy researchers: Identifying shared purposes. In P. F. Talley, H. H. Strupp, & S. F. Butler (Eds.), Psychotherapy research and practice: Bridging the gap (pp. 124–142). New York, NY: Basic Books.
   Google Scholar
• England, M. J., Butler, A. S., & Gonzalez, M. L. (Eds.). (2015). Psychosocial interventions for mental and substance abuse disorders: A framework for establishing evidence-based standards. Washington, DC: National Academies Press.
   Google Scholar
• Garb, H. N. (1998). Case formulation. Washington, DC: American Psychological Association.
   Google Scholar
• Garb, H. N. (2005). Clinical judgment and decision making. Annual Review of Clinical Psychology, 1, 67–89.10.1146/annurev.clinpsy.1.102803.143810
   PubMed Web of Science ®Google Scholar
• Garb, H. N., & Boyle, P. A. (2015). Understanding why some clinicians use pseudoscientific methods: Findings from research on clinical judgment. In S. D. Lilienfeld, S. J. Lynn, & J. M. Lohr (Eds.), Science and pseudoscience in clinical psychology (2nd ed., pp. 19–41). New York, NY: Guilford Press.
   Google Scholar
• Garland, A. F., & Schoenwald, S. K. (2013). Use of Effective and Efficient Quality Control Methods to Implement Psychosocial Interventions. Clinical Psychology Science and Practice, 20, 33–43.10.1111/cpsp.2013.20.issue-1
   Web of Science ®Google Scholar
• Grove, W. M. & Meehl, P. E. (1996). Comparative efficiency of informal (subjective, impressionistic) and formal (mechanical, algorithmic) prediction procedures: The clinical–statistical controversy. Psychology, Public Policy, and Law, 2, 293–323.
   Web of Science ®Google Scholar
• Grove, W. M., Zald, D. H., Lebow, B. S., Snitz, B. E., & Nelson, C. (2000). Clinical versus mechanical prediction: A meta-analysis. Psychological Assessment, 12, 19–30.10.1037/1040-3590.12.1.19
   PubMed Web of Science ®Google Scholar
• Hannan, C., Lambert, M. J., Harmon, C., Nielsen, S. L., Smart, D. W., Shimokawa, K., & Sutton, S. W. (2005). A lab test and algorithms for identifying clients at risk for treatment failure. Journal of clinical psychology, 61, 155–163.
   PubMed Web of Science ®Google Scholar
• Hatfield, D., McCullough, L., Frantz, S. H., & Krieger, K. (2010). Do we know when our clients get worse? An investigation of therapists’ ability to detect negative client change. Clinical Psychology & Psychotherapy, 17, 25–32.
   PubMed Web of Science ®Google Scholar
• Kazdin, A. E. (2008). Evidence-based treatment and practice: New opportunities to bridge clinical research and practice, enhance the knowledge base, and improve patient care. American Psychologist, 63, 146–159.10.1037/0003-066X.63.3.146
   PubMed Web of Science ®Google Scholar
• Kenward, M. G., & Roger, J. H. (1997). Small sample inference for fixed effects from restricted maximum likelihood. Biometrics, 983–997.10.2307/2533558
   PubMed Web of Science ®Google Scholar
• Koerner, K., & Castonguay, L. G. (2015). Practice-oriented research: What it takes to do collaborative research in private practice. Psychotherapy Research, 25, 67–83.10.1080/10503307.2014.939119
   PubMed Web of Science ®Google Scholar
• McAleavey, A. A., & Castonguay, L. G. (2014). Insight as a common and specific impact of psychotherapy: Therapist-reported exploratory, directive, and common factor interventions. Psychotherapy, 51, 283–294.10.1037/a0032410
   PubMed Web of Science ®Google Scholar
• McCarthy, K. S., & Barber, J. P. (2009). The multitheoretical list of therapeutic interventions (MULTI): Initial report. Psychotherapy Research, 19, 96–113.10.1080/10503300802524343
   PubMed Web of Science ®Google Scholar
• McNeish, D. M., & Stapleton, L. M. (2016). The effect of small sample size on two-level model estimates: A review and illustration. Educational Psychology Review, 28, 295–314. doi:10.1007/s10648-014-9287-x
   Web of Science ®Google Scholar
• Meehl, P. E. (1954). Clinical versus statistical prediction: A theoretical analysis and a review of the evidence. Washington, DC: American Psychological Association.
   Google Scholar
• Meehl, P. E. (1973). Psychodiagnosis: Selected papers. Kingsport, TN: Kingsport Press.
   Google Scholar
• Orlinsky, D. E., Gerin, P., Davis, J., Davis, M., Ambuhl, H., Willutzski, U., & Iahns, J. F. (1991). The international study of the development of psychotherapists: Conceptual organizational of the common core questionnaires (Unpublished manuscript). Chicago, IL: University of Chicago.
   Google Scholar
• Pinheiro, J., Bates, D., DebRoy, S., & Sarkar, D. (2013). R development core team: Linear and nonlinear mixed effects models. R package version, 3, e107.
   Google Scholar
• R Development Core Team. (2014). R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing. Retrieved from http://www.R-project.org/
   Google Scholar
• Salisbury, T. N. (2015). Predicting youth treatment failure: An investigation of clinical versus actuarial judgment. Retrieved from PsycINFO. http://ezaccess.libraries.psu.edu/login?url=http://search.proquest.com/docview/1721926585?accountid=13158
   Google Scholar
• Sarbin, T. R. (1943). A contribution to the study of actuarial and individual methods of prediction. American Journal of Sociology, 48, 593–602.10.1086/219248
   Google Scholar
• Spengler, P. M., White, M. J., Ægisdóttir, S., Maugherman, A. S., Anderson, L. A., Cook, R. S., … Rush, J. D. (2009). The meta-analysis of clinical judgment project: Effects of experience on judgment accuracy. Counseling Psychologist, 37, 350–399.
   Web of Science ®Google Scholar
• Tracey, T. J. G., Wampold, B. E., Lichtenberg, J. W., & Goodyear, R. K. (2014). Expertise in psychotherapy: An elusive goal? American Psychologist, 69, 218–229.10.1037/a0035099
   PubMed Web of Science ®Google Scholar
• Wampold, B. E., Baldwin, S. A., Grosse Holtforth, M., & Imel, Z. (2017). There are therapist effects but what characterizes effective therapist? In L. G. Castonguay & C. E. Hill (Eds.), Therapist effects: Toward understanding how and why some therapists are better than others (pp. 37–54). Washington, DC: American Psychological Association book.
   Google Scholar
• Wiggins, J. S. (1973). Personality and Prediction: Principles of personality assessment. Reading, MA: Addison-Wesley.
   Google Scholar