The effect of implementing the Outcome Questionnaire-45.2 feedback system in Norway: A multisite randomized clinical trial in a naturalistic setting

References

• Amble, I., Gude, T., Stubdal, S., Oktedalen, T., Skjorten, A. M., Andersen, B. J., … Wampold, B. E. (2013). Psychometric properties of the Outcome Questionnaire-45.2: The Norwegian version in an international context. Psychotherapy Research, 504–513. 10.1080/10503307.2013.849016
   PubMed Web of Science ®Google Scholar
• Anker, M. G., Duncan, B. L. et al. (2009). Using client feedback to improve couple therapy outcomes: A randomized clinical trial in a naturalistic setting. Journal of Consulting and Clinical Psychology, 77, 693–704. 10.1037/a0016062
   PubMed Web of Science ®Google Scholar
• Aoun, S., Pennebaker, D., & Janca, A. (2002). Outcome measurement in rural mental health care: A field trial of rooming-in models. Australian Journal of Rural Health, 10, 302–307. 10.1046/j.1440-1584.2002.00484.x
   PubMedGoogle Scholar
• Barkham, M., Hardy, G. E., & Mellor-Clark, J. (2010). Developing and delivering practice-based evidence: A guide for the psychological therapies. Chichester: Wiley Blackwell. 10.1002/9780470687994
   Google Scholar
• Beretvas, S., Kearney, L. et al. (2003). A shortened form of the Outcome Questionnaire: A validation of scores across ethnic groups. Published on line by the Counseling and Mind Health Center of Texas University.
   Google Scholar
• Bludworth, J. L., Tracey, T. J. G. et al. (2010). The bilevel structure of the Outcome Questionnaire–45. Psychological Assessment, 22, 350–355. 10.1037/a0019187
   PubMed Web of Science ®Google Scholar
• Boswell, J. F., Kraus, D. R., Miller, S. D., & Lambert, M. J. (2013). Implementing routine outcome monitoring in clinical practice: Benefits, challenges, and solutions. Psychotherapy Research (ahead-of-print), 1–14. 10.1080/10503307.2013.817696
   Google Scholar
• Budge, S. L., Moore, J. T., Del Re, A. C., Wampold, B. E., Baardseth, T. P., & Nienhuis, J. B. (2013). The effectiveness of evidence-based treatments for personality disorders when comparing treatment-as-usual and bona fide treatments. Clinical Psychology Review, 33, 1057–1066. 10.1016/j.cpr.2013.08.003
   PubMed Web of Science ®Google Scholar
• Chambless, D. L., Sanderson, W. C., Shoham, V., Johnson, S. B., Pope, K. S., Crits-Christoph, P., … McCurry, S. (1996). An update on empirically validated therapies. The Clinical Psychologist, 49(2), 5–18.
   Google Scholar
• Chapman, J. E. (2003). Reliability and validity of the progress questionnaire: An adaptation of the outcome questionnaire (Doctoral dissertation), Drexel University, Philadelphia.
   Google Scholar
• Chiappelli, M., Coco, G. L., Gullo, S., Bensi, L., & Prestano, C. (2008). The Outcome Questionnaire 45.2. Italian validation of an instrument for the assessment of phychological treatments. Epidemiologia e Psichiatria Sociale [Epidemiology and Social Psychiatry], 17(2), 152–161.
   PubMed Web of Science ®Google Scholar
• Cohen, J. (1988). Statistical power analysis for the behavioral sciencies. East Sussex: Psychology Press.
   Google Scholar
• Crits-Christoph, P., Ring-Kurtz, S., Hamilton, J. L., Lambert, M. J., Gallop, R., McClure, B., … Rotrosen, J. (2012). A preliminary study of the effects of individual patient-level feedback in outpatient substance abuse treatment programs. Journal of Substance Abuse Treatment, 42, 301–309. 10.1016/j.jsat.2011.09.003
   PubMed Web of Science ®Google Scholar
• de Jong, K., Nugter, M. A., Polak, M. G., Wagenborg, J. E. A., Spinhoven, P., & Heiser, W. J. (2007). The Outcome Questionnaire (OQ-45) in a Dutch population: A cross-cultural validation. Clinical Psychology & Psychotherapy, 14, 288–301. 10.1002/cpp.529
   Web of Science ®Google Scholar
• de Jong, K., Timman, R., Hakkaart-Van Roijen, L., Vermeulen, P., Kooiman, K., Passchier, J., & van Busschbach, J. (2014). The effect of outcome monitoring feedback to clinicians and patients in short and long-term psychotherapy: A randomized controlled trial. Psychotherapy Research. 10.1080/10503307.2013.871079
   Google Scholar
• de Jong, K., van Sluis, P., Nugter, M. A., Heiser, W. J., & Spinhoven, P. (2012). Understanding the differential impact of outcome monitoring: Therapist variables that moderate feedback effects in a randomized clinical trial. Psychotherapy Research, 22, 464–474. 10.1080/10503307.2012.673023
   PubMed Web of Science ®Google Scholar
• Durlak, J. A. (2009). How to select, calculate, and interpret effect sizes. Journal of Pediatric Psychology, 34, 917–928. 10.1093/jpepsy/jsp004
   PubMed Web of Science ®Google Scholar
• Evans, C., Connell, J., Barkham, M., Margison, F., McGRATH, G., Mellor-Clark, J., & Audin, K. (2002). Towards a standardised brief outcome measure: Psychometric properties and utility of the CORE—OM. The British Journal of Psychiatry, 180(1), 51–60. 10.1192/bjp.180.1.51
   PubMed Web of Science ®Google Scholar
• Fonagy, P., Roth, A., & Higgitt, A. (2005). The outcome of psychodynamic psychotherapy for psychological disorders. Clinical Neuroscience Research, 4, 367–377. 10.1016/j.cnr.2005.03.005
   Web of Science ®Google Scholar
• Hansen, N. B., & Lambert, M. J. (2003). An evaluation of the dose–response relationship in naturalistic treatment settings using survival analysis. Mental Health Services Research, 5(1), 1–12. 10.1023/A:1021751307358
   PubMedGoogle Scholar
• Hansen, N. B., Lambert, M. J., & Forman, E. M. (2002). The psychotherapy dose-response effect and its implications for treatment delivery services. Clinical Psychology: Science and Practice, 9, 329–343. 10.1093/clipsy.9.3.329
   Web of Science ®Google Scholar
• Hatfield, D. R., & Ogles, B. M. (2004). The use of outcome measures by psychologists in clinical practice. Professional Psychology: Research and Practice, 35, 485–491. 10.1037/0735-7028.35.5.485
   Web of Science ®Google Scholar
• Hawkins, E. J., Lambert, M. J., Vermeersch, D. A., Slade, K. L., & Tuttle, K. C. (2004). The therapeutic effects of providing patient progress information to therapists and patients. Psychotherapy Research, 14, 308–327. 10.1093/ptr/kph027
   Web of Science ®Google Scholar
• Jones, S. R. G. (1992). Was there a Hawthorne effect? American Journal of Sociology, 98, 451–468. 10.1086/230046
   Web of Science ®Google Scholar
• Kim, S.-H., Beretvas, S. N., & Sherry, A. R. (2010). A validation of the factor structure of OQ-45 scores using factor mixture modeling. Measurement and Evaluation in Counseling and Development, 42, 275–295. 10.1177/0748175609354616
   Web of Science ®Google Scholar
• Knaup, C., Koesters, M., Schoefer, D., Becker, T., & Puschner, B. (2009). Effect of feedback of treatment outcome in specialist mental healthcare: Meta-analysis. The British Journal of Psychiatry, 195(1), 15–22. 10.1192/bjp.bp.108.053967
   PubMed Web of Science ®Google Scholar
• Kraemer, H. C., & Kupfer, D. J. (2006). Size of treatment effects and their importance to clinical research and practice. Biological Psychiatry, 59, 990–996. 10.1016/j.biopsych.2005.09.014
   PubMed Web of Science ®Google Scholar
• Lambert, M. J. (2010). Prevention of treatment failure: The use of measuring, monitoring, and feedback in clinical practice. Washington, DC: American Psychological Association.
   Google Scholar
• Lambert, M. J. (2013). Bergin and Garfield's handbook of psychotherapy and behavior change. New York, NY: John Wiley & Sons.
   Google Scholar
• Lambert, M., & Ogles, B. (2004). The efficacy and effectiveness of psychotherapy. In M. J. Lambert (Ed.), Bergin and Garfield's handbook of psychotherapy and behaviour change (pp. 139–193). Chichester: John Wiley & Sons.
   Google Scholar
• Lambert, M. J., & Shimokawa, K. (2011a). Measuring client outcome. In J. C. Norcross (Ed.), Psychotherapy relationships that work: Evidence-based responsiveness ( 2nd ed., pp. 203–223). New York, NY: Oxford University Press.
   Google Scholar
• Lambert, M. J., & Shimokawa, K. (2011b). Collecting client feedback. Psychotherapy, 48(1), 72–79. 10.1037/a0022238
   PubMed Web of Science ®Google Scholar
• Lambert, M. J., Kahler, M., Harmon, C., Burlingame, G. M. (2011). Administration and Scoring Manual Outcome Questionnaire OQ-45.2. (OQ Measures L.L.C.).
   Google Scholar
• Lambert, M. J., Burlingame, G. M., Umphress, V., Hansen, N. B., Vermeersch, D. A., Clouse, G. C., & Yanchar, S. C. (1996). The reliability and validity of the Outcome Questionnaire. Clinical Psychology & Psychotherapy, 3, 249–258. 10.1002/(SICI)1099-0879(199612)3:4<249::AID-CPP106>3.0.CO;2-S
   Web of Science ®Google Scholar
• Lambert, M. J., Hannöver, W., Nisslmüller, K., Richard, M., & Kordy, H. (2002). Fragebogen zum Ergebnis von Psychotherapie [Questionnaire on the results of psychotherapy: Reliability and validity of the German translation of the Outcome Questionnaire 45.2 (OQ-45.2)]. Zeitschrift für klinische Psychologie und Psychotherapie [Journal of Clinical Psychology and Psychotherapy], 31(1), 40–46. 10.1026//1616-3443.31.1.40
   Web of Science ®Google Scholar
• Laska, K. M., Gurman, A. S., & Wampold, B. E. (2013). Expanding the lens of evidence-based practice in psychotherapy: A common factors perspective. Psychotherapy [Epub ahead of print].
   Google Scholar
• Lo Coco, G., Chiappelli, M., Bensi, L., Gullo, S., Prestano, C., & Lambert, M. J. (2008). The factorial structure of the outcome questionnaire-45: A study with an Italian sample. Clinical Psychology & Psychotherapy, 15, 418–423. 10.1002/cpp.601
   PubMed Web of Science ®Google Scholar
• McAleavey, A. A., Nordberg, S. S., Hayes, J. A., Castonguay, L. G., Locke, B. D., & Lockard, A. J. (2012). Clinical validity of the Counseling Center Assessment of Psychological Symptoms-62 (CCAPS-62): Further evaluation and clinical applications. Journal of Counseling Psychology, 59, 575–590. 10.1037/a0029855
   PubMed Web of Science ®Google Scholar
• Miller, S. D., Duncan, B. L., Sorrell, R., & Brown, G. S. (2005). The partners for change outcome management system. Journal of Clinical Psychology, 61(2), 199–208.
   PubMed Web of Science ®Google Scholar
• Mueller, R. M., Lambert, M. J. et al. (1998). Construct validity of the Outcome Questionnaire: A confirmatory factor analysis. Journal of Personality Assessment, 70, 248–262. 10.1207/s15327752jpa7002_5
   Web of Science ®Google Scholar
• Mohr, D. C. (1995). Negative outcome in psychotherapy: A critical review. Clinical Psychology: Science and Practice, 2(1), 1–27. 10.1111/j.1468-2850.1995.tb00022.x
   Web of Science ®Google Scholar
• Pinsof, W. M., Zinbarg, R. E., Lebow, J. L., Knobloch-Fedders, L. M., Durbin, E., Chambers, A., … Friedman, G. (2009). Laying the foundation for progress research in family, couple, and individual therapy: The development and psychometric features of the initial Systemic Therapy Inventory of Change. Psychotherapy Research, 19(2), 143–156. 10.1080/10503300802669973
   PubMed Web of Science ®Google Scholar
• Probst, T., Lambert, M. J., Loew, T. H., Dahlbender, R. W., Göllner, R., & Tritt, K. (2013). Feedback on patient progress and clinical support tools for therapists: Improved outcome for patients at risk of treatment failure in psychosomatic in-patient therapy under the conditions of routine practice. Journal of Psychosomatic Research, 75, 255–261. 10.1016/j.jpsychores.2013.07.003
   PubMed Web of Science ®Google Scholar
• Qin, Y.-f., & Hu, S.-j. (2008). Usability report of outcome Questionnaire-45 in part of Chinese sample. Chinese Journal of Clinical Psychology, 16, 138–140.
   Google Scholar
• Shafran, R., Clark, D. M., Fairburn, C. G., Arntz, A., Barlow, D. H., Ehlers, A., … Wilson, G. T. (2009). Mind the gap: Improving the dissemination of CBT. Behaviour Research and Therapy, 47, 902–909. 10.1016/j.brat.2009.07.003
   PubMed Web of Science ®Google Scholar
• Shimokawa, K., Lambert, M. J., & Smart, D. W. (2010). Enhancing treatment outcome of patients at risk of treatment failure: Meta-analytic and mega-analytic review of a psychotherapy quality assurance system. Journal of Consulting and Clinical Psychology, 78, 298–311. 10.1037/a0019247
   PubMed Web of Science ®Google Scholar
• Simon, W., Lambert, M. J., Busath, G., Vazquez, A., Berkeljon, A., Hyer, K., … Berrett, M. (2013). Effects of providing patient progress feedback and clinical support tools to psychotherapists in an inpatient eating disorders treatment program: A randomized controlled study. Psychotherapy Research, 23, 287–300. 10.1080/10503307.2013.787497
   PubMed Web of Science ®Google Scholar
• Simon, W., Lambert, M. J., Harris, M. W., Busath, G., & Vazquez, A. (2012). Providing patient progress information and clinical support tools to therapists: Effects on patients at risk of treatment failure. Psychotherapy Research, 22, 638–647. 10.1080/10503307.2012.698918
   PubMed Web of Science ®Google Scholar
• Spielmans, G. I., Gatlin, E. T., & McFall, J. P. (2010). The efficacy of evidence-based psychotherapies versus usual care for youths: Controlling confounds in a meta-reanalysis. Psychotherapy Research, 20, 234–246. 10.1080/10503300903311293
   PubMed Web of Science ®Google Scholar
• Walter, G., Cleary, M., & Rey, J. (1998). Attitudes of mental health personnel towards rating outcome. Journal of Quality in Clinical Practice, 18(2), 109.
   PubMedGoogle Scholar
• Wampold, B. E., & Brown, G. S. (2005). Estimating therapist variability: A naturalistic study of outcomes in managed care. Journal of Consulting and Clinical Psychology, 73, 914–923. 10.1037/0022-006X.73.5.914
   PubMed Web of Science ®Google Scholar
• Wampold, B. E., Budge, S. L., Laska, K. M., Del Re, A. C., Baardseth, T. P., Flűckiger, C., … Gunn, W. (2011). Evidence-based treatments for depression and anxiety versus treatment-as-usual: A meta-analysis of direct comparisons. Clinical Psychology Review, 31, 1304–1312. 10.1016/j.cpr.2011.07.012
   PubMed Web of Science ®Google Scholar
• Weisz, J. R., Jensen-Doss, A., & Hawley, K. M. (2006). Evidence-based youth psychotherapies versus usual clinical care: A meta-analysis of direct comparisons. American Psychologist, 61, 671–689. 10.1037/0003-066X.61.7.671
   PubMed Web of Science ®Google Scholar
• Wennberg, P., Philips, B., & Jong, K. (2010). The Swedish version of the Outcome Questionnaire (OQ-45): Reliability and factor structure in a substance abuse sample. Psychology and Psychotherapy: Theory, Research and Practice, 83, 325–329. 10.1348/147608309X478715
   PubMed Web of Science ®Google Scholar
• Willis, A., Deane, F. P., & Coombs, T. (2009). Improving clinicians’ attitudes toward providing feedback on routine outcome assessments. International Journal of Mental Health Nursing, 18, 211–215. 10.1111/j.1447-0349.2009.00596.x
   PubMed Web of Science ®Google Scholar