Measuring psychotherapy outcomes in routine practice: Examining Slovak versions of three commonly used outcome instruments

References

• Barkham, M., Evans, C., Margison, F., McGrath, G., Mellor-Clark, J., Milne, D., & Connell, J. (1998). The rationale for developing and implementing core outcome batteries for routine use in service settings and psychotherapy outcome research. Journal of Mental Health, 7, 35–47.
   Google Scholar
• Barkham, M., Margison, F., Leach, C., Lucock, M., Mellor-Clark, J., Evans, C., … McGrath, G. (2001). Service profiling and outcomes benchmarking using the CORE-OM: Toward practice-based evidence in the psychological therapies. Journal of Consulting and Clinical Psychology, 69, 184–196.
   PubMed Web of Science ®Google Scholar
• Barkham, M., & Mellor-Clark, J. (2003). Bridging evidence-based practice and practice-based evidence: Developing a rigorous and relevant knowledge for the psychological therapies. Clinical Psychology and Psychotherapy, 10, 319–327.
   Web of Science ®Google Scholar
• Barkham, M., Mellor-Clark, J., Connell, J., & Cahill, J. (2006). A core approach to practice-based evidence: A brief history of the origins and applications of the CORE-OM and CORE System. Counselling and Psychotherapy Research, 6, 3–15.
   Google Scholar
• Beck, A. T., Epstein, N., Brown, G., & Steer, R. A. (1988). An inventory for measuring clinical anxiety: Psychometric properties. Journal of Consulting and Clinical Psychology, 56, 893–897.
   PubMed Web of Science ®Google Scholar
• Bieščad, M. (2004). Psychometrická analýza sebaposudzovacej škály Symptom Checklist – 90 (SCL-90) [Psychometric analysis of the Symptom Checklist-90, a self-report] ( Diplomová práca [Master’s dissertation]). Trnava: Fakulta humanistiky, Trnavskej univerzity.
   Google Scholar
• Bieščad, M. (2007). Aplikácia nástrojov merajúcich výsledky psychoterapie. Porovnanie citlivosti nástrojov merania v jednotlivých oblastiach terapeutickej zmeny [The application of psychotherapy outcome instruments: A comparison of the instruments’ sensitivity in different areas of therapeutic change] ( Dizertačná práca [PhD dissertation]). Trnava: Filozofická fakulta, Trnavskej univerzity v Trnave.
   Google Scholar
• Biescad, M., & Timulak, L. (2006, June 21–24). Using CORE-OM, OQ-45 and Outcome Rating Scale in various mental health care settings: Preliminary data comparing results on the three instruments. Paper presented at 37th annual meeting of the Society for Psychotherapy Research, Edinburgh, Scotland.
   Google Scholar
• Boleloucký, Z. (1993). Psychiatrické posuzovací stupnice a dotazníkové metódy [Psychiatric rating scales and questionnaires]. In J. Baštecký, J. Šavlík, & J. Šimek (Eds.), Psychosomatická medicína [Psychosomatic medicine] (s. 118–127). Praha: Grada Avicenum.
   Google Scholar
• Burlingame, G. M., Lambert, M. J., Reisinger, C. W., Neff, W. M., & Mosier, J. (1995). Pragmatics of tracking mental health outcomes in a managed care setting. The Journal of Mental Health Administration, 22, 226–236.
   PubMedGoogle Scholar
• Cahill, J., Barkham, M., Stiles, W. B., Twigg, E., Hardy, G. E., Rees, A., & Evans, C. (2006). Convergent validity of the CORE measures with measures of depression for clients in cognitive therapy for depression. Journal of Counseling Psychology, 53, 253–259.
   Web of Science ®Google Scholar
• Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.
   Google Scholar
• Cone, J. D. (2001). Evaluating outcomes: Empirical tools for effective practice. Washington, DC: American Psychological Association.
   Google Scholar
• Connell, J., & Barkham, M. (2007). CORE-10 user manual, Version 1.1 (pp. 1–40). CORE System Trust & CORE Information Management Systems Ltd.
   Google Scholar
• CORE System Group. (1998). CORE System (information management) handbook. Leeds: Author.
   Google Scholar
• de Jong, K., Nugter, M. A., Polak, M. G., Wagenborg, J. E. A., Spinhoven, P., & Heiser, W. J. (2007). The Outcome Questionnaire (OQ-45) in a Dutch population: A cross-cultural validation. Clinical Psychology and Psychotherapy, 14, 288–301.
   Web of Science ®Google Scholar
• Derogatis, L. R., Lipman, R. S., & Covi, L. (1973). SCL-90: An outpatient psychiatric rating scale-preliminary report. Psychopharmacology Bulletin, 9, 13–28.
   PubMedGoogle Scholar
• Doerfler, L. A., Addis, M. E., & Moran, P. W. (2002). Evaluating mental health outcomes in an inpatient setting: Convergent and divergent validity of the OQ-45 and BASIS-32. Journal of Behavioral Health Services and Research, 29, 394–403.
   PubMed Web of Science ®Google Scholar
• Elfström, M. L., Evans, C., Lundgren, J., Johansson, B., Hakeberg, M., & Carlsson, S. G. (2012). Validation of the Swedish version of the Clinical Outcomes in Routine Evaluation Outcome Measure (CORE-OM). Clinical Psychology and Psychotherapy, 20, 447–455.
   PubMed Web of Science ®Google Scholar
• Evans, C. (2012a). Cautionary notes on power steering for psychotherapy. Psychologie Canadienne [Canadian Psychology], 53, 131–139.
   Google Scholar
• Evans, C. (2012b). The CORE-OM (Clinical Outcomes in Routine Evaluation – Outcome Measure) and its derivatives. Integrating Science and Practice, 2, 12–15.
   Google Scholar
• Evans, C., Connell, J., Barkham, M., Margison, F., McGrath, G., Mellor-Clark, J., & Audin, K. (2002). Toward a standardised brief outcome measure: Psychometric properties and utility of CORE-OM. British Journal of Psychiatry, 180, 56–60.
   Web of Science ®Google Scholar
• Evans, C., Mellor-Clark, J., Margison, F., Barkham, M., Audin, K., Connell, J., & McGrath, G. (2000). CORE: Clinical Outcomes in Routine Evaluation. Journal of Mental Health, 9, 247–255.
   Google Scholar
• Gampe, K., Bieščad, M., Balúnová-Labaničová, L., Timuľák, L., & Evans, Ch. (2007). Slovenská adaptácia metódy CORE-OM [Slovak adaptation of the CORE-OM]. Česká a Slovenská psychiatrie [Czech and Slovak Psychiatry], 103, 4–13.
   Google Scholar
• Holi, M. (2003). Assessment of psychiatric symptoms using the SCL – 90. Helsinky: Helsinky University Printing House.
   Google Scholar
• Howard, K. I., Lueger, R. J., Maling, M. S., & Martinovich, Z. (1993). A phase model of psychotherapy outcome: Causal mediation of change. Journal of Consulting and Clinical Psychology, 61, 678–685.
   PubMed Web of Science ®Google Scholar
• Howard, K. I., Moras, K., Brill, P. L., Martinovich, Z., & Lutz, W. (1996). Evaluation of psychotherapy: Efficacy, effectiveness, and patient progress. American Psychologist, 51, 1059–1064.
   PubMed Web of Science ®Google Scholar
• International Centre for Clinical Excellence. (2013). The Outcome Rating Scale. Retrieved from http://www.centerforclinicalexcellence.com/site.php?page=measures.php
   Google Scholar
• Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59, 12–19.
   PubMed Web of Science ®Google Scholar
• Klaghofer, R., & Brähler, E. (2001). Konstruktion und teststatistische prüfung einer kurzform der SCL-90-R [Construction and statistical evaluation of a short version of the SCL-90–R]. Zeitschrift für Klinische Psychologie, Psychiatrie und Psychoterapie [Journal of Clinical Psychology, Psychiatry and Psychotherapy], 49, 115–124.
   Google Scholar
• Lambert, M. J. (1983). Introduction to assessment of psychotherapy outcome: Historical perspective and current issues. In M. J. Lambert, E. R. Christensen, & S. S. DeJulio (Eds.), The assessment of psychotherapy outcome (pp. 3–32). New York, NY: Wiley.
   Google Scholar
• Lambert, M. J. (2010). Prevention of treatment failure. Washington, DC: American Psychological Association.
   Google Scholar
• Lambert, M. J., Burlingame, G. M., Umphress, V., Hansen, N. B., Vermeersch, D. A., Clouse, G. C., & Yanchar, S. (1996). The reliability and validity of the Outcome Questionnaire. Clinical Psychology and Psychotherapy, 3, 249–258.
   Web of Science ®Google Scholar
• Lambert, M. J., & Finch, A. E. (1999). The Outcome Questionnaire. In M. E. Maruish (Ed.), The use of psychological testing for treatment planning and outcomes assessment (2nd ed., pp. 831–869). Mahwah, NJ: Lawrence Erlbaum Associates.
   Google Scholar
• Lambert, M. J., Hannöver, W., Nisslmüller, K., Richard, M., & Kordy, H. (2002). Fragebogen zum Ergebnis von Psychotherapie: Zur Reliabilität und Validität der deutschen Übersetzung des Outcome Questionnaire 45.2 (OQ-45.2) [Psychotherapy outcome measures: Toward reliability and validity of the German version of the Outcome Questionnaire 45.2 (OQ-45.2)]. Zeitschrift für Klinische Psychologie und Psychotherapie [Journal of Clinical Psychology, Psychiatry and Psychotherapy], 31, 40–46.
   Web of Science ®Google Scholar
• Lambert, M. J., Hansen, N. B., & Finch, A. E. (2001). Patient-focused research: Using patient outcome data to enhance treatment effects. Journal of Consulting and Clinical Psychology, 69, 159–172.
   PubMed Web of Science ®Google Scholar
• Lambert, M. J., & Hawkins, E. J. (2004). Measuring outcome in professional practice: Considerations in selecting and using brief outcome instruments. Professional Psychology: Research and Practice, 35, 492–499.
   Web of Science ®Google Scholar
• Lambert, M. J., & Hill, C. E. (1994). Assessing psychotherapy outcomes and processes. In A. E. Bergin & S. L. Garfield (Eds.), Handbook of psychotherapy and behavior change (4th ed., pp. 72–113). New York, NY: Wiley.
   Google Scholar
• Lambert, M. J., Morton, J. J., Hattfield, D., Harmon, C., Hamilton, S., Reid, R. C., … Burlingame, G. M. (2004). Administration and scoring manual for the OQ^© – 45.2 (Outcome Questionnaire). Orem, UT: American Professional Credentialing Services.
   Google Scholar
• Lambert, M. J., Okiishi, J. C., Finch, A., & Johnson, L. D. (1998). Outcome assessment: From conceptualization to implementation. Professional Psychology: Research and Practice, 29, 63–70.
   Web of Science ®Google Scholar
• Lambert, M. J., Whipple, J. L., Hawkins, E. J., Vermeersch, D. A., Nielsen, S. L., & Smart, D. W. (2003). Is it time for clinicians to routinely track patient outcome? A meta-analysis. Clinical Psychology: Science and Practice, 10, 288–301.
   Web of Science ®Google Scholar
• Lambert, M. J., Whipple, J. L., Smart, D. W., Vermeersch, D. A., Nielsen, S. L., & Hawkins, E. J. (2001). The effects of providing therapists with feedback on patient progress during psychotherapy: Are outcomes enhanced? Psychotherapy Research, 11, 49–68.
   PubMed Web of Science ®Google Scholar
• Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159–174.
   PubMed Web of Science ®Google Scholar
• Lo Coco, G., Chiappelli, M., Prestano, C., Gullo, S., Bensi, L., Lo Verso, G., & Lambert, M. J. (2006, June 21–24). Generalizability of normative data for the OQ-45: A study with an Italian outpatient group. Poster presented at 37th annual meeting of the Society for Psychotherapy Research, Edinburgh, Scotland.
   Google Scholar
• Machado, P. P. P., & Klein, J. M. (2006, June 21–24). The Outcome Questionnaire – 45: Portuguese psychometric data with a non-clinical sample. Poster presented at 37th annual meeting of the Society for Psychotherapy Research, Edinburgh, Scotland.
   Google Scholar
• Miller, S. D., Duncan, B. L., Brown, J., Sparks, J., & Claud, D. (2003). The Outcome Rating Scale: A preliminary study of the reliability, validity, and feasibility of a brief visual analog measure. Journal of Brief Therapy, 2, 91–100.
   Google Scholar
• Miller, S. D., Duncan, B. L., & Hubble, M. A. (2004). Beyond integration: The triumph of outcome over process in clinical practice. Psychotherapy in Australia, 10, 2–19.
   Google Scholar
• Miller, S. D., Duncan, B. L., & Hubble, M. A. (2005). Outcome-informed clinical work. In J. C. Norcross & M. R. Goldfried (Eds.), Handbook of psychotherapy integration (2nd ed., pp. 84–102). New York, NY: Oxford University Press.
   Google Scholar
• Miller, S. D., Duncan, B. L., Sorrell, R., & Brown, G. S. (2005). The partners for change outcome management system. Journal of Clinical Psychology, 61, 199–208.
   PubMed Web of Science ®Google Scholar
• Newman, F. L., Ciarlo, J. A., & Carpenter, D. (1999). Guidelines for selecting psychological instruments for treatment planning and outcome assessment. In M. E. Maruish (Ed.), The use of psychological testing for treatment planning and outcomes assessment (2nd ed., pp. 153–170). Mahwah, NJ: Lawrence Erlbaum Associates.
   Google Scholar
• Nguyen, T. D., Attkisson, C. C., & Stegner, B. L. (1983). Assessment of patient satisfaction: Development and refinement of a Service Evaluation Questionnaire. Evaluation and Program Planning, 6, 299–313.
   PubMedGoogle Scholar
• Ogles, B. M., Lambert, M. J., & Fields, S. A. (2002). Essentials of outcome assessment. New York, NY: Wiley.
   Google Scholar
• Palmieri, G., Evans, C., Hansen, V., Brancaleoni, G., Ferrari, S., Porcelli, P., … Rigatelli, M. (2009). Validation of the Italian version of the Clinical Outcomes in Routine Evaluation – Outcome Measure (CORE-OM). Clinical Psychology and Psychotherapy, 16, 444–449.
   PubMed Web of Science ®Google Scholar
• Rosen, C. S., Drescher, K. D., Moos, R. H., Finney, J. W., Murphy, R. T., & Gusman, F. (2000). Six and ten-item indexes of psychological distress based on the Symptom Checklist-90. Assessment, 7, 103–111.
   PubMed Web of Science ®Google Scholar
• Rosenberg, M. (1965). Society and the adolescent self-image. Princeton, NJ: Princeton University Press.
   Google Scholar
• Sederer, L. I., Dickey, B., & Eisen, S. V. (1997). Assessing outcomes in clinical practice. Psychiatric Quarterly, 68, 311–325.
   Google Scholar
• Skre, I., Friborg, O., Elgarøy, S., Evans, C., Myklebust, L. H., Lillevoll, K., … Hansen, V. (2013). The factor structure and psychometric properties of the Clinical Outcomes in Routine Evaluation – Outcome Measure (CORE-OM) in Norwegian clinical and non-clinical samples. BMC Psychiatry, 13, 99.
   PubMed Web of Science ®Google Scholar
• Vermeersch, D. A., Lambert, M. J., & Burlingame, G. M. (2000). Outcome Questionnaire: Item sensitivity to change. Journal of Personality Assessment, 74, 242–261.
   PubMed Web of Science ®Google Scholar
• Vermeersch, D. A., Whipple, J. L., Lambert, M. J., Hawkins, E. J., Burchfield, C. M., & Okiishi, J. C. (2004). Outcome Questionnaire: Is it sensitive to changes in counseling center clients? Journal of Counseling Psychology, 51, 38–49.
   Web of Science ®Google Scholar
• Wiger, D. E., & Solberg, K. B. (2001). Tracking mental health outcomes. New York, NY: Wiley.
   Google Scholar
• Zvarová, M., & Bieščad, M. (2007, April). Overenie konštruktovej validity a vzájomných vzťahov Dotazníka výsledku (Outcome Questionnaire – 45) a Škály hodnotenia výsledku (Outcome Rating Scale). [Evaluation of construct validity and of the relationship between the Outcome Questionnaire 45 and Outcome Rating Scale]. In II. Medzinárodnej konferencii doktorandov odborov Psychológia a Sociálna práca [2nd International conference of doctoral students in psychology and social work], Nitra.
   Google Scholar