Use of outcome measurements in clinical practice: How specific should one be?

References

• American Psychiatric Association. (2000). DSM-IV-TR: Diagnostic and statistical manual of mental disorders (4th ed., Text revision). Washington, DC: Author, p. 75.
   Google Scholar
• Andrews, G., & Page, A. C. (2005). Outcome measurement, outcome management and monitoring. Australian & New Zealand Journal of Psychiatry, 39, 649–651. doi: 10.1080/j.1440-1614.2005.01648.x
   PubMed Web of Science ®Google Scholar
• Bates, D., Maechler, M., Bolker, B., Walker, S., Christensen, R. H. B., Singmann, H. … Green, P. (2017). Linear mixed-effects models using “Eigen” en S4 (R package lme4, Version 1.1-14). Retrieved from https://cran.rprojectorg/web/packages/lme4/lme4.pdfs/lme4/lme4.pdf.
   Google Scholar
• Bickman, L., Kelley, S. D., Breda, C., De Andrade, A. R., & Riemer, M. (2011). Effects of routine feedback to clinicians on youth mental health outcomes: A randomized cluster design. Psychiatric Services, 62, 1423–1429. doi: 10.1176/appi.ps.002052011
   PubMed Web of Science ®Google Scholar
• Bickman, L., Riemer, M., Breda, C., & Kelley, S. D. (2006). CFIT: A system to provide a continuous quality improvement infrastructure through organizational responsiveness, measurement, training, and feedback. Report on Emotional and Behavioral Disorders in Youth, 6, 86–94.
   Google Scholar
• Boswell, J. F., Kraus, D. R., Miller, S. D., & Lambert, M. J. (2015). Implementing routine outcome monitoring in clinical practice. Benefits, Challenges, and Solutions. Psychotherapy Research, 25(1), 6–19. doi: 10.1080/10503307.2013.817696
   PubMed Web of Science ®Google Scholar
• Brazier, J., Connell, J., Papaioannou, D., Mukuria, C., Mulhern, B., Peasgood, T., … Parry, G. (2014). A systematic review, psychometric analysis and qualitative assessment of generic preference-based measures of health in mental health populations and the estimation of mapping functions from widely used specific measures. Health Technology Assessment, 18(34), 1–183. doi: 10.3310/hta18340
   PubMed Web of Science ®Google Scholar
• Brown, E. S., Murray, M., Carmody, T. J., Kennard, B. D., Hughes, C. W., Khan, D. A., & Rush, A. J. (2008). The Quick Inventory of Depressive Symptomatology—self-report: A psychometric evaluation in patients with asthma and major depressive disorder. Annual Allergy Asthma Immunology Journal, 100, 433–438. doi: 10.1016/S1081-1206(10)60467-x
   PubMed Web of Science ®Google Scholar
• Carlier, I. V. E., Meuldijk, D., Van Vliet, I. M., Van Fenema, E., Van der Wee, N. J. A., & Zitman, F. G. (2010). Routine outcome monitoring and feedback on physical or mental health status: Evidence and theory. Journal of Evaluation in Clinical Practice, 18, 104–110. doi: 10.1111/j.1365-2753.2010.01543.x
   PubMed Web of Science ®Google Scholar
• Claiborn, C. D., & Goodyear, R. K. (2005). Feedback in psychotherapy. Journal of Clinical Psychology, 61(2), 209–217. doi: 10.1002/jclp.20112
   PubMed Web of Science ®Google Scholar
• Cumming, G. (2012). Understanding the new statistics: Effect sizes, confidence intervals, and meta-analysis. New York, NY: Routledge.
   Google Scholar
• De Beurs, E. (2009). Brief symptom inventory: Handleiding addendum. Leiden: PITS BV.
   Google Scholar
• De Beurs, E., Barendregt, M., De Heer, A., van Duijn, E., Goeree, B., Kloos, M. … Merks, A. (2016). Comparing methods to denote treatment outcome in clinical research and benchmarking mental health care. Clinical Psychology & Psychotherapy, 23, 308–318. doi: 10.1002/cpp.1954
   PubMed Web of Science ®Google Scholar
• De Beurs, E., & Zitman, F. G. (2006). De Brief Symptom Inventory (BSI): de betrouwbaarheid en validiteit van een handzaam alternatief voor de SCL-90. Maandblad Geestelijke Volksgezondheid, 61, 120–141.
   Google Scholar
• De Jong, K., Nugter, M. A., Polak, M., Wagenborg, J. E. A., Spinhoven, P., & Heiser, W. A. (2007). The outcome questionnaire (OQ-45) in a Dutch population: A cross-cultural validation. Clinical Psychology and Psychotherapy, 14, 288–301. doi: 10.1002/cpp.529
   Web of Science ®Google Scholar
• De Jong, K., Timman, R., Hakkaart-Van Roijen, L., Vermeulen, P., Kooiman, K., Passchier, J., & Busschbach, J. V. (2014). The effect of outcome monitoring feedback to clinicians and patients in short and long-term psychotherapy: A randomized controlled trial. Psychotherapy Research, 24(6), 629–639. doi: 10.1080/10503307.2013.871079
   PubMed Web of Science ®Google Scholar
• De Jong, K., van Sluis, P., Nugter, M. A., Heiser, W. J., & Spinhoven, P. (2012). Understanding the differential impact of outcome monitoring: Therapist variables that moderate feedback effects in a randomized clinical trial. Psychotherapy Research, 22, 464–474. doi: 10.1080/10503307.2012.673023
   PubMed Web of Science ®Google Scholar
• Delespaul, P. A. E. G. (2015). Routine outcome measurement in the Netherlands—a focus on benchmarking. International Review of Psychiatry, 27, 320–328. doi: 10.3109/09540261.2015.1045408
   PubMed Web of Science ®Google Scholar
• Dingemans, A. E., & Van Furth, E. F. (2017). Measuring changes during the treatment of eating disorders: A comparison of two types of questionnaires. Tijdschrift Voor Psychiatrie, 59(5), 278–285.
   PubMedGoogle Scholar
• Greevy, R., Lu, B., Silber, J. H., & Rosenbaum, P. (2004). Optimal multivariate matching before randomization. Biostatistics (Oxford, England), 5, 263–275. doi: 10.1093/biostatistics/5.2.263
   PubMed Web of Science ®Google Scholar
• Hansen, N. B., Lambert, M. J., & Forman, E. M. (2002). The psychotherapy dose–response effect and its implications for treatment delivery services. Clinical Psychology: Science and Practice, 9, 329–343. doi: 10.1093/clipsy.9.3.329
   Web of Science ®Google Scholar
• Harmon, S. C., Lambert, M. J., Smart, D. M., Hawkins, E., Nielsen, S. L., Slade, K., & Lutz, W. (2007). Enhancing outcome for potential treatment failures: Therapist–client feedback and clinical support tools. Psychotherapy Research, 17(4), 379–392. doi:10.1002/jclp.20109
   Web of Science ®Google Scholar
• Herman, R. C. (2005). Linking outcome measurement with process measurement for quality improvement. In L. W. W. Ishak, T. Burt, & L. I. Sederer (Eds.), Outcome measurement in psychiatry: A critical review (pp. 23–34). Washington, DC: American Psychiatric.
   Google Scholar
• Hill, J. L., Reiter, J. P., & Zanutto, E. L. (2004). A comparison of experimental and observational data analyses. In A. Gelman & X.-L. Meng (Eds.), Applied Bayesian modeling and causal inference from incomplete data perspectives (pp. 51–60). New York, NY: John Wiley & Sons.
   Google Scholar
• Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Clinical and Consulting Psychology, 59(1), 12–19. 10.1037/0022-006X.59.1.12
   PubMed Web of Science ®Google Scholar
• Kelley, S. D., & Bickman, L. (2009). Beyond outcomes monitoring: Measurement feedback systems in child and adolescent clinical practice. Current Opinion in Psychiatry, 22(4), 363–368. doi: 10.1097/YCO.0b013e32832c9162
   PubMed Web of Science ®Google Scholar
• Kendrick, T., El-Gohary, M., Stuart, B., Gilbody, S., Churchill, R., Aiken, L., … Moore, M. (2016). Routine use of patient reported outcome measures (PROMs) for improving treatment of common mental health disorders in adults. Cochrane Database of Systematic Reviews, (7). doi: 10.1002/14651858.CD011119.pub2
   Web of Science ®Google Scholar
• Kluger, A. N., & DeNisi, A. (1996). The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychological Bulletin, 119(2), 254–284. doi: 10.1037/0033-2909.119.2.254
   Web of Science ®Google Scholar
• Knaup, C., Koesters, M., Schoefer, D., Becker, T., & Puschner, B. (2009). Effect of feedback of treatment outcome in specialist mental healthcare: Meta-analysis. The British Journal of Psychiatry, 195, 15–22. doi: 10.1192/bjp.bp.108.053967
   PubMed Web of Science ®Google Scholar
• Lee, W., Jones, L., Goodman, R., & Heyman, I. (2005). Broad outcome measures may underestimate effectiveness: An instrument comparison study. Child and Adolescent Mental Health, 10(3), 143–144. doi: 10.1111/j.1475-3588.2005.00350.x
   Google Scholar
• Leite, W. (2007). Practical propensity score methods using R. Los Angeles, CA: Sage.
   Google Scholar
• Proctor, E., Silmer, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., … Hensley, M. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services Research, 38, 65–76. doi: 10.1007/s10488-010-0319-7
   PubMed Web of Science ®Google Scholar
• Ronk, F. R., Hooke, G. R., & Page, A. C. (2012). How consistent are clinical significance classifications when calculation methods and outcome measures differ? Clinical Psychology: Science and Practice, 19(2), 167–179. doi: 10.1111/j.1468-2850.2012.01281.x
   Web of Science ®Google Scholar
• Rosenbaum, P. R., & Rubin, D. R. (1984). Reducing bias in observational studies using subclassification on the propensity score. Journal of the American Statistical Association, 79(387), 516–524. doi:10.2307/2288398
   Web of Science ®Google Scholar
• Schulte-van Maaren, Y. W. M., Carlier, I. V. E., Zitman, F. G., van Hemert, A. M., de Waal, M. W. M., van der Does, A. J. W., … Giltay, E. J. (2013). Reference values for major depression questionnaires: The Leiden Routine Outcome Monitoring Study. Journal of Affective Disorders, 149, 342–349. doi: 10.1016/j.jad.2013.02.009
   PubMed Web of Science ®Google Scholar
• Sekhon, J. S. (2011). Multivariate and propensity score matching software with automated balance optimization: The matching package for R. Journal of Statistical Software, 42(7), doi: 10.18637/jss.v042.i07
   Web of Science ®Google Scholar
• Sekhon, J. S. (2015). Multivariate and propensity score matching with balance optimization (R package “matching”, Version 4.9-2). Retreived from https://cran.r-project.org/web/packages/Matching/Matching.pdf.
   Google Scholar
• Shimokawa, K., Lambert, M. J., & Smart, D. W. (2010). Enhancing treatment outcome of patients at risk of treatment failure: Meta-analytic and mega-analytic review of a psychotherapy quality assurance system. Journal of Consulting and Clinical Psychology, 78, 298–311. doi: 10.1037/a0019247
   PubMed Web of Science ®Google Scholar
• Steiner, P. M., Cook, T. D., Shadish, W. R., & Clark, M. H. (2010). The importance of covariate selection in controlling for selection bias in observational studies. Psychological Methods, 15(3), 250–267. doi: 10.1037/a0018719
   PubMed Web of Science ®Google Scholar
• Trauer, T. (2010). (Ed.). Outcome measurement in mental health: Theory and practice. New York, NY: Cambridge University Press.
   Google Scholar
• van der Lem, R., van der Wee, N. J., van Veen, T., & Zitman, F. G. (2012). Efficacy versus effectiveness: A direct comparison of the outcome of treatment for mild to moderate depression in randomized controlled trials and daily practice. Psychotherapy and Psychosomatics, 81, 226–234. doi: 10.1159/000330890
   PubMed Web of Science ®Google Scholar
• von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gøtzsche, P. C., & Vandenbroucke, J. P. (2008). The strengthening the reporting of observational studies in epidemiology (STROBE) statement: Guidelines for reporting observational studies. Journal of Clinical Epidemiology, 61, 344–349. doi: 10.1016/j.jclinepi.2007.11.008
   PubMed Web of Science ®Google Scholar