References
- Ajzen, I. (2011). The theory of planned behaviour: Reactions and reflections. Psychology & Health, 26(9), 1113–1127. https://doi.org/https://doi.org/10.1080/08870446.2011.613995
- American Psychological Association. (2006). Evidence-based practice in psychology. American Psychologist, 61(4), 271–285. https://doi.org/https://doi.org/10.1037/0003-066X.61.4.271
- Batalden, P. B., & Davidoff, F. (2007). What is “quality improvement” and how can it transform healthcare? Quality and Safety in Health Care, 16(1), 2–3. https://doi.org/https://doi.org/10.1136/qshc.2006.022046
- Beidas, R. S., Buttenheim, A. M., & Mandell, D. S. (2021). Transforming mental health care delivery through implementation science and behavioral economics. JAMA Psychiatry, 78(9), 941–942. https://doi.org/https://doi.org/10.1001/jamapsychiatry.2021.1120
- Bergman, H., Kornør, H., Nikolakopoulou, A., Hanssen‐Bauer, K., Soares‐Weiser, K., Tollefsen, T. K., & Bjørndal, A. (2018). Client feedback in psychological therapy for children and adolescents with mental health problems. Cochrane Database of Systematic Reviews, 20(8), CD011729. https://doi.org/https://doi.org/10.1002/14651858.CD011729.pub2
- Bickman, L., Douglas, K. S., Breda, C., De Andrade, A. R. V., & Riemer, M. (2011). Effects of routine feedback to clinicians on mental health outcomes of youths: Results of a randomized trial. Psychiatric Services, 62(12), 1423–1429. https://doi.org/https://doi.org/10.1176/appi.ps.002052011
- Bickman, L., Douglas, S. R., De Andrade, A. R., Vides, Tomlinson, M., Gleacher, A., Olin, S., & Hoagwood, K. (2016). Implementing a measurement feedback system: A tale of two sites. Administration and Policy in Mental Health and Mental Health Services Research, 43, 410–425. https://doi.org/https://doi.org/10.1007/s10488-015-0647-8
- Carver, C. S., & Scheier, M. F. (1998). On the self-regulation of behavior. Cambridge University Press.
- Chiauzzi, E., & Wicks, P. (2021). Beyond the Therapist’s office: Merging measurement-based care and digital medicine in the real world. Digital Biomarkers, 5(2), 176–182. https://doi.org/https://doi.org/10.1159/000517748
- Coalition for the Advancement and Application of Psychological Science. (2018). “Evidence-based practice decision-making for mental and behavioral health care.” Retrieved December 2, 2021, from https://www.caaps.co/consensus-statement
- Connors, E. H., Douglas, S., Jensen-Doss, A., Landes, S. J., Lewis, C. C., McLeod, B. D., Stanick, C., & Lyon, A. R. (2021). What gets measured gets done: How mental health agencies can leverage measurement-based care for better patient care, clinician supports, and organizational goals. Administration and Policy in Mental Health and Mental Health Services Research, 48, 250–265. https://doi.org/https://doi.org/10.1007/s10488-020-01063-w
- de Jong, K., Conijn, J. M., Gallagher, R. A., Reshetnikova, A. S., Heij, M., & Lutz, M. C. (2021). Using progress feedback to improve outcomes and reduce dropout, treatment duration, and deterioration: A multilevel meta-analysis. Clinical Psychology Review, 85, 102002. https://doi.org/https://doi.org/10.1016/j.cpr.2021.102002
- Dopp, A. R., Parisi, K. E., Munson, S. A., & Lyon, A. R. (2019). A glossary of user-centered design strategies for implementation experts. Translational Behavioral Medicine, 9(6), 1057–1064. https://doi.org/https://doi.org/10.1093/tbm/iby119
- Douglas, S., Button, S., & Casey, S. E. (2016). Implementing for sustainability: Promoting use of a measurement feedback system for innovation and quality improvement. Administration and Policy in Mental Health and Mental Health Services Research, 43(3), 286–291. https://doi.org/https://doi.org/10.1007/s10488-014-0607-8
- First, M. B., Pincus, H. A., Levine, J. B., Williams, J. B. W. W., Ustun, B., & Peele, R. (2004). Clinical utility as a criterion for revising psychiatric diagnoses. American Journal of Psychiatry, 161(6), 946–954. https://doi.org/https://doi.org/10.1176/appi.ajp.161.6.946
- Harmon, S. C., Lambert, M. J., Smart, D. M., Hawkins, E., Nielsen, S. L., Slade, K., & Lutz, W. (2007). Enhancing outcome for potential treatment failures: Therapist–client feedback and clinical support tools. Psychotherapy Research, 17(4), 379–392. https://doi.org/https://doi.org/10.1080/10503300600702331
- Hemmelgarn, A. L., Glisson, C., & James, L. R. (2006). Organizational culture and climate: Implications for services and interventions research. Clinical Psychology: Science and Practice, 13(1), 73–89. https://doi.org/https://doi.org/10.1111/j.1468-2850.2006.00008.x
- Hepner, K. A., Farmer, C. M., Holliday, S. B., Bharil, S., Kimerling, R. E., McGee-Vincent, P., McCaslin, S. E. & Rosen, C. (2019). Displaying behavioral health measurement-based care data: Identifying key features from clinician and patient perspectives. Santa Monica, CA: RAND Corporation. https://www.rand.org/pubs/research_reports/RR3078.html
- Hooke, G. R., Sng, A. A. H., Cunningham, N. K., & Page, A. C. (2018). Methods of delivering progress feedback to optimise patient outcomes: The value of expected treatment trajectories. Cognitive Therapy and Research, 42(2), 204–211. https://doi.org/https://doi.org/10.1007/s10608-017-9851-z
- Hunsley, J. (2003). Introduction to the special section on incremental validity and utility in clinical assessment. Psychological Assessment, 15(4), 443–445. https://doi.org/https://doi.org/10.1037/1040-3590.15.4.443
- Hunsley, J., & Bailey, J. M. (1999). The clinical utility of the Rorschach: Unfulfilled promises and an uncertain future. Psychological Assessment, 11(3), 266–277. https://doi.org/https://doi.org/10.1037/1040-3590.11.3.266
- Hunsley, J., & Mash, E. J. (2007). Evidence-based assessment. Annual Review of Clinical Psychology, 3(1), 29–51. https://doi.org/https://doi.org/10.1146/annurev.clinpsy.3.022806.091419
- Ivers, N., Jamtvedt, G., Flottorp, S., Young, J. M., Odgaard-Jensen, J., French, S. D., O’Brien, M. A., Johansen, M., Grimshaw, J., & Oxman, A. D. (2012). Audit and feedback: Effects on professional practice and healthcare outcomes. The Cochrane Database of Systematic Reviews, 6, CD000259. https://doi.org/https://doi.org/10.1002/14651858.CD000259.pub3
- Jensen-Doss, A. J. (2005). Evidence-based diagnosis: Incorporating diagnostic instruments into clinical practice. Journal of the American Academy of Child and Adolescent Psychiatry, 44(9), 947–952. https://doi.org/https://doi.org/10.1097/01.chi.0000171903.16323.92
- Jensen-Doss, A., Douglas, S., Phillips, D. A., Gencdur, O., Zalman, A., & Gomez, N. E. (2020). Measurement-based care as a practice improvement tool: Clinical and organizational applications in youth mental health. Evidence-Based Practice in Child and Adolescent Mental Health, 5(3), 233–250. https://doi.org/https://doi.org/10.1080/23794925.2020.1784062
- The Joint Commission. (2018). Revised outcome measures standard for behavioral health care. R3 Report: Requirement, Rationale, Reference. https://www.jointcommission.org/assets/1/18/R3_Outcome_measures_1_30_18_FINAL.pdf
- Kamphuis, J. H., Noordhof, A., & Hopwood, C. J. (2021). When and how assessment matters: An update on the Treatment Utility of Clinical Assessment (TUCA). Psychological Assessment, 33(2), 122–132. https://doi.org/https://doi.org/10.1037/pas0000966
- Keeley, J. W., Reed, G. M., Roberts, M. C., Evans, S. C., Medina-Mora, M. E., Robles, R., Robello, T., Sharan, P., Gureje, O., First, M. B., Andrews, H., Ayuso-Mateos, J. L., Gaebel, W., Zielasek, J., & Saxena, S. (2016). Developing a science of clinical utility in diagnostic classification systems field study strategies for ICD-11 mental and behavioral disorders. American Psychologist, 71(1), 3–16. https://doi.org/https://doi.org/10.1037/a0039972
- Keesara, S., Jonas, A., & Schulman, K. (2020). Covid-19 and health care’s digital revolution. New England Journal of Medicine, 382(23), e82. https://doi.org/https://doi.org/10.1056/NEJMp2005835
- Kendell, R., & Jablensky, A. (2003). Distinguishing between the validity and utility of psychiatric diagnoses. The American Journal of Psychiatry, 160(1), 4–12. https://doi.org/https://doi.org/10.1176/appi.ajp.160.1.4
- Kendrick, T., El-Gohary, M., Stuart, B., Gilbody, S., Churchill, R., Aiken, L., Bhattacharya, A., Gimson, A., Brütt, A. L., de Jong, K., & Moore, M. (2016). Routine use of patient reported outcome measures (PROMs) for improving treatment of common mental health disorders in adults. Cochrane Database of Systematic Reviews, 13(7), CD011119. https://doi.org/https://doi.org/10.1002/14651858.CD011119.pub2
- Kilbourne, A. M., Beck, K., Spaeth-Rublee, B., Ramanuj, P., O’Brien, R. W., Tomoyasu, N., & Pincus, H. A. (2018). Measuring and improving the quality of mental health care: A global perspective. World Psychiatry, 17(1), 30–38. https://doi.org/https://doi.org/10.1002/wps.20482
- Lambert, M. J., Whipple, J. L., Bishop, M. J., Vermeersch, D. A., Gray, G. V., & Finch, A. E. (2002). Comparison of empirically-derived and rationally-derived methods for identifying patients at risk for treatment failure. Clinical Psychology & Psychotherapy, 9(3), 149–164. https://doi.org/https://doi.org/10.1002/cpp.333
- Last, B. S., Buttenheim, A. M., Timon, C. E., Mitra, N., & Beidas, R. S. (2021). Systematic review of clinician-directed nudges in healthcare contexts. BMJ Open, 11(7), e048801. https://doi.org/https://doi.org/10.1136/bmjopen-2021-048801
- Lewin, S., Hendry, M., Chandler, J., Oxman, A. D., Michie, S., Shepperd, S., Reeves, B. C., Tugwell, P., Hannes, K., Rehfuess, E. A., Welch, V., Mckenzie, J. E., Burford, B., Petkovic, J., Anderson, L. M., Harris, J., & Noyes, J. (2017). Assessing the complexity of interventions within systematic reviews: Development, content and use of a new tool (iCAT_SR). BMC Medical Research Methodology, 17(1), 76. https://doi.org/https://doi.org/10.1186/s12874-017-0349-x
- Lewis, C. C., Boyd, M., Puspitasari, A., Navarro, E., Howard, J., Kassab, H., Hoffman, M., Scott, K., Lyon, A., Douglas, S., Simon, G., & Kroenke, K. (2019). Implementing measurement-based care in behavioral health: A review. JAMA Psychiatry, 76(3), 324–335. https://doi.org/https://doi.org/10.1001/jamapsychiatry.2018.3329
- Lewis, C. C., Boyd, M. R., Walsh-Bailey, C., Lyon, A. R., Beidas, R., Mittman, B., Aarons, G. A., Weiner, B. J., & Chambers, D. A. (2020). A systematic review of empirical studies examining mechanisms of implementation in health. Implementation Science, 15(1), 1–25. https://doi.org/https://doi.org/10.1186/s13012-020-00983-3
- Lewis, C. C., Scott, K., Marti, C. N., Marriott, B. R., Kroenke, K., Putz, J. W., Mendel, P., & Rutkowski, D. (2015). Implementing measurement-based care (iMBC) for depression in community mental health: A dynamic cluster randomized trial study protocol. Implementation Science, 10(1), 127. https://doi.org/https://doi.org/10.1186/s13012-015-0313-2
- Lund, A. (2001). Measuring usability with the USE questionnaire. Usability Interface, 8, 3–6.
- Lyon, A. R., Dopp, A. R., Brewer, S. K., Kientz, J. A., & Munson, S. A. (2020). Designing the future of children’s mental health services. Administration and Policy in Mental Health and Mental Health Services Research, 47(5), 735–751. https://doi.org/https://doi.org/10.1007/s10488-020-01038-x
- Lyon, A. R., Koerner, K., & Chung, J. (2020). Usability Evaluation for Evidence-Based Psychosocial Interventions (USE-EBPI): A methodology for assessing complex intervention implementability. Implementation Research and Practice, 1, 2633489520932924. https://doi.org/https://doi.org/10.1177/2633489520932924
- Lyon, A. R., Lewis, C. C., Boyd, M. R., Hendrix, E., & Liu, F. (2016). Capabilities and characteristics of digital measurement feedback systems: Results from a comprehensive review. Administration and Policy in Mental Health and Mental Health Services Research, 43(3), 441–466. https://doi.org/https://doi.org/10.1007/s10488-016-0719-4
- Lyon, A. R., Munson, S. A., Renn, B. N., Atkins, D. C., Pullmann, M. D., Friedman, E., & Areán, P. A. (2019). Use of human-centered design to improve implementation of evidence-based psychotherapies in low-resource communities: Protocol for studies applying a framework to assess usability. JMIR Research Protocols, 8(10), e14990. https://doi.org/https://doi.org/10.2196/14990
- Marangunić, N., & Granić, A. (2015). Technology acceptance model: A literature review from 1986 to 2013. Universal Access in the Information Society, 14(1), 81–95. https://doi.org/https://doi.org/10.1007/s10209-014-0348-1
- May, C. R., Cummings, A., Girling, M., Bracher, M., Mair, F. S., May, C. M., Murray, E., Myall, M., Rapley, T., & Finch, T. (2018). Using normalization process theory in feasibility studies and process evaluations of complex healthcare interventions: A systematic review. Implementation Science, 13(1), 80. https://doi.org/https://doi.org/10.1186/s13012-018-0758-1
- McLeod, B. D. (2011). The relation of the alliance with outcomes in youth psychotherapy: A meta-analysis. Clinical Psychology Review, 31(4), 603–616. https://doi.org/https://doi.org/10.1016/j.cpr.2011.02.001
- McLeod, B. D., Cook, C., Sutherland, K. S., Lyon, A. R., Dopp, A., Broda, M., & Beidas, R. S. (2021). A theory-informed approach to locally-managed learning school systems: Integrating treatment integrity and student outcome data to promote student mental health. School Mental Health. https://doi.org/https://doi.org/10.1007/s12310-021-09413-1
- McLeod, B. D., Cox, J. R., Jensen-Doss, A., Herschell, A., Ehrenreich-May, J., & Wood, J. J. (2018). Proposing a mechanistic model of training and consultation. Clinical Psychology: Science and Practice, 25(3), 1–19. https://doi.org/https://doi.org/10.1111/cpsp.12260
- McLeod, B. D., Jensen-Doss, A., & Ollendick, T. H. (2013). Case conceptualization, treatment planning and outcome monitoring. In B. D. McLeod, A. Jensen-Doss, & T. H. Ollendick (Eds.), Diagnostic and behavioral assessment in children and adolescents: A clinical guide (pp. 77–102). Guilford Publications, Inc.
- Milinkovic, M. S., & Tiliopoulos, N. (2020). A systematic review of the clinical utility of the DSM–5 section III alternative model of personality disorder. Personality Disorders: Theory, Research, and Treatment, 11(6), 377–397. https://doi.org/https://doi.org/10.1037/per0000408
- Mullins-Sweatt, S. N., Lengel, G. J., & DeShong, H. L. (2016). The importance of considering clinical utility in the construction of a diagnostic manual. Annual Review of Clinical Psychology, 12(1), 133–155. https://doi.org/https://doi.org/10.1146/annurev-clinpsy-021815-092954
- Norman, D. A., & Draper, S. W. (1986). User centered system design: New perspectives on human-computer interaction (1st ed.). CRC Press.
- Nugter, M. A., Hermens, M. L. M., Robbers, S., Son, G. V., Theunissen, J., & Engelsbel, F. (2019). Use of outcome measurements in clinical practice: How specific should one be? Psychotherapy Research, 29(4), 432–444. https://doi.org/https://doi.org/10.1080/10503307.2017.1408975
- Page, A. C., Camacho, K. S., & Page, J. T. (2019). Delivering cognitive behaviour therapy informed by a contemporary framework of psychotherapy treatment selection and adaptation. Psychotherapy Research, 29(8), 971–973. https://doi.org/https://doi.org/10.1080/10503307.2019.1662510
- Parikh, A., Fristad, M. A., Axelson, D., & Krishna, R. (2020). Evidence based for measurement-based care in child and adolescent psychiatry. Child and Adolescent Psychiatric Clinics of North America, 29(4), 587–599. https://doi.org/https://doi.org/10.1016/j.chc.2020.06.001
- Patel, M. S., Navathe, A. S., & Liao, J. M. (2020). Using nudges to improve value by increasing imaging-based cancer screening. Journal of the American College of Radiology, 17(1), 38–41. https://doi.org/https://doi.org/10.1016/j.jacr.2019.08.025
- Peterson, A. P., & Fagan, C. (2021). Improving measurement feedback systems for measurement-based care. Psychotherapy Research, 31(2), 184–199. https://doi.org/https://doi.org/10.1080/10503307.2020.1823031
- Proctor, E. K., Powell, B. J., & McMillen, J. C. (2013). Implementation strategies: Recommendations for specifying and reporting. Implementation Science, 8(1), 139. https://doi.org/https://doi.org/10.1186/1748-5908-8-139
- Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., Griffey, R., & Hensley, M. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services Research, 38(2), 65–76. https://doi.org/https://doi.org/10.1007/s10488-010-0319-7
- Reed, G. M. (2010). Toward ICD-11: Improving the clinical utility of WHO’s international classification of mental disorders. Professional Psychology: Research and Practice, 41(6), 457–464. https://doi.org/https://doi.org/10.1037/a0021701
- Reed, G. M., Roberts, M. C., Keeley, J., Hooppell, C., Matsumoto, C., Sharan, P., Robles, R., Carvalho, H., Wu, C., Gureje, O., Leal-Leturia, I., Flanagan, E., Mendonça Correia, J., Maruta, T., Ayuso-Mateos, J. L., Mari, J. D. J., Xiao, Z., Evans, S. C., Saxena, S., & Medina-Mora, M. E. (2013). Mental health professionals’ natural taxonomies of mental disorders: Implications for the clinical utility of the ICD-11 and the DSM–5. Journal of Clinical Psychology, 69(12), 1191–1212. https://doi.org/https://doi.org/10.1002/jclp.22031
- Riemer, M., & Bickman, L. (2011). Using program theory to link social psychology and program evaluation. In M. M. Mark, S. I. Donaldson, & B. Campbell (Eds.), Social Psychology and Evaluation (pp. 102–139). Guilford Press.
- Roberts, M. C., Reed, G. M., Medina-Mora, M. E., Keeley, J. W., Sharan, P., Johnson, D. K., Mari, J. D. J., Ayuso-Mateos, J. L., Gureje, O., Xiao, Z., Maruta, T., Khoury, B., Robles, R., & Saxena, S. (2012). A global clinicians’ map of mental disorders to improve ICD-11: Analysing meta-structure to enhance clinical utility. International Review of Psychiatry, 24(6), 578–590. https://doi.org/https://doi.org/10.3109/09540261.2012.736368
- Scott, K., & Lewis, C. C. (2015). Using measurement-based care to enhance any treatment. Cognitive and Behavioral Practice, 22(1), 49–59. https://doi.org/https://doi.org/10.1016/j.cbpra.2014.01.010
- Slade, K., Lambert, M. J., Harmon, S. C., Smart, D. W., & Bailey, R. (2008). Improving psychotherapy outcome: The use of immediate electronic feedback and revised clinical support tools. Clinical Psychology & Psychotherapy: An International Journal of Theory & Practice, 15(5), 287–303. https://doi.org/https://doi.org/10.1002/cpp.594
- Stewart, R. E., Mandell, D. S., & Beidas, R. S. (2021). Lessons From Maslow: Prioritizing funding to improve the quality of community mental health and substance use services. Psychiatric Services, 72(10), 1219–1221. https://doi.org/https://doi.org/10.1176/appi.ps.202000209
- Tam, H. E., & Ronan, K. (2017). The application of a feedback-informed approach in psychological service with youth: Systematic review and meta-analysis. Clinical Psychology Review, 55, 41–55. https://doi.org/https://doi.org/10.1016/j.cpr.2017.04.005
- Umscheid, C. A. (2010). Maximizing the clinical utility of comparative effectiveness research. Clinical Pharmacology and Therapeutics, 88(6), 876–879. https://doi.org/https://doi.org/10.1038/clpt.2010.200
- Yates, B. T., & Taub, J. (2003). Assessing the costs, benefits, cost-effectiveness, and cost-benefit of psychological assessment: We should, we can, and here’s how. Psychological Assessment, 15(4), 478–495. https://doi.org/https://doi.org/10.1037/1040-3590.15.4.478
- Youngstrom, E. (2008). Evidence-based strategies for the assessment of developmental psychopathology: Measuring prediction, prescription, and process. In W. E. Craighead, D. J. Miklowitz, & L. W. Craighead (Eds.), Psychopathology: History, diagnosis, and empirical foundations (pp. 34–77). John Wiley & Sons Inc.