The Therapy Progress Scale: Evaluating Psychometric Properties in an Outpatient Sample of Clients in Private Practice

References

• APA Presidential Task Force on Evidence-Based Practice. (2006). Evidence-based practice in psychology. The American Psychologist, 61(4), 271–285. https://doi.org/10.1037/0003-066X.61.4.271
   PubMed Web of Science ®Google Scholar
• Anker, M. G., Duncan, B. L., & Sparks, J. A. (2009). Using client feedback to improve couple therapy outcomes: A randomized clinical trial in a naturalistic setting. Journal of Consulting and Clinical Psychology, 77(4), 693–704. https://doi.org/10.1037/a0016062
   PubMed Web of Science ®Google Scholar
• Barkham, M., Lutz, W., & Castonguay, L. G. (2021). Bergin and Garfield’s handbook of psychotherapy and behavior change. Psychotherapie, Psychosomatik, Medizinische Psychologie, 72(1), 7–8. https://doi.org/10.1055/a-1686-4682
   Google Scholar
• Barlow, D. H., Farchione, T. J., Bullis, J. R., Gallagher, M. W., Murray-Latin, H., Sauer-Zavala, S., Bentley, K. H., Thompson-Hollands, J., Conklin, L. R., Boswell, J. F., Ametaj, A., Carl, J. R., Boettcher, H. T., & Cassiello-Robbins, C. (2017). The unified protocol for transdiagnostic treatment of emotional disorders compared with diagnosis-specific protocols for anxiety disorders: A randomized clinical trial. JAMA Psychiatry, 74(9), 875–884. https://doi.org/10.1001/jamapsychiatry.2017.2164
   PubMed Web of Science ®Google Scholar
• Boswell, J. F., Hepner, K. A., Lysell, K., Rothrock, N. E., Bott, N., Childs, A. W., Douglas, S., Owings-Fonner, N., Wright, C. V., Stephens, K. A., Bard, D. E., Aajmain, S., & Bobbitt, B. L. (2023). The need for a measurement-based care professional practice guideline. Psychotherapy, 60(1), 1–16. https://doi.org/10.1037/pst0000439
   PubMed Web of Science ®Google Scholar
• Boswell, J. F., Kraus, D. R., Castonguay, L. G., & Youn, S. J. (2015). Treatment outcome package: Measuring and facilitating multidimensional change. Psychotherapy, 52(4), 422–431. https://doi.org/10.1037/pst0000028
   PubMed Web of Science ®Google Scholar
• Bugatti, M., & Boswell, J. F. (2022). Clinician perceptions of nomothetic and individualized patient-reported outcome measures in measurement-based care. Psychotherapy Research: Journal of the Society for Psychotherapy Research, 32(7), 898–909. https://doi.org/10.1080/10503307.2022.2030497
   PubMed Web of Science ®Google Scholar
• Chen, F. F. (2007). Sensitivity of goodness of fit indices to lack of measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14(3), 464–504. https://doi.org/10.1080/10705510701301834
   Web of Science ®Google Scholar
• Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 9(2), 233–255. https://doi.org/10.1207/S15328007SEM0902_5
   Web of Science ®Google Scholar
• Coleman, J. J., Dong, Y., Dumas, D., Owen, J., & Kopta, M. (2022). Longitudinal measurement invariance of the Behavioral Health Measure in a clinical sample. Journal of Counseling Psychology, 69(1), 100–110. https://doi.org/10.1037/cou0000524
   PubMed Web of Science ®Google Scholar
• de Jong, K., Conijn, J. M., Gallagher, R. A., Reshetnikova, A. S., Heij, M., & Lutz, M. C. (2021). Using progress feedback to improve outcomes and reduce drop-out, treatment duration, and deterioration: A multilevel meta-analysis. Clinical Psychology Review, 85, 102002. https://doi.org/10.1016/j.cpr.2021.102002
   PubMed Web of Science ®Google Scholar
• Dong, Y., & Dumas, D. (2020). Are personality measures valid for different populations? A systematic review of measurement invariance across cultures, gender, and age. Personality and Individual Differences, 160, 109956. https://doi.org/10.1016/j.paid.2020.109956
   Web of Science ®Google Scholar
• Drinane, J. M., Owen, J., & Kopta, S. M. (2016). Racial/ethnic disparities in psychotherapy: Does the outcome matter? Testing, Psychometrics, and Methodology in Applied Psychology, 23(4), 531–544. https://doi.org/10.4473/TPM23.4.7
   Google Scholar
• Dumas, D., & Dong, Y. (2019). Development and calibration of the student opportunities for deeper learning instrument. Psychology in the Schools, 56(9), 1381–1412. https://doi.org/10.1002/pits.22292
   Web of Science ®Google Scholar
• Hancock, G. R., & Mueller, R. O. (2001). Rethinking construct reliability within latent variable systems. In R. Cudeck, S. du Toit, & D. Sörbom (Eds.), Structural equation modeling: Present and future—A festschrift in honor of Karl Jöreskog (pp. 195–216). Scientific Software International.
   Google Scholar
• Hatcher, R. L., & Barends, A. W. (1996). Patients’ view of the alliance in psychotherapy: Exploratory factor analysis of three alliance measures. Journal of Consulting and Clinical Psychology, 64(6), 1326–1336. https://doi.org/10.1037/0022-006X.64.6.1326
   PubMed Web of Science ®Google Scholar
• Hatfield, D. R., & Ogles, B. M. (2004). The use of outcome measures by psychologists in clinical practice. Professional Psychology: Research and Practice, 35(5), 485–491. https://doi.org/10.1037/0735-7028.35.5.485
   Web of Science ®Google Scholar
• Hatfield, D. R., & Ogles, B. M. (2007). Why some clinicians use outcome measures and others do not. Administration and Policy in Mental Health, 34(3), 283–291. https://doi.org/10.1007/s10488-006-0110-y
   PubMed Web of Science ®Google Scholar
• Hayes, J. A., McAleavey, A. A., Castonguay, L. G., & Locke, B. D. (2016). Psychotherapists’ outcomes with White and racial/ethnic minority clients: First, the good news. Journal of Counseling Psychology, 63(3), 261–268. https://doi.org/10.1037/cou0000098
   PubMed Web of Science ®Google Scholar
• Howard, G. S., Millham, J., Slaten, S., & O’donnell, L. (1981). Influence of subject response style effects on retrospective measures. Applied Psychological Measurement, 5(1), 89–100. https://doi.org/10.1177/014662168100500113
   Web of Science ®Google Scholar
• Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
   Web of Science ®Google Scholar
• Imel, Z. E., Baldwin, S., Atkins, D. C., Owen, J., Baardseth, T., & Wampold, B. E. (2011). Racial/ethnic disparities in therapist effectiveness: A conceptualization and initial study of cultural competence. Journal of Counseling Psychology, 58(3), 290–298. https://doi.org/10.1037/a0023284
   PubMed Web of Science ®Google Scholar
• Ionita, G., & Fitzpatrick, M. (2014). Bringing science to clinical practice: A Canadian survey of psychological practice and usage of progress monitoring measures. Canadian Psychology / Psychologie Canadienne, 55(3), 187–196. https://doi.org/10.1037/a0037355
   Web of Science ®Google Scholar
• Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59(1), 12–19. https://doi.org/10.1037//0022-006x.59.1.12
   PubMed Web of Science ®Google Scholar
• Jensen-Doss, A., Haimes, E. M. B., Smith, A. M., Lyon, A. R., Lewis, C. C., Stanick, C. F., & Hawley, K. M. (2018). Monitoring treatment progress and providing feedback is viewed favorably but rarely used in practice. Administration and Policy in Mental Health, 45(1), 48–61. https://doi.org/10.1007/s10488-016-0763-0
   PubMed Web of Science ®Google Scholar
• Jensen-Doss, A., Smith, A. M., Becker-Haimes, E. M., Mora Ringle, V., Walsh, L. M., Nanda, M., Walsh, S. L., Maxwell, C. A., & Lyon, A. R. (2018). Individualized progress measures are more acceptable to clinicians than standardized measures: Results of a national survey. Administration and Policy in Mental Health, 45(3), 392–403. https://doi.org/10.1007/s10488-017-0833-y
   PubMed Web of Science ®Google Scholar
• Johansson, R., Hesser, H., Ljótsson, B., Frederick, R. J., & Andersson, G. (2012). Transdiagnostic, affect-focused, psychodynamic, guided self-help for depression and anxiety through the internet: Study protocol for a randomised controlled trial. BMJ Open, 2(6), e002167. https://doi.org/10.1136/bmjopen-2012-002167
   PubMed Web of Science ®Google Scholar
• Kopta, M., Owen, J., & Budge, S. (2015). Measuring psychotherapy outcomes with the behavioral health measure–20: Efficient and comprehensive. Psychotherapy, 52(4), 442–448. https://doi.org/10.1037/pst0000035
   PubMed Web of Science ®Google Scholar
• Kroenke, K., Spitzer, R. L., & Williams, J. B. (2001). The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine, 16(9), 606–613. https://doi.org/10.1046/j.1525-1497.2001.016009606.x
   PubMed Web of Science ®Google Scholar
• Lambert, M. J., Whipple, J. L., & Kleinstäuber, M. (2018). Collecting and delivering progress feedback: A meta-analysis of routine outcome monitoring. Psychotherapy, 55(4), 520–537. https://doi.org/10.1037/pst0000167
   PubMed Web of Science ®Google Scholar
• Lewis, C. C., Boyd, M., Puspitasari, A., Navarro, E., Howard, J., Kassab, H., Hoffman, M., Scott, K., Lyon, A., Douglas, S., Simon, G., & Kroenke, K. (2019). Implementing measurement-based care in behavioral health: A review. JAMA Psychiatry, 76(3), 324–335. https://doi.org/10.1001/jamapsychiatry.2018.3329
   PubMed Web of Science ®Google Scholar
• Marsh, H. W. (2007). Application of confirmatory factor analysis and structural equation modeling in sport/exercise psychology. In G. Tenenbaum & R. C. Eklund (Eds.), Handbook of sport psychology (3rd ed., pp. 774–798). Wiley. https://doi.org/10.1002/9781118270011.ch35
   Google Scholar
• McNeish, D. (2018). Thanks coefficient alpha, we’ll take it from here. Psychological Methods, 23(3), 412–433. https://doi.org/10.1037/met0000144
   PubMed Web of Science ®Google Scholar
• Meade, A. W., & Lautenschlager, G. J. (2004). A comparison of item response theory and confirmatory factor analytic methodologies for establishing measurement equivalence/lnvariance. Organizational Research Methods, 7(4), 361–388. https://doi.org/10.1177/1094428104268027
   Web of Science ®Google Scholar
• Miller, S. D., Duncan, B. L., Brown, J., Sparks, J. A., & Claud, D. A. (2003). The outcome rating scale: A preliminary study of the reliability, validity, and feasibility of a brief visual analog measure. Journal of Brief Therapy, 2(2), 91–100.
   Google Scholar
• Millsap, R. E., & Olivera-Aguilar, M. (2012). Investigating measurement invariance using confirmatory factor analysis. In R. H. Hoyle (Ed.), Handbook of structural equation modeling (pp. 380–392). The Guilford Press.
   Google Scholar
• Moore, J., & Owen, J. (2014). Assessing outcomes: Practical methods and evidence. Journal of College Counseling, 17(2), 175–185. https://doi.org/10.1002/j.2161-1882.2014.00056.x
   Google Scholar
• Muthén, L. K., & Muthén, B. O. (2017). Mplus user’s guide. Muthén & Muthén.
   Google Scholar
• Norcross, J. C., & Rogan, J. D. (2013). Psychologists conducting psychotherapy in 2012: Current practices and historical trends among division 29 members. Psychotherapy, 50(4), 490–495. https://doi.org/10.1037/a0033512
   PubMed Web of Science ®Google Scholar
• Owen, J., Coleman, J., Drinane, J., Tao, K., Imel, Z., Wampold, B., & Kopta, M. (2021). Psychotherapy racial/ethnic disparities in treatment outcomes: The role of university racial/ethnic composition. Journal of Counseling Psychology, 68(4), 418–424. https://doi.org/10.1037/cou0000548
   PubMed Web of Science ®Google Scholar
• Owen, J., Leach, M. M., Wampold, B., & Rodolfa, E. (2011). Multicultural approaches in psychotherapy: A rejoinder. Journal of Counseling Psychology, 58(1), 22–26. https://doi.org/10.1037/a0022222
   Web of Science ®Google Scholar
• Owen, J., Wong, Y. J., & Rodolfa, E. (2009). Empirical search for psychotherapists’ gender competence in psychotherapy. Psychotherapy, 46(4), 448–458. https://doi.org/10.1037/a0017958
   PubMed Web of Science ®Google Scholar
• Rapkin, B. D., & Schwartz, C. E. (2004). Toward a theoretical model of quality-of-life appraisal: Implications of findings from studies of response shift. Health and Quality of Life Outcomes, 2(1), 14. https://doi.org/10.1186/1477-7525-2-14
   PubMedGoogle Scholar
• Reese, R. J., Slone, N. C., & Miserocchi, K. M. (2013). Using client feedback in psychotherapy from an interpersonal process perspective. Psychotherapy, 50(3), 288–291. https://doi.org/10.1037/a0032522
   PubMed Web of Science ®Google Scholar
• Seidel, J. A., Andrews, W. P., Owen, J., Miller, S. D., & Buccino, D. L. (2017). Preliminary validation of the Rating of Outcome Scale and equivalence of ultra-brief measures of well-being. Psychological Assessment, 29(1), 65–75. https://doi.org/10.1037/pas0000311
   PubMed Web of Science ®Google Scholar
• Shadish, W. R., Navarro, A. M., Matt, G. E., & Phillips, G. (2000). The effects of psychological therapies under clinically representative conditions: A meta-analysis. Psychological Bulletin, 126(4), 512–529. https://doi.org/10.1037/0033-2909.126.4.512
   PubMed Web of Science ®Google Scholar
• Spitzer, R. L., Kroenke, K., Williams, J. B., & Löwe, B. (2006). A brief measure for assessing generalized anxiety disorder: The GAD-7. Archives of Internal Medicine, 166(10), 1092–1097. https://doi.org/10.1001/archinte.166.10.1092
   PubMed Web of Science ®Google Scholar
• Wainer, H., & Thissen, D. (2001). True score theory: The traditional method. In D. Thissen & H. Wainer (Eds.), Test scoring (pp. 23–72). Lawrence Erlbaum Associates.
   Google Scholar
• Wampold, B. E., & Imel, Z. E. (2015). The great psychotherapy debate: The evidence for what makes psychotherapy work. Routledge.
   Google Scholar