The therapeutic alliance as an indicator of well-implemented and impactful employee counseling services: Deployment of the Brief Therapeutic Alliance Scale in an employee assistance program

References

• Ardito, R. B., & Rabellino, D. (2011). Therapeutic alliance and outcome of psychotherapy: Historical excursus, measurements, and prospects for research. Frontiers in Psychology, 2, 270.
   PubMed Web of Science ®Google Scholar
• Attridge, M. (2012). Employee assistance programs: Evidence and current trends. In Handbook of occupational health and wellness (pp. 441–467). New York, United States: Springer.
   Google Scholar
• Attridge, M. (2016). EAP industry outcomes for employee absenteeism and presenteeism: A global research analysis. Presented at the World Conference of the Employee Assistance Professionals Association (EAPA), Chicago, IL.
   Google Scholar
• Attridge, M., Cahill, T., Granberry, S. W., & Herlihy, P. A. (2013). The National Behavioral Consortium industry profile of external EAP vendors. Journal of Workplace Behavioral Health, 28(4), 251–324. doi:10.1080/15555240.2013.845050
   Google Scholar
• Attridge, M., & Dickens, S. P. (2021). Onsite screening and enhanced EAP counseling improves overall health, depression, and work outcomes: Four-wave longitudinal pilot study at a community health center in Vermont. Journal of Workplace Behavioral Health, 36(4), 278–308. doi:10.1080/15555240.2021.1971537
   Web of Science ®Google Scholar
• Attridge, M., Sharar, D. A., DeLapp, G. P., & Veder, B. (2018). EAP works: Global results from 24,363 counseling cases with pre-post data on the workplace outcome suite (WOS). International Journal of Health & Productivity, 10(2), 7–27.
   Google Scholar
• Bachelor, A., Meunier, G., Laverdiére, O., & Gamache, D. (2010). Client attachment to therapist: Relation to client personality and symptomatology, and their contributions to the therapeutic alliance. Psychotherapy: Theory, Research, Practice, Training, 47(4), 454–468. doi:10.1037/a0022079
   PubMed Web of Science ®Google Scholar
• Baier, A. L., Kline, A. C., & Feeny, N. C. (2020). Therapeutic alliance as a mediator of change: A systematic review and evaluation of research. Clinical Psychology Review, 82, 101921.
   PubMed Web of Science ®Google Scholar
• Bartram, M., Atanackovic, J., Runnels, V., Bourgeault, I. L., Fournier, C., Kovacina, N., … Renaud, A. (2020). Applying gender-based analysis plus to employee assistance programs: A Canadian perspective. Journal of Workplace Behavioral Health, 35(2), 80–99. doi:10.1080/15555240.2020.1726773
   Web of Science ®Google Scholar
• Bland, J. M., & Altman, D. G. (1997). Statistics notes: Cronbach’s alpha. BMJ, 314(7080), 572–572. doi:10.1136/bmj.314.7080.572
   PubMed Web of Science ®Google Scholar
• Cameron, S. K., Rodgers, J., & Dagnan, D. (2018). The relationship between the therapeutic alliance and clinical outcomes in cognitive behaviour therapy for adults with depression: A meta‐analytic review. Clinical Psychology & Psychotherapy, 25(3), 446–456.
   PubMed Web of Science ®Google Scholar
• Carroll, C., Patterson, M., Wood, S., Booth, A., Rick, J., & Balain, S. (2007). A conceptual framework for implementation fidelity. Implementation Science, 2(1), 1–9. doi:10.1186/1748-5908-2-40
   PubMed Web of Science ®Google Scholar
• Castro-Schilo, L., & Grimm, K. J. (2018). Using residualized change versus difference scores for longitudinal research. Journal of Social and Personal Relationships, 35(1), 32–58. doi:10.1177/0265407517718387
   Web of Science ®Google Scholar
• Cliff, N. (1988). The eigenvalues-greater-than-one rule and the reliability of components. Psychological Bulletin, 103(2), 276–279. doi:10.1037/0033-2909.103.2.276
   Web of Science ®Google Scholar
• Crits-Christoph, P., Gibbons, M. B. C., & Hearon, B. (2006). Does the alliance cause good outcome? Recommendations for future research on the alliance. Psychotherapy: Theory, Research, Practice, Training, 43(3), 280–285. doi:10.1037/0033-3204.43.3.280
   PubMed Web of Science ®Google Scholar
• Csiernik, R., Cavell, M., & Csiernik, B. (2021). EAP evaluation 2010–2019: What do we now know? Journal of Workplace Behavioral Health, 36(2), 105–124. doi:10.1080/15555240.2021.1902336
   Web of Science ®Google Scholar
• Csiernik, R., Chaulk, P., & McQuaid, S. (2012). A process evaluation of a Canadian public sector employee assistance program. Journal of Workplace Behavioral Health, 27(3), 160–180. doi:10.1080/15555240.2012.701169
   Google Scholar
• Dane, A. V., & Schneider, B. H. (1998). Program integrity in primary and early secondary prevention: Are implementation effects out of control? Clinical Psychology Review, 18(1), 23–45.
   PubMed Web of Science ®Google Scholar
• de Leeuw, R. R., de Boer, A. A., & Minnaert, A. E. (2020). The proof of the intervention is in the implementation; a systematic review about implementation fidelity of classroom-based interventions facilitating social participation of students with social-emotional problems or behavioural difficulties. International Journal of Educational Research Open, 1, 100002. doi:10.1016/j.ijedro.2020.100002
   Google Scholar
• de Roten, Y., Fischer, M., Drapeau, M., Beretta, V., Kramer, U., Favre, N., & Despland, J. N. (2004). Is one assessment enough? Patterns of helping alliance development and outcome. Clinical Psychology & Psychotherapy, 11(5), 324–331.
   Web of Science ®Google Scholar
• Del Re, A. C., Flückiger, C., Horvath, A. O., Symonds, D., & Wampold, B. E. (2012). Therapist effects in the therapeutic alliance–outcome relationship: A restricted-maximum likelihood meta-analysis. Clinical Psychology Review, 32(7), 642–649.
   PubMed Web of Science ®Google Scholar
• Delgadillo, J., de Jong, K., Lucock, M., Lutz, W., Rubel, J., Gilbody, S., … Nevin, J. (2018). Feedback-informed treatment versus usual psychological treatment for depression and anxiety: A multisite, open-label, cluster randomised controlled trial. The Lancet. Psychiatry, 5(7), 564–572. doi:10.1016/S2215-0366(18)30162-7
   PubMed Web of Science ®Google Scholar
• Dimitrov, D. M., & Rumrill, P. D. Jr, (2003). Pretest-posttest designs and measurement of change. Work, 20(2), 159–165.
   PubMedGoogle Scholar
• Dusenbury, L., Brannigan, R., Falco, M., & Hansen, W. B. (2003). A review of research on fidelity of implementation: Implications for drug abuse prevention in school settings. Health Education Research, 18(2), 237–256. doi:10.1093/her/18.2.237
   PubMed Web of Science ®Google Scholar
• Elvins, R., & Green, J. (2008). The conceptualization and measurement of therapeutic alliance: An empirical review. Clinical Psychology Review, 28(7), 1167–1187.
   PubMed Web of Science ®Google Scholar
• Fonagy, P., & Luyten, P. (2019). Fidelity vs. flexibility in the implementation of psychotherapies: Time to move on. World Psychiatry, 18(3), 270–271.
   PubMed Web of Science ®Google Scholar
• Gaston, L., & Charles, R. (1994). The California Psychotherapy Alliance Scales. The Working Alliance: Theory, Research, and Practice, 173, 85.
   Google Scholar
• Hattie, J. (1985). Methodology review: Assessing unidimensionality of tests and items. Applied Psychological Measurement, 9(2), 139–164. doi:10.1177/014662168500900204
   Web of Science ®Google Scholar
• Havermans, B. M., Schlevis, R. M., Boot, C. R., Brouwers, E. P., Anema, J., & van der Beek, A. J. (2016). Process variables in organizational stress management intervention evaluation research: A systematic review. Scandinavian Journal of Work, Environment & Health, 42(5), 371–381. doi:10.5271/sjweh.3570
   PubMed Web of Science ®Google Scholar
• Hayes, A. F. (2017). Introduction to mediation, moderation, and conditional process analysis: A regression-based approach. New York, United States: Guilford publications.
   Google Scholar
• Horvath, A., Gaston, L., & Luborsky, L. (1993). The therapeutic alliance and its measures. In N. E. Miller, L. Luborsky, J. P. Barber, & J. P. Docherty (Eds.), Psychodynamic treatment research: A handbook for clinical practice (pp. 247–273). Basic Books.
   Google Scholar
• Horvath, A. O., Del Re, A., Flückiger, C., & Symonds, D. (2011). Alliance in individual psychotherapy. Psychotherapy (Chic), 48(1), 9–16. doi: 10.1037/a0022186
   Google Scholar
• Hosmer, D. W., Jr, Lemeshow, S., & Sturdivant, R. X. (2013). Applied logistic regression (vol. 398). Hoboken, New Jersey: John Wiley & Sons.
   Google Scholar
• Joseph, B., Walker, A., & Fuller-Tyszkiewicz, M. (2018). Evaluating the effectiveness of employee assistance programmes: A systematic review. European Journal of Work and Organizational Psychology, 27(1), 1–15. doi:10.1080/1359432X.2017.1374245
   Web of Science ®Google Scholar
• Kazdin, A. E. (2007). Mediators and mechanisms of change in psychotherapy research. Annual Review of Clinical Psychology, 3, 1–27. doi:10.1146/annurev.clinpsy.3.022806.091432
   PubMed Web of Science ®Google Scholar
• Kazdin, A. E., & Nock, M. K. (2003). Delineating mechanisms of change in child and adolescent therapy: Methodological issues and research recommendations. Journal of Child Psychology and Psychiatry, and Allied Disciplines, 44(8), 1116–1129.
   PubMed Web of Science ®Google Scholar
• Kirk, A. K., & Brown, D. F. (2003). Employee assistance programs: A review of the management of stress and wellbeing through workplace counselling and consulting. Australian Psychologist, 38(2), 138–143. doi:10.1080/00050060310001707137
   Web of Science ®Google Scholar
• Klein, D. N., Schwartz, J. E., Santiago, N. J., Vivian, D., Vocisano, C., Castonguay, L. G., … Markowitz, J. C. (2003). Therapeutic alliance in depression treatment: Controlling for prior change and patient characteristics. Journal of Consulting and Clinical Psychology, 71(6), 997–1006.
   PubMed Web of Science ®Google Scholar
• Kristensen, T. S. (2005). Intervention studies in occupational epidemiology. Occupational and Environmental Medicine, 62(3), 205–210. doi:10.1136/oem.2004.016097
   PubMed Web of Science ®Google Scholar
• Laurenceau, J.-P., Hayes, A. M., & Feldman, G. C. (2007). Some methodological and statistical issues in the study of change processes in psychotherapy. Clinical Psychology Review, 27(6), 682–695. doi:10.1016/j.cpr.2007.01.007
   PubMed Web of Science ®Google Scholar
• Lennox, R. D., Sharar, D., Schmitz, E., & Goehner, D. B. (2018). Validation of the 5-item short form version of the Workplace Outcome Suite©. International Journal of Health & Productivity, 10(2), 49–61.
   Google Scholar
• Lennox, R. D., Sharar, D., Schmitz, E., & Goehner, D. B. (2010). Development and validation of the chestnut global partners workplace outcome suite. Journal of Workplace Behavioral Health, 25(2), 107–131. doi:10.1080/15555241003760995
   Google Scholar
• Löwe, B., Kroenke, K., & Gräfe, K. (2005). Detecting and monitoring depression with a two-item questionnaire (PHQ-2). Journal of Psychosomatic Research, 58(2), 163–171.
   PubMed Web of Science ®Google Scholar
• Mallinckrodt, B., Gantt, D. L., & Coble, H. M. (1995). Attachment patterns in the psychotherapy relationship: Development of the Client Attachment to Therapist Scale. Journal of Counseling Psychology, 42(3), 307–317. doi:10.1037/0022-0167.42.3.307
   Web of Science ®Google Scholar
• Mallinckrodt, B., & Jeong, J. (2015). Meta-analysis of client attachment to therapist: Associations with working alliance and client pretherapy attachment. Psychotherapy, 52(1), 134–139. doi:10.1037/a0036890
   PubMed Web of Science ®Google Scholar
• Martin, D. J., Garske, J. P., & Davis, M. K. (2000). Relation of the therapeutic alliance with outcome and other variables: A meta-analytic review. Journal of Consulting and Clinical Psychology, 68(3), 438–450.
   PubMed Web of Science ®Google Scholar
• Marziali, E., Marmar, C., & Krupnick, J. (1981). Therapeutic Alliance Scales: Development and relationship to psychotherapy outcome. The American Journal of Psychiatry, 138(3), 361–364. doi:10.1176/ajp.138.3.361.
   PubMed Web of Science ®Google Scholar
• Miller, S. D., Hubble, M. A., Chow, D., & Seidel, J. (2015). Beyond measures and monitoring: Realizing the potential of feedback-informed treatment. Psychotherapy, 52(4), 449–457.
   PubMed Web of Science ®Google Scholar
• Milot, M. (2017). Evaluating benefit equity in outcomes among users of an Employee Assistance Program. EASNA Research Notes, 6(1), 1–7.
   Google Scholar
• Milot, M. (2019). The impact of a Canadian external Employee Assistance Program on mental health and workplace functioning: Findings from a prospective quasi-experimental study. Journal of Workplace Behavioral Health, 34(3), 167–191. doi:10.1080/15555240.2019.1609978
   Web of Science ®Google Scholar
• Milot, M. (2020). Therapist aptitude metrics to optimize employee counseling delivery: An initial study of ImpactMetrix. Unpublished study, Workreach Lab.
   Google Scholar
• Milot, M. (2021). Initial validation of the Brief Therapeutic Alliance Scale in an employee assistance counseling setting. Unpublished study, Workreach Lab.
   Google Scholar
• Milot, M., & Borkenhagen, E. (2018). Job stress in users of an Employee Assistance Program and association with presenting status. Journal of Workplace Behavioral Health, 33(3–4), 153–167. doi:10.1080/15555240.2018.1502044
   Web of Science ®Google Scholar
• Moore, G. F., Audrey, S., Barker, M., Bond, L., Bonell, C., Hardeman, W., … Wight, D. (2015). Process evaluation of complex interventions: Medical Research Council guidance. BMJ, 350(6), h1258–h1258. doi:10.1136/bmj.h1258
   PubMed Web of Science ®Google Scholar
• Moore, T. G. (2016). Towards a model of evidence-informed decision making and service delivery. CCCH Working paper No. 5. Parkville, Victoria: Centre for Community Child Health, Murdoch Childrens Research Institute.
   Google Scholar
• Muran, J. C., & Barber, J. P. (2011). The therapeutic alliance: An evidence-based guide to practice. New York, United States: Guilford Press.
   Google Scholar
• Nielsen, K., & Abildgaard, J. S. (2013). Organizational interventions: A research-based framework for the evaluation of both process and effects. Work & Stress, 27(3), 278–297. doi:10.1080/02678373.2013.812358
   Web of Science ®Google Scholar
• Nielsen, K., & Randall, R. (2013). Opening the black box: Presenting a model for evaluating organizational-level interventions. European Journal of Work and Organizational Psychology, 22(5), 601–617. doi:10.1080/1359432X.2012.690556
   Web of Science ®Google Scholar
• Peterson, C., Stevenson, A., Hertlein, K. M., & Fife, S. (2010). Therapeutic alliance and client satisfaction from the client’s perspective. Graduate Research Symposium (GCUA) (2010–2017), 17.
   Google Scholar
• Priebe, S., & McCabe, R. (2006). The therapeutic relationship in psychiatric settings. Acta Psychiatrica Scandinavica, 113(s429), 69–72. doi:10.1111/j.1600-0447.2005.00721.x
   Web of Science ®Google Scholar
• Richardson, J. T. (2011). Eta squared and partial eta squared as measures of effect size in educational research. Educational Research Review, 6(2), 135–147. doi:10.1016/j.edurev.2010.12.001
   Web of Science ®Google Scholar
• Richmond, M. K., Pampel, F. C., Wood, R. C., & Nunes, A. P. (2016). Impact of employee assistance services on depression, anxiety, and risky alcohol use: A quasi-experimental study. Journal of Occupational and Environmental Medicine, 58(7), 641–650.
   PubMed Web of Science ®Google Scholar
• Richmond, M. K., Pampel, F. C., Wood, R. C., & Nunes, A. P. (2017). The impact of employee assistance services on workplace outcomes: Results of a prospective, quasi-experimental study. Journal of Occupational Health Psychology, 22(2), 170–179.
   PubMed Web of Science ®Google Scholar
• Rutherford, A. (2011). ANOVA and ANCOVA: A GLM approach. Hoboken, New Jersey: John Wiley & Sons.
   Google Scholar
• Safran, D. G., Taira, D. A., Rogers, W. H., Kosinski, M., Ware, J. E., & Tarlov, A. R. (1998). Linking primary care performance to outcomes of care. The Journal of Family Practice, 47(3), 213–220.
   PubMed Web of Science ®Google Scholar
• Saito, T., & Rehmsmeier, M. (2015). The precision-recall plot is more informative than the ROC plot when evaluating binary classifiers on imbalanced datasets. PLOS One, 10(3), e0118432. doi:10.1371/journal.pone.0118432
   PubMed Web of Science ®Google Scholar
• Sharf, J., Primavera, L. H., & Diener, M. J. (2010). Dropout and therapeutic alliance: A meta-analysis of adult individual psychotherapy. Psychotherapy, 47(4), 637–645. doi:10.1037/a0021175
   PubMed Web of Science ®Google Scholar
• Shi, D., DiStefano, C., Maydeu-Olivares, A., & Lee, T. (2022). Evaluating SEM model fit with small degrees of freedom. Multivariate Behavioral Research, 57(2–3), 179–207. doi:10.1080/00273171.2020.1868965.
   Web of Science ®Google Scholar
• Shrout, P. E., & Bolger, N. (2002). Mediation in experimental and nonexperimental studies: New procedures and recommendations. Psychological Methods, 7(4), 422–445.
   PubMed Web of Science ®Google Scholar
• Strauss, J. L., & Johnson, S. L. (2006). Role of treatment alliance in the clinical management of bipolar disorder: Stronger alliances prospectively predict fewer manic symptoms. Psychiatry Research, 145(2–3), 215–223.
   PubMed Web of Science ®Google Scholar
• Sweeney, A., Fahmy, S., Nolan, F., Morant, N., Fox, Z., Lloyd-Evans, B., … McCabe, R. (2014). The relationship between therapeutic alliance and service user satisfaction in mental health inpatient wards and crisis house alternatives: A cross-sectional study. PLOS One, 9(7), e100153. doi:10.1371/journal.pone.0100153
   PubMed Web of Science ®Google Scholar
• Tavakol, M., & Dennick, R. (2011). Making sense of Cronbach’s alpha. International Journal of Medical Education, 2, 53–55.
   PubMedGoogle Scholar
• Unal, I. (2017). Defining an optimal cut-point value in ROC analysis: An alternative approach. Computational and Mathematical Methods in Medicine, 2017, 1–14. doi:10.1155/2017/3762651
   Web of Science ®Google Scholar
• Webb, C. A., DeRubeis, R. J., Dimidjian, S., Hollon, S. D., Amsterdam, J. D., & Shelton, R. C. (2012). Predictors of patient cognitive therapy skills and symptom change in two randomized clinical trials: The role of therapist adherence and the therapeutic alliance. Journal of Consulting and Clinical Psychology, 80(3), 373–381.
   PubMed Web of Science ®Google Scholar