A Meta-Analysis on Differences and Associations between Alliance Ratings in Child and Adolescent Psychotherapy

References

• Accurso, E. C., Hawley, K. M., & Garland, A. F. (2013). Psychometric properties of the therapeutic alliance scale for caregivers and parents. Psychological Assessment, 25(1), 244–252. https://doi.org/10.1037/a0030551
   PubMed Web of Science ®Google Scholar
• Altimir, C., Capella, C., Nuñez, L., Abarzúa, M., & Krause, M. (2017). Meeting in difference: Revisiting the therapeutic relationship based on patients′ and therapists′ experiences in several clinical contexts. Journal of Clinical Psychology, 73(11), 1510–1522. https://doi.org/10.1002/jclp.22525
   PubMed Web of Science ®Google Scholar
• Anderson, R. E. E., Spence, S. H., Donovan, C. L., March, S., Prosser, S., & Kenardy, J. (2012). Working alliance in online cognitive behavior therapy for anxiety disorders. Journal of Medical Internet Research, 14(3), e88. https://doi.org/10.2196/jmir.1848
   PubMed Web of Science ®Google Scholar
• Assink, M., & Wibbelink, C. M. (2016). Fitting three-level meta-analytic models in R: A step-by-step tutorial. The Quantitative Methods for Psychology, 12(3), 154–174. https://doi.org/10.20982/tqmp.12.3.p154
   Web of Science ®Google Scholar
• Baillargeon, P., Coté, R., & Douville, L. (2012). Resolution process of therapeutic alliance ruptures: A review of the literature. Psychology, 3(12), 1049–1058. https://doi.org/10.4236/psych.2012.312156
   Google Scholar
• Baumeister, R. F., Bratslavsky, E., Finkenauer, C., & Vohs, K. D. (2001). Bad is stronger than good. Review of General Psychology, 5(4), 323–370. https://doi.org/10.1037/1089-2680.5.4.323
   Google Scholar
• Baylis, P. J., Collins, D., & Coleman, H. (2011). Child alliance process theory: A qualitative study of a child centred therapeutic alliance. Child and Adolescent Social Work Journal, 28(2), 79–95. https://doi.org/10.1007/s10560-011-0224-2
   Google Scholar
• Bordin, E. S. (1979). The generalizability of the psychoanalytic concept of the working alliance. Psychotherapy:Theory, Research, Practice, 16(3), 252–260. https://doi.org/10.1037/h0085885
   Google Scholar
• Bordin, E. S. (1994). Theory and research on the therapeutic working alliance: New directions. In A. O. Horvath & L. S. Greenberg (Eds.), The working alliance: Theory, research and practice (pp. 13–37). John Willey & Sons.
   Google Scholar
• Campbell, A. F., & Simmonds, J. G. (2011). Therapist perspectives on the therapeutic alliance with children and adolescents. Counselling Psychology Quarterly, 24(3), 195–209. https://doi.org/10.1080/09515070.2011.620734
   Google Scholar
• Cheung, M. W. L. (2014). Modeling dependent effect sizes with three-level meta-analyses: A structural equation modeling approach. Psychological Methods, 19(2), 211–229. https://doi.org/10.1037/a0032968
   PubMed Web of Science ®Google Scholar
• Cirasola, A., Midgley, N., Fonagy, P., & Martin, P. (2021). The factor structure of the Working Alliance Inventory short-form in youth psychotherapy: An empirical investigation. Psychotherapy Research, 31(4), 535–547. https://doi.org/10.1080/10503307.2020.1765041.
   PubMed Web of Science ®Google Scholar
• Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Erlbaum.
   Google Scholar
• Connors, E. H., Douglas, S., Jensen-Doss, A., Landes, S. J., Lewis, C. C., McLeod, B. D., Stanick, C., & Lyon, A. R. (2021). What gets measured gets done: How mental health agencies can leverage measurement-based care for better patient care, clinician supports, and organizational goals. Administration and Policy in Mental Health and Mental Health Services Research, 48(2), 250–265. https://doi.org/10.1007/s10488-020-01063-w
   PubMed Web of Science ®Google Scholar
• Crom, A., Paap, D., Wijma, A., Dijkstra, P. U., & Pool, G. (2020). Between the lines: A qualitative phenomenological analysis of the therapeutic alliance in pediatric physical therapy. Physical & Occupational Therapy In Pediatrics, 40(1), 1–14. https://doi.org/10.1080/01942638.2019.1610138
   PubMed Web of Science ®Google Scholar
• De Greef, M., Pijnenburg, H. M., Van Hattum, M. J. C., McLeod, B. D., & Scholte, R. H. J. (2017). Parent-professional alliance and outcomes of child, parent, and family treatment: A systematic review. Journal of Child and Family Studies, 26(4), 961–976. https://doi.org/10.1007/s10826-016-0620-5
   Web of Science ®Google Scholar
• De Los Reyes, A., Thomas, S. A., Goodman, K. L., & Kundey, S. M. (2013). Principles underlying the use of multiple informants’ reports. Annual Review of Clinical Psychology, 9(1), 123–149. https://doi.org/10.1146/annurev-clinpsy-050212-185617
   PubMed Web of Science ®Google Scholar
• De Los Reyes, A., Augenstein, T. M., Wang, M., Thomas, S. A., Drabick, D. A. G., Burgers, D., & Rabinowitz, J. (2015). The validity of the multi-informant approach to assessing child and adolescent mental health. Psychological Bulletin, 141(4), 858–900. https://doi.org/10.1037/a0038498
   PubMed Web of Science ®Google Scholar
• De Los Reyes, A., & Ohannessian, C. M. (2016). Introduction to the special issue: Discrepancies in adolescent-parent perceptions of the family and adolescent adjustment. Journal of Youth and Adolescence, 45(10), 1957–1972. https://doi.org/10.1007/s10964-016-0533-z
   PubMed Web of Science ®Google Scholar
• De Los Reyes, A., Lerner, M. D., Keeley, L. M., Weber, R., Drabick, D. A. G., Rabinowitz, J., & Goodman, K. L. (2019). Improving interpretability of subjective assessments about psychological phenomena: A review and cross-cultural meta-analysis. Review of General Psychology, 23(3), 293–319. https://doi.org/10.1177/1089268019837645
   Web of Science ®Google Scholar
• DiGiuseppe, R., Linscott, J., & Jilton, R. (1996). Developing the therapeutic alliance in child-adolescent psychotherapy. Applied & Preventive Psychology, 5(2), 85–100. https://doi.org/10.1016/S0962-1849(96)
   Web of Science ®Google Scholar
• Doran, J. M. (2016). The working alliance: Where have we been, where are we going? Psychotherapy Research, 26(2), 146–163. https://doi.org/10.1080/10503307.2014.954153
   PubMed Web of Science ®Google Scholar
• Duncan, B. L., Miller, S. D., Wampold, B. E., & Hubble, M. A. (Eds.) (2010). The heart and soul of change: Delivering what works in therapy (2nd ed.). American Psychological Association. https://doi.org/10.1037/12075-000
   Google Scholar
• Duppong Hurley, K., Van Ryzin, M. J., Lambert, M., & Stevens, A. L. (2015). Examining change in therapeutic alliance to predict youth mental health outcomes. Journal of Emotional and Behavioral Disorders, 23(2), 90–100. https://doi.org/10.1177/1063426614541700
   PubMed Web of Science ®Google Scholar
• Duval, S., & Tweedie, R. (2000). Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics, 56(2), 455–463. https://doi.org/10.1111/j.0006-341X.2000.00455.x
   PubMed Web of Science ®Google Scholar
• Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997). Bias in meta-analysis detected by a simple, graphical test. British Medical Journal, 315(7109), 629–634. https://doi.org/10.1136/bmj.315.7109.629
   PubMed Web of Science ®Google Scholar
• Elvins, R., & Green, J. (2008). The conceptualization and measurement of therapeutic alliance: An empirical overview. Clinical Psychology Review, 28(7), 1167–1187. https://doi.org/10.1016/j.cpr.2008.04.002
   PubMed Web of Science ®Google Scholar
• Escudero, V., Friedlander, M. L., Kivlighan, D. M., Abascal, A., & Orlowski, E. (2021). Toward a broader understanding of split alliances in family therapy: Adding the therapist to the mix. Family Process, 61(1), 167–182. https://doi.org/10.1111/famp.12718
   PubMed Web of Science ®Google Scholar
• Fernández-Castilla, B., Declercq, L., Jamshidi, L., Beretvas, S. N., Onghena, P., & Van den Noortgate, W. (2020). Visual representations of meta-analyses of multiple outcomes: Extensions to forest plots, funnel plots, and caterpillar plots. Methodology, 16(4), 299–315. https://doi.org/10.5964/meth.4013
   Web of Science ®Google Scholar
• Fernández-Castilla, B., Declercq, L., Jamshidi, L., Beretvas, S. N., Onghena, P., & Van den Noortgate, W. (2021). Detecting selection bias in meta-analyses with multiple outcomes: A simulation study. The Journal of Experimental Education, 89(1), 125–144. https://doi.org/10.1080/00220973.2019.1582470
   Web of Science ®Google Scholar
• Fjermestad, K. W., Lerner, M. D., McLeod, B. D., Wergeland, G. J. H., Heiervang, E. R., Silverman, W. K., Öst, L.-G., De Los Reyes, A., Havik, O. E., & Haugland, B. S. M. (2016). Therapist-youth agreement on alliance change predicts long-term outcome in CBT for anxiety disorders. Journal of Child Psychology and Psychiatry, 57(5), 625–632. https://doi.org/10.1111/jcpp.12485
   PubMed Web of Science ®Google Scholar
• Flückiger, C., Rubel, J., Del Re, A. C., Horvath, A. O., Wampold, B. E., Crits-Christoph, P., Atzil-Slonim, D., Compare, A., Falkenström, F., Ekeblad, A., Errázuriz, P., Fisher, H., Hoffart, A., Huppert, J. D., Kivity, Y., Kumar, M., Lutz, W., Muran, J. C., Strunk, D. R., & Barber, J. P. (2020). The reciprocal relationship between alliance and early treatment symptoms: A two-stage individual participant data meta-analysis. Journal of Consulting and Clinical Psychology, 88(9), 829–843. https://doi.org/10.1037/ccp0000594
   PubMed Web of Science ®Google Scholar
• Friedlander, M. L., Kivlighan, D. M., & Shaffer, K. S. (2012). Exploring actor-partner interdependence in family therapy: Whose view (parent or adolescent) best predicts treatment progress? Journal of Counseling Psychology, 59(1), 168–175. https://doi.org/10.1037/a0024199
   PubMed Web of Science ®Google Scholar
• Friedlander, M. L., Escudero, V., Welmers-van de Poll, M. J., & Heatherington, L. (2018). Meta-analysis of the alliance-outcome relation in couple and family therapy. Psychotherapy, 55(4), 356–371. https://doi.org/10.1037/pst0000161
   PubMed Web of Science ®Google Scholar
• Garland, A. F., Lewczyk, C. M., Gabayan, E., & Hawley, K. M. (2004). Multiple stakeholder agreement on desired outcomes for adolescents’ mental health services. Psychiatric Services, 55(6), 671–676. https://doi.org/10.1176/appi.ps.55.6.671
   PubMed Web of Science ®Google Scholar
• Gilson, M. L., & Abela, A. (2021). The therapeutic alliance with parents and their children working through a relational trauma in the family. Contemporary Family Therapy, 43(4), 343–358. https://doi.org/10.1007/s10591-021-09607-4
   PubMed Web of Science ®Google Scholar
• Green, J. (2006). Annotation: The therapeutic alliance – A significant but neglected variable in child mental health treatment. Journal of Child Psychology and Psychiatry, 47(5), 425–435. https://doi.org/10.1111/j.1469-7610.2005.01516.x
   PubMed Web of Science ®Google Scholar
• Harris, J. R. (1998). The nurture assumption: Why children turn out the way they do. Free Press.
   Google Scholar
• Hartmann, A., Joos, A., Orlinsky, D. A., & Zeeck, A. (2015). Accuracy of therapist perceptions of patients’ alliance: Exploring the divergence. Psychotherapy Research, 25(4), 408–419. https://doi.org/10.1080/10503307.2014.927601
   PubMed Web of Science ®Google Scholar
• Hawks, J. M. (2015). Exploring the therapeutic alliance with adolescents and their caregivers: A qualitative approach [Doctoral dissertation]. University of Kentucky.
   Google Scholar
• Hawley, K. M., & Weisz, J. R. (2003). Child, parent, and therapist (dis)agreement on target problems in outpatient therapy: The therapist’s dilemma and its implications. Journal of Consulting and Clinical Psychology, 71(1), 62–70. https://doi.org/10.1037/0022-006X.71.1.62
   PubMed Web of Science ®Google Scholar
• Hawley, K. M., & Garland, A. F. (2008). Working alliance in adolescent outpatient therapy: Youth, parent and therapist reports and associations with therapy outcomes. Child & Youth Care Forum, 37(2), 59–74. https://doi.org/10.1007/s10566-008-9050-x
   Web of Science ®Google Scholar
• Hedges, L. V., & Olkin, I. (1985). Statistical methods for meta-analysis. Academic Press.
   Google Scholar
• Horvath, A. O., & Greenberg, L. S. (1989). Development and validation of the Working Alliance Inventory. Journal of Counseling Psychology, 36(2), 223–233. https://doi.org/10.1037/0022-0167.36.2.223
   Web of Science ®Google Scholar
• Horvath, A. O., Del Re, A. C., Flückiger, C., & Symonds, D. (2011). Alliance in individual psychotherapy. Psychotherapy, 48(1), 9–16. https://doi.org/10.1037/a0022186
   PubMed Web of Science ®Google Scholar
• Horvath, A. O. (2018). Research on the alliance: Knowledge in search of a theory. Psychotherapy Research, 28(4), 499–516. https://doi.org/10.1080/10503307.2017.1373204
   PubMed Web of Science ®Google Scholar
• Houlding, K. (2014). Exploring the therapeutic alliance in cognitive-behavior therapy with children with autism spectrum disorder: An interpretative phenomenological approach. [Master’s thesis]. Brock University.
   Google Scholar
• Karver, M. S., De Nadai, A. S., Monahan, M., & Shirk, S. R. (2018). Meta-analysis of the prospective relation between alliance and outcome in child and adolescent psychotherapy. Psychotherapy, 55(4), 341–355. https://doi.org/10.1037/pst0000176
   PubMed Web of Science ®Google Scholar
• Karver, M. S., De Nadai, A. S., Monahan, M., & Shirk, S. R. (2019). Alliance in child and adolescent psychotherapy. In J. C. Norcross & M. J. Lambert (Eds.), Psychotherapy relationships that work (3rd ed., pp. 79–116). Oxford University Press.
   Google Scholar
• Kazdin, A. E. (2005). Evidence-based assessment for children and adolescents: Issues in measurement development and clinical application. Journal of Clinical Child and Adolescent Psychology, 34(3), 548–558. https://doi.org/10.1207/s15374424jccp3403_10
   PubMed Web of Science ®Google Scholar
• Kazdin, A. E., Whitley, M., & Marciano, P. L. (2006). Child–therapist and parent–therapist alliance and therapeutic change in the treatment of children referred for oppositional, aggressive, and antisocial behavior. Journal of Child Psychology and Psychiatry, 47(5), 436–445. https://doi.org/10.1111/j.1469-7610.2005.01475.x
   PubMed Web of Science ®Google Scholar
• Kivlighan, D. M. (2007). Where is the relationship in research on the alliance? Two methods for analyzing dyadic data. Journal of Counseling Psychology, 54(4), 423–433. https://doi.org/10.1037/0022-0167.54.4.423
   Web of Science ®Google Scholar
• Knapp, G., & Hartung, J. (2003). Improved tests for a random effects meta-regression with a single covariate. Statistics in Medicine, 22(17), 2693–2710. https://doi.org/10.1002/sim.1482
   PubMed Web of Science ®Google Scholar
• Lambert, M. J., Whipple, J. L., & Kleinstäuber, M. (2018). Collecting and delivering progress feedback: A meta-analysis of routine outcome monitoring. Psychotherapy, 55(4), 520–537. https://doi.org/10.1037/pst0000167
   PubMed Web of Science ®Google Scholar
• Langer, D. A., McLeod, B. D., & Weisz, J. R. (2011). Do treatment manuals undermine child-therapist alliance in community clinical practice? Journal of Consulting and Clinical Psychology, 79(4), 427–432. https://doi.org/10.1037/a0023821
   PubMed Web of Science ®Google Scholar
• Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis. Sage.
   Google Scholar
• McLeod, B. D., & Weisz, J. R. (2005). The therapy process observational coding system-alliance scale: Measure characteristics and prediction of outcome in usual clinical practice. Journal of Consulting and Clinical Psychology, 73(2), 323–333. https://doi.org/10.1037/0022-006X.73.2.323
   PubMed Web of Science ®Google Scholar
• McLeod, B. D. (2011). Relation of the alliance with outcomes in youth psychotherapy: A meta-analysis. Clinical Psychology Review, 31(4), 603–616. https://doi.org/10.1016/j.cpr.2011.02.001
   PubMed Web of Science ®Google Scholar
• McLeod, B. D., Southam-Gerow, M. A., & Kendall, P. C. (2017). Observer, youth, and therapist perspectives on the alliance in cognitive behavioral treatment for youth anxiety. Psychological Assessment, 29(12), 1550–1555. https://doi.org/10.1037/pas0000465
   PubMed Web of Science ®Google Scholar
• Mihalo, J. R., & Valenti, M. W. (2018). How are we doing? Results of receiving family- driven feedback on alliances between families and residential treatment staff over time. Children and Youth Services Review, 86, 42–48. https://doi.org/10.1016/j.childyouth.2018.01.011
   Web of Science ®Google Scholar
• Mullen, B. (1989). Advanced BASIC meta-analysis. Erlbaum.
   Google Scholar
• Murphy, R., & Hutton, P. (2018). Therapist variability, patient-reported therapeutic alliance, and clinical outcomes in adolescents undergoing mental health treatment – A systematic review and meta-analysis. Journal of Child Psychology and Psychiatry, 59(1), 5–19. https://doi.org/10.1111/jcpp.12767
   PubMed Web of Science ®Google Scholar
• Nooteboom, L. A., Kuiper, C. H. Z., Mulder, E. A., Roetman, P. J., Eilander, J., & Vermeiren, R. J. M. (2020). What do parents expect in the 21st century? A qualitative analysis of integrated youth care. International Journal of Integrated Care, 20(3), 1–13. https://doi.org/10.5334/ijic.5419
   Web of Science ®Google Scholar
• Norcross, J. C., & Lambert, M. J. (2018). Psychotherapy relationships that work III. Psychotherapy, 55(4), 303–315. https://doi.org/10.1037/pst0000193
   PubMed Web of Science ®Google Scholar
• Nuñez, L., Midgley, N., Capella, C., Alamo, N., Mortimer, R., & Krause, M. (2021). The therapeutic relationship in child psychotherapy: Integrating the perspectives of children, parents and therapists. Psychotherapy Research, 31(8), 988–1000. https://doi.org/10.1080/10503307.2021.1876946
   PubMed Web of Science ®Google Scholar
• Nuñez, L., Fernández, S., Alamo, N., Midgley, N., Capella, C., & Krause, M. (2022). The therapeutic relationship and change processes in child psychotherapy: A qualitative, longitudinal study of the views of children, parents and therapists. Research in Psychotherapy: Psychopathology, Process, and Outcome, 25(1), 67–81. https://doi.org/10.4081/ripppo.2022.556
   Google Scholar
• Ormhaug, S. M., Jensen, T. K., Wentzel-Larsen, T., & Shirk, S. R. (2014). The therapeutic alliance in treatment of traumatized youths: Relation to outcome in a randomized clinical trial. Journal of Consulting and Clinical Psychology, 82(1), 52–64. https://doi.org/10.1037/a0033884
   PubMed Web of Science ®Google Scholar
• Ormhaug, S. M., Shirk, S. R., & Wentzel-Larsen, T. (2015). Therapist and client perspectives on the alliance in the treatment of traumatized adolescents. European Journal of Psychotraumatology, 6(1), 27705. https://doi.org/10.3402/ejpt.v6.27705
   PubMed Web of Science ®Google Scholar
• Peters, J. L., Sutton, A. J., Jones, D. R., Abrams, K. R., & Rushton, L. (2007). Performance of the trim and fill method in the presence of publication bias and between-study heterogeneity. Statistics in Medicine, 26(25), 4544–4562. https://doi.org/10.1002/sim.2889
   PubMed Web of Science ®Google Scholar
• R Core Team. (2015). R: A language and environment for statistical computing. R Foundation for Statistical Computing https://www.Rproject.org/
   Google Scholar
• Rober, P., Van Tricht, K., & Sundet, R. (2020). ‘One step up, but not there yet’: Using client feedback to optimise the therapeutic alliance in family therapy. Journal of Family Therapy, 43(1), 46–63. https://doi.org/10.1111/1467-6427.12292
   Web of Science ®Google Scholar
• Rodgers, M. A., & Pustejovsky, J. E. (2021). Evaluating meta-analytic methods to detect selective reporting in the presence of dependent effect sizes. Psychological Methods, 26(2), 141–160. https://doi.org/10.1037/met0000300
   Web of Science ®Google Scholar
• Rosenthal, R. (1979). The “file drawer problem” and tolerance for null results. Psychological Bulletin, 86(3), 638–641. https://doi.org/10.1037//0033-2909.86.3.638
   Web of Science ®Google Scholar
• Rosenthal, R., & DiMatteo, M. R. (2001). Meta-Analysis: Recent developments in quantitative methods for literature reviews. Annual Review of Psychology, 52(1), 59–82. https://doi.org/10.1146/annurev.psych.52.1.59
   PubMed Web of Science ®Google Scholar
• Rothstein, H. R. (2008). Publication bias as a threat to the validity of meta-analytic results. Journal of Experimental Criminology, 4(1), 61–81. https://doi.org/10.1007/s11292-007-9046-9
   Google Scholar
• Ryan, R., Berry, K., Law, H., & Hartley, S. (2021). Therapeutic relationships in child and adolescent mental health services: A Delphi study with young people, carers and clinicians. International Journal of Mental Health Nursing, 30(4), 1010–1021. https://doi.org/10.1111/inm.12857
   PubMed Web of Science ®Google Scholar
• Shelef, K., Diamond, G. M., Diamond, G. S., & Liddle, H. A. (2005). Adolescent and parent alliance and treatment outcome in multidimensional family therapy. Journal of Consulting and Clinical Psychology, 73(4), 689–698. https://doi.org/10.1037/0022-006x.73.4.689
   PubMed Web of Science ®Google Scholar
• Shirk, S. R., & Saiz, C. C. (1992). Clinical, empirical, and developmental perspectives on the therapeutic relationship in child psychotherapy. Development and Psychopathology, 4(4), 713–728. https://doi.org/10.1017/S0954579400004946
   Web of Science ®Google Scholar
• Shirk, S. R., & Karver, M. S. (2003). Prediction of treatment outcome from relationship variables in child and adolescent therapy: A meta-analytic review. Journal of Consulting and Clinical Psychology, 71(3), 452–464. https://doi.org/10.1037/0022-006X.71.3.452
   PubMed Web of Science ®Google Scholar
• Shirk, S. R., Caporino, N. E., & Karver, M. S. (2010). The alliance in adolescent therapy: Conceptual, operational, and predictive issues. In D. Castro-Blanco & M. S. Karver (Eds.). Elusive alliance: Treatment engagement strategies with high-risk adolescents (pp. 59–93). American Psychological Association.
   Google Scholar
• Shirk, S. R., Karver, M. S., & Brown, R. (2011). The alliance in child and adolescent psychotherapy. Psychotherapy, 48(1), 17–24. https://doi.org/10.1037/a0022181
   PubMed Web of Science ®Google Scholar
• Simmonds, C. R. (2016). An exploration of how therapists judge the quality of their therapeutic relationships in clinical practice [Doctoral dissertation]. University of Southampton.
   Google Scholar
• Tabachnik, B. G., & Fidell, L. S. (2013). Using multivariate statistics (6th ed.). Allyn and Bacon.
   Google Scholar
• Tam, H. E., & Ronan, K. (2017). The application of a feedback-informed approach in psychological service with youth: Systematic review and meta-analysis. Clinical Psychology Review, 55, 41–55. https://doi.org/10.1016/j.cpr.2017.04.005
   PubMed Web of Science ®Google Scholar
• Tryon, G. S., Blackwell, S. C., & Hammel, E. F. (2007). A meta-analytic examination of client-therapist perspectives of the working alliance. Psychotherapy Research, 17(6), 629–642. https://doi.org/10.1080/10503300701320611
   Web of Science ®Google Scholar
• Tryon, G. S., Blackwell, S. C., & Hammel, E. F. (2008). The magnitude of client and therapist working alliance ratings. Psychotherapy: Theory, Research, Practice, Training, 45(4), 546–551. https://doi.org/10.1037/a0014338
   PubMed Web of Science ®Google Scholar
• Van Benthem, P., Spijkerman, R., Blanken, P., Kleinjan, M., Vermeiren, R. R. J. M., & Hendriks, V. M. (2020). A dual perspective on first‑session therapeutic alliance: Strong predictor of youth mental health and addiction treatment outcome. European Child & Adolescent Psychiatry, 29(11), 1593–1601. https://doi.org/10.1007/s00787-020-01503-w
   PubMed Web of Science ®Google Scholar
• Van den Noortgate, W., & Onghena, P. (2003). Multilevel meta-analysis: A comparison with traditional meta-analytical procedures. Educational and Psychological Measurement, 63(5), 765–790. https://doi.org/10.1177/0013164403251027
   Web of Science ®Google Scholar
• Van den Noortgate, W., López-López, J. A., Marín-Martínez, F., & Sánchez-Meca, J. (2013). Three-level meta-analysis of dependent effect sizes. Behavior Research Methods, 45(2), 576–594. https://doi.org/10.3758/s13428-012-0261-6
   PubMed Web of Science ®Google Scholar
• Van den Noortgate, W., López-López, J. A., Marín-Martínez, F., & Sánchez-Meca, J. (2014). Meta-analysis of multiple outcomes: A multilevel approach. Behavior Research Methods, 47(4), 1274–1294. https://doi.org/10.3758/s13428-014-0527-2
   Web of Science ®Google Scholar
• Van Sonsbeek, M. A. M. S., Hutschemaekers, G. J. M., Veerman, J. W., Vermulst, A., Kleinjan, M., & Tiemens, B. G. (2021). Challenges in investigating the effective components of feedback from Routine Outcome Monitoring (ROM) in youth mental health care. Child & Youth Care Forum, 50(2), 307–332. https://doi.org/10.1007/s10566-020-09574-1
   Web of Science ®Google Scholar
• Viechtbauer, W. (2010). Conducting a meta-analysis in R with the metafor package. Journal of Statistical Software, 36(3), 1–48. https://doi.org/10.18637/jss.v036.i03
   Web of Science ®Google Scholar
• Welmers-Van de Poll, M. J., Stams, G. J. J. M., Van den Akker, A. L., & Overbeek, G. (2020). Alliance discrepancies in home-based family treatment: Occurrence, development and the therapist’s perspective. Journal of Family Therapy, 43(4), 642–664. https://doi.org/10.1111/1467-6427.12309
   Web of Science ®Google Scholar
• Zack, S. E., Castonguay, L. G., & Boswell, J. F. (2007). Youth working alliance: A core clinical construct in need of empirical maturity. Harvard Review of Psychiatry, 15(6), 278–288. https://doi.org/10.1080/10673220701803867
   PubMed Web of Science ®Google Scholar
• Zandberg, L. J., Skriner, L. C., & Chu, B. C. (2015). Client-therapist alliance discrepancies and outcome in cognitive-behavioral therapy for youth anxiety. Journal of Clinical Psychology, 71(4), 313–322. https://doi.org/10.1002/jclp.22167
   PubMed Web of Science ®Google Scholar
• Zeegers, M. A. J., Colonnesi, C., Stams, G. J. J. M., & Meins, E. (2017). Mind matters: A meta-analysis on parental mentalization and sensitivity as predictors of infant-parent attachment. Psychological Bulletin, 143(12), 1245–1272. https://doi.org/10.1037/bul0000114
   PubMed Web of Science ®Google Scholar
• Zilcha-Mano, S., Snyder, J., & Silberschatz, G. (2017). The effect of congruence in patient and therapist alliance on patients’ symptomatic levels. Psychotherapy Research, 27(3), 371–380. https://doi.org/10.1080/10503307.2015.1126682
   PubMed Web of Science ®Google Scholar