2,292
Views
2
CrossRef citations to date
0
Altmetric
FUTURE DIRECTIONS

Future Directions in Youth and Family Treatment Engagement: Finishing the Bridge Between Science and Service

ORCID Icon & ORCID Icon

ABSTRACT

The field has spent more than 50 years investing in the quality of youth mental healthcare, with intervention science yielding roughly 1,300 efficacious treatments. In the latter half of this period, concurrent efforts in implementation science have developed effective methods for supporting front-line service organizations and therapists to begin to bridge the science to service gap. However, many youths and families still do not benefit fully from these strategic investments due to low treatment engagement: nearly half of youths in need of services pursue them, and among those who do, roughly another half terminate prematurely. The negative impact of low engagement is substantial, and is disproportionally and inequitably so for many. We contend that to build a robust and “finished” bridge connecting science and service, the field must go beyond its two historical foci of designing interventions and preparing therapists to deliver them, to include an intentional focus on the youths and families who participate in these interventions and who work with those therapists. In this paper, we highlight the significance of treatment engagement in youth mental healthcare and discuss the current state of the literature related to four priorities: conceptualization, theory, measurement, and interventions. Next, we offer an example from our own program of research as one illustration for advancing these priorities. Finally, we propose recommendations to act on these priorities.

To improve the quality of mental health services for youths and families, the field has pursued strategies to bridge science and service for at least a quarter century (National Institute of Mental Health [NIMH], Citation1998). Situated on one side of the span is an extensive, scientifically derived knowledge base, enabled by more than five decades of policy (Kefauver-Harris Drug Amendments, Citation1962; NIMH, Citation2001), leading to massive public and institutional investments in experimental interventions research (Hoagwood et al., Citation2018). This evidence base now represents more than 1,500 randomized controlled trials (RCTs), yielding protocols from roughly 1,300 treatment arms that meet a general standard for being evidence-based, addressing a wide variety of clinical concerns from infancy to early adulthood (PracticeWise, Citation2022).

Situated on the other side of the span are healthcare organizations and their service providers, whose context typically includes large caseloads, administrative and billing demands, workforce turnover, and limited professional development opportunities. Notably, these factors bear little resemblance to the context of research trials. Several major historical reviews showed that in these settings, typical effect sizes were low (Weisz et al., Citation1992, Citation1995, Citation2006) and that uptake or application of evidence-based practice was minimal (Garland et al., Citation2010; Weersing & Weisz, Citation2002; Weisz et al., Citation2006). In light of these observations, the attention of policymakers began to shift to address the known “chasm” between science and service (Institute of Medicine [IOM], Citation2001), resulting in increased investments in implementation science. Over the past 25 years, these investments have yielded new models that aim to fit efficacious interventions to community service contexts, with attention to several interconnected factors such as service delivery structure; training and consultation; measurement of meaningful outcomes; and organizational structure, resources, and preferences (e.g., Chorpita, Citation2003; Fixsen et al., Citation2005; Glasgow et al., Citation1999; Greenhalgh et al., Citation2004; Hoagwood et al., Citation2020; Schoenwald & Hoagwood, Citation2001). These advances required institutional commitments and investments in new types of research, albeit they remain dramatically lower for dissemination and implementation research than for interventions research (Purtle et al., Citation2015). This investment has begun to pay off, and an accumulation of trials has shown positive outcomes in service contexts (e.g., Chorpita et al., Citation2017; Jensen et al., Citation2014; Schaeffer et al., Citation2021), as well as sustained application of evidence-informed care within large health systems (e.g., Hoagwood et al., Citation2020; Nakamura et al., Citation2014; Southam-Gerow et al., Citation2014). In light of these positive findings, it is fair to conclude at long last that the field has built a passable structure and that crossing the chasm is now possible, although it is widely acknowledged that improving the quality of mental health services is not as straightforward as “building a bridge and driving across it with a truckload of manuals” (Shirk & Peterson, Citation2013, p. 107). Shirk and Peterson’s claim thus brings us to the question referenced in our title of how to move from a rudimentary structure to a fully robust and complete connection between science and service.

While addressing the complexities involved in the scientific study of organizations and systems, Nobel laureate Herbert Simon pointed out that, under typical conditions, a bridge will perform as planned – by carrying a path over an obstacle – but that it is the taxing conditions that expose the bridge’s weaknesses (Simon, Citation1988). In our field, “taxing conditions” are so commonplace that the evidence-based support needed by most youths and families does not make it across this bridge. In other words, our bridge from science to service is replete with metaphorical potholes and hazardous debris; it has an absence of lane lines and is missing stretches of guardrails. Technically, it can be spanned, but pragmatically, at scale, and under taxing conditions, it fails too often and for too many. We contend that one of the most insidious taxing conditions involves treatment engagement. That is, even when evidence-based care is delivered with a high degree of integrity and quality by community therapists, which is a significant achievement, roughly half of families withdraw from treatment and still more are unable to participate meaningfully in their care to achieve the desired outcomes. Thus, we contend that the topic of “future directions of treatment engagement research” is of paramount relevance to finishing the bridge from science to service. This recognition of the need to expand the focus of research beyond the two well-established areas of intervention science and implementation science is not new. Calls for increased family empowerment in mental health services have been made by leaders in the field for more than two decades (e.g., Bickman et al., Citation1998; Jensen & Hoagwood, Citation2008; McKay et al., Citation1996; Olin et al., Citation2010). There is, however, a new perspective emerging from the small but developing evidence base on treatment engagement, whose synthesis now offers increasingly clear direction for the future.

The Extent of the Challenge

The scope of this problem is extraordinary: low engagement is the most ubiquitous challenge among youths and families with mental health needs. National survey findings suggest that only one-third of youths with mental health needs access services (Merikangas et al., Citation2011). Of those who do enroll in treatment, between 50% and 70% terminate earlier than recommended by their therapists, meaning that they withdraw from therapy before achieving the expected benefits (de Haan et al., Citation2013; Guo et al., Citation2014; Nock & Ferriter, Citation2005; Pellerin et al., Citation2010). One study of a U.S. insurance claims database revealed that 45% of youth discontinued treatment within 30 days and those who remained in treatment averaged less than one session per month across a 6-month period (Harpaz-Rotem et al., Citation2004). Another study revealed that 40% of youths enrolled in mental health services attended only a single appointment (Saloner et al., Citation2014).

Low engagement is not an artifact of “usual care” services, nor is it confined to the mental health service sector. Similar attrition rates have been observed in studies testing evidence-based treatments (EBTs). For example, studies of Trauma-Focused CBT have reported attrition rates of 30–70% (Cohen et al., Citation2011; Scheeringa et al., Citation2011; Wamser-Nanney & Steinzor, Citation2016, Citation2017; Yasinski et al., Citation2018). A summary of 262 studies of behavioral parent training revealed that 25% of those participants who passed eligibility screening declined subsequent participation; another 13% discontinued before the first session; and another 13% withdrew during the study, suggesting that 51% of those appropriate for parent training did not complete treatment (Chacko et al., Citation2016). Even when treatments are designed to be especially responsive to youth and family needs and outperform high-quality EBTs on clinical and engagement outcomes, discontinuation rates are still unacceptably high (Chorpita & Daleiden, Citation2018). Attrition is so problematic in research that scholars now routinely summarize attrition rates across studies of specific EBTs (e.g., dialectical behavior therapy; Dixon & Linardon, Citation2020) and youth populations (e.g., depressed youth; Wright, Mughal et al., Citation2021) and publish ideas for retention/recruitment strategies specific to improving research studies (e.g., Daykin et al., Citation2018; Robinson et al., Citation2015).

It is even more alarming that attrition rates are not evenly distributed; typically, attrition is worse for those with greater mental health impairment (Pellerin et al., Citation2010; Rich et al., Citation2014). Moreover, youths and families of color are even less likely to access services than are their white/European American counterparts (Carson et al., Citation2011; Cook et al., Citation2013; Georgiades et al., Citation2018; Merikangas et al., Citation2011; Saloner et al., Citation2014). Youths of color attend fewer visits within a specified timeframe and are more likely to discontinue treatment than are white youths (Carson et al., Citation2011; de Haan et al., Citation2013; Marrast et al., Citation2016; Saloner et al., Citation2014). Other traditionally underserved groups, including those who have immigrated to the U.S. (Georgiades et al., Citation2018), those with incomes below the poverty line (Merikangas et al., Citation2010; Saloner et al., Citation2014), and those living in rural regions (Kelleher & Gardner, Citation2017) also have well-documented service use disparities.

Beyond the individual client, low engagement impacts mental health therapists, systems, and even other consumers. Missed appointments and therapy discontinuation consume staff time and reduce revenue (Barrett et al., Citation2008; Gross et al., Citation2011; Pekarik, Citation1985). Therapists rate low engagement as a highly stressful client behavior (Farber, Citation1983) that contributes to therapist distress (Piselli et al., Citation2011) and diminished confidence (Coutinho et al., Citation2011), with clear implications for turnover. Moreover, a missed appointment by one client increases the time that others spend on the waiting list. Waitlist time, in turn, is associated with increased likelihood of missed intake appointments when an appointment finally becomes available, thereby perpetuating a cycle of low engagement for the consumer population (Schraeder & Reid, Citation2015; Sherman et al., Citation2009).

The diminished return on our investment in the bridge from science to service is even worse than the data on attrition would suggest. This is because dropout has been posited as the final step on an engagement pathway that can begin with other engagement challenges that also have been shown to limit outcomes, including weak therapeutic alliance (e.g., Karver et al., Citation2018; McLeod & Weisz, Citation2005; Shirk et al., Citation2011), poor homework completion (e.g., Simons et al., Citation2012), insufficient skill rehearsal (e.g., Wu et al., Citation2020), low perceptions of treatment credibility (Wergeland et al., Citation2015), and low expectations of therapeutic success (e.g., Norris et al., Citation2019).

Let us also be clear: this vexing problem of treatment discontinuation and low engagement is not a recent one. Attrition rates of 30–40% were reported in the youth mental health literature 65 years ago (e.g., Levitt, Citation1957, Citation1958; Ross & Lacey, Citation1961). Across youth and adult clinic populations, attrition was examined with such frequency that a review paper was published as early as 1975 (i.e., Baekeland & Lundwall, Citation1975). Around this time, initial research on engagement interventions took place (e.g., Eyberg & Johnson, Citation1974; Fleischman, Citation1979; Holmes & Urie, Citation1975), laying the foundations for seminal work in the next two decades that (a) included behavioral observation of client and therapist interactions to understand client resistance (e.g., Chamberlain et al., Citation1984; Patterson & Chamberlain, Citation1994; Patterson & Forgatch, Citation1985), (b) identified and examined the impact of common barriers on treatment participation (e.g., Kazdin & Wassell, Citation1999; Kazdin et al., Citation1997), and (c) tested engagement interventions designed to reduce the interference of these barriers for families seeking services in front-line settings in urban contexts (e.g., McKay et al., Citation1998; McKay, Nudelman, et al., Citation1996; McKay, McCadam, et al., Citation1996).

Prioritizing Solutions

To produce a robust and finished bridge that performs under taxing real-life conditions, we contend, as others before us have (e.g., Shirk, Citation2004), that the field must prioritize research on treatment engagement, as it continues to invest in research on interventions and on dissemination and implementation. The disparity between scientific examination of treatment engagement and the evidence base of more than 1,500 RCTs testing children’s mental health interventions is striking: despite its significance in research and practice, there are fewer than 60 randomized controlled trials testing engagement interventions (Becker et al., Citation2018; Lakind et al., Citation2022). This disparity in research emphasis is amplified when considering the small literatures on the conceptualization, theory, and measurement of engagement relative to the many thousands of studies on psychopathology. However, the prioritization of treatment engagement cannot be borne by scholars alone, responding only to aspirational commitments documented in federal reports to improve access or reduce disparities in mental health services. Disappointingly, funding has decreased for youth mental health research (Hoagwood et al., Citation2018) at a time when the field requires strategic commitments and programmatic funding from sponsors that establish new, dedicated, and significant investments in research on treatment engagement. In addition, to incentivize a new generation of engagement researchers, we contend that organizational recognition of treatment engagement as a substantive area of scientific inquiry in its own right (i.e., beyond the contexts of specific mental health conditions, such as substance use or depression) will be required.

It is time for a deliberate effort to engineer a more robust bridge connecting science and service, one that works under the taxing conditions faced by most young people and their families who need mental health services. In the following sections, we discuss the present status of four priorities related to treatment engagement: conceptualization, theory, measurement, and interventions. We then offer an illustration from our own program of research as one strategy for advancing these integrated priorities. Finally, we offer recommendations for future directions related to these priorities.

Current State of the Science of Treatment Engagement

Conceptualization

Conceptualization involves the way the field organizes ideas to represent treatment engagement. As such, conceptualization provides a critical foundation for all other related work in the field, including theory development, measurement, and intervention. The current conceptualization in the field is that engagement is multidimensional, dynamic, and transactional.

Engagement is typically conceptualized as a latent variable with multiple composite or causal indicators. This means that there are multiple identifiable manifestations that reflect an individual’s level of engagement, rather than engagement as a global or unidimensional construct. Research has confirmed the structural validity of engagement as comprising behavioral, cognitive, and social dimensions (Chorpita & Becker, Citation2022). Thus, it is possible for an individual to be more or less engaged across different dimensions (e.g., have a positive view of the therapeutic alliance but have low expectations that treatment will be helpful). Additionally, high and low engagement can look different for different people (e.g., one person might have low expectations for treatment whereas another might have difficulty attending treatment regularly).

Although there are many conceptual models of engagement as a multidimensional construct (e.g., Becker et al., Citation2018; Haine-Schlagel & Walsh, Citation2015; King et al., Citation2014; Piotrowska et al., Citation2017; Pullmann et al., Citation2013; Staudt, Citation2007), scholars have not yet come to a consensus about the specific dimensions of engagement and their manifestations. There is general agreement that behavioral dimensions include behaviors such as treatment enrollment, attendance, session participation, and homework completion. In contrast, cognitive dimensions significantly vary across models (e.g., attitudes, self-efficacy, locus of control, understanding of treatment, readiness to change). Social dimensions typically represent the dyadic interactions between a therapist and their client (e.g., quality of the therapeutic alliance) and have been included explicitly in some models (e.g., Becker et al., Citation2018; Staudt, Citation2007) or conceptualized as primarily cognitive phenomena in others (e.g., perceptions of therapist efficacy, King et al., Citation2014).

In addition to being multidimensional, engagement is typically conceptualized as dynamic, meaning that it can change across time (Staudt, Citation2007). Multiple studies have demonstrated that alliance typically increases within a session (Zlotnick et al., Citation2020), changes across the course of treatment (Chu et al., Citation2014; Halfon et al., Citation2019), and improves even for those with the weakest alliance at the outset of treatment (e.g., Zilcha-Mano & Errázuriz, Citation2017). Engagement is also conceptualized as a transactional phenomenon, meaning that engagement is not a feature of an individual, but rather the result of transactions between the client and their ecology, including people (e.g., therapist, support network, community) and systems (e.g., the service agency, the network of services they receive), as well as the interface between the client and the treatment itself. Certainly, clients have agency to decide whether and how much to participate in treatment, yet the transactional nature of engagement means that therapists can and do influence the engagement of youths and families (Fjermestad et al., Citation2021; Ovenstad et al., Citation2020), even repairing alliance ruptures when they occur (Eubanks, Muran, et al., Citation2018; O’Keeffe et al., Citation2020).

The conceptualization of engagement as multidimensional, dynamic, and transactional largely diverges from how research on engagement historically has been carried out. In fact, an uncritical review of the evidence base could give one the misleading impression that engagement is unidimensional, static, and a stable attribute of the individual. This is because the research literature is siloed by discrete dimensions (e.g., the evidence base on alliance is separate from the evidence base on therapy expectancies; Becker et al., Citation2018), is characterized by studies that often measure engagement outcomes at only a single point in time (e.g., attendance or expectancies at the first appointment; Lakind et al., Citation2022), and features studies that examine client demographic characteristics (e.g., age, race, gender) and their association with one’s engagement in therapy (Karver et al., Citation2018).

Despite how the research has historically been organized, it has thus far yielded productive insights that have shaped the current conceptualization of engagement. Indeed, discrete lines of research are necessary and have provided a valuable understanding of such dimensions as alliance (e.g., McLeod & Weisz, Citation2005; O’Keeffe et al., Citation2020; Shirk et al., Citation2011) and expectancy (e.g., Horvath, Citation1990; Kazdin & Krouse, Citation1983; Schleider & Weisz, Citation2018). At the same time, the accumulating research now affords consolidation and synthesis that can advance a conceptualization of engagement as multidimensional, dynamic, and transactional, reflecting the complexities with which engagement manifests in clinical practice. An example of such a consolidated view is offered below (see “A Process Illustration” section).

Theory

Whereas conceptualization involves organizing ideas about how to represent a phenomenon, theories aim to explain phenomena by specifying how concepts relate to one another and by providing testable hypotheses (Fried, Citation2020; Meehl, Citation1990; Robinaugh et al., Citation2021). In psychology broadly, the pursuit of identifying, validating, and describing patterns of increasingly complex phenomena has greatly outpaced theory development (Proulx et al., Citation2021; Robinaugh et al., Citation2021). The same is true for the phenomenon of treatment engagement. Theories that specify potential mechanisms of change have influenced discrete engagement procedures, as in the example of operant conditioning (Skinner, Citation1938) that inspired the study of incentives for participation in therapy (e.g., Dumas et al., Citation2010). However, the field lacks bona fide theories of treatment engagement that attempt to explain: (a) why, when, and how treatment engagement will occur, (b) mechanisms of action, including those that represent different theoretical constructs (e.g., self-efficacy, social learning, operant conditioning), (c) mediators and moderators, and (d) engagement outcomes from a multidimensional perspective. Statistical models of treatment engagement are a bit more common than theories, but these represent patterns of data associations, rather than a priori explanatory theories that can account for current observations and also extrapolate to unforeseen contexts (Haslbeck et al., Citation2021).

Scholars have long lamented the waning influence of theory in psychological science (e.g., Eronen & Bringmann, Citation2021; Fried, Citation2020; Meehl, Citation1978, Citation1990; Proulx et al., Citation2021; Robinaugh et al., Citation2021), yet the value of a theory regarding engagement as a multidimensional, dynamic, and transactional phenomenon cannot be understated. Development and rigorous testing of theory elevates the knowledge gained from scientific investigation above one’s intuition (Lilienfeld, Citation2010; Meehl, Citation1978). Theory offers safeguards against biases, including a priori specified associations (vs. ad hoc “happenstantial” explanations; Beutler, Citation1991, p. 226) and an emphasis on falsification (vs. confirmation). In contrast to unwavering rationalization, strong theories evolve in an iterative, self-correcting way as the understanding of a phenomenon deepens and additional constructs or causal links lend themselves to testing (Lilienfeld, Citation2010). Theory is the connector among discrete empirical findings, serving to integrate these findings in a coherent manner thereby contributing to future empirical and intellectual breakthroughs (Prochaska et al., Citation2020). One caveat, though, is that most theories remain intact despite opposing empirical data. By testing competing theories within the same study (e.g., six theories of parenting practices and adolescent sexual behavior; L. G. Simons et al., Citation2016), scientists can contest prevailing assumptions and spur paradigm shifts that significantly advance the field (Joireman & Lange, Citation2015).

We have chosen to briefly discuss the Theory of Planned Behavior (TPB; Ajzen, Citation1985) as an exemplar; not because it fully explains the phenomena of low engagement, but because it embodies the features of strong theories and underscores the significance of consistent application of theory to psychological research. The TPB clearly specifies a clear causal chain: (a) attitudes, subjective norms, and perceived behavioral control influence (b) intentions to perform a behavior which then influence (c) behavioral performance (Ajzen, Citation1985). Importantly, the TPB made explicit ideas that might underlie clinical intuition (e.g., surrounding an individual with others who support behavior change will increase the likelihood of the individual’s behavior change) and it integrated concepts that, previously, had discrete lines of research. The strong theoretical foundation of the TPB accelerated the related priorities of measure and intervention development. Measures representing the TPB constructs have proliferated and contributed to a growing body of research clarifying the ways in which different measurement methods affect study findings (e.g., Courneya et al., Citation2006; Hardeman et al., Citation2013; Mankarious & Kothe, Citation2015). The TPB has guided the development of interventions for diverse health behaviors (e.g., diabetes management, Caro-Bautista et al., Citation2021; smoking cessation, Lareyre, Gourlan, et al., Citation2021), amassing voluminous research, including studies that diverge from what would be predicted by theory. Challenging studies and published criticisms have promoted intermittent scholarly discourse clarifying the TPB and evaluating its research evidence. Not only have these exchanges identified where the theory is more or less robust but they have also elevated the scientific discourse about expectations of theory and the role of theory in science (see Ajzen, Citation2011, Citation2015, Citation2020; Sniehotta et al., Citation2014, Citation2015; Trafimow, Citation2015). Although widely applied in healthcare research, the TPB has been used infrequently in mental health research, and rarely in youth mental health research (e.g., Chang et al., Citation2019). The few studies that exist in mental healthcare suggest that TPB is useful for predicting treatment attendance (e.g., Kelly et al., Citation2016).

The example of the TPB reveals what is possible for theory development related to treatment engagement. Developing theories that represent engagement as a multidimensional construct will require deep reflection about the integration of historically siloed lines of research, yet has the potential to create synergy that will accelerate our understanding of how different dimensions relate to one another. Elaborating theory to also reflect the dynamic and transactional nature of engagement will expand our capacity to represent the factors that influence engagement and identify mechanisms of change. We expect that initial attempts at theory will serve as stepping stones for future revisions of conceptualization and theory informed by theory-driven research. Importantly, prioritizing theory development and theory-driven research will enhance the field’s ability to strategically measure and intervene on treatment engagement.

Measurement

Measurement involves the quantification of a phenomenon (e.g., score on an alliance survey). Given that engagement is multidimensional, dynamic, and transactional, it is important to consider the capability of the field’s measurement methods to characterize the nature of engagement. Lakind et al. (Citation2022) reviewed 112 measures used in 52 randomized controlled trials (RCTs) testing engagement interventions. They found that 61.6% of these measures reflected treatment attendance, with far fewer representing other behavioral (e.g., in-session participation or out-of-session homework completion), cognitive (e.g., expectancy or understanding of therapy), and social (e.g., therapeutic relationship) dimensions (for a list, see Lakind et al., Citation2022). Most studies collected outcome data for only a single engagement dimension and at a single point in time; when more than one engagement dimension was measured, it was often done so using different methods, thereby introducing method variance into any analyses examining the associations between dimensions. Measurement of youth (19.2% of studies) or caregiver (26.9%) perspectives of their own engagement was infrequent relative to use of clinic records, in part due to the overreliance on attendance as the primary indicator of engagement (Lakind et al., Citation2022). Certainly, there are measurement constraints and tradeoffs within the context of research studies, but it is important to recognize that the collective way that engagement has been measured within these studies shapes our ability to understand the nature of engagement, emergent challenges, the ebb and flow of engagement over time, mechanisms of action, the perspectives of youths and families, and mediators and moderators of engagement. Thus, considering ways to better align measurement with the multidimensional, dynamic, and transactional nature of engagement will significantly advance science and practice. As an example, we created youth and caregiver self-report questionnaires that measure five engagement dimensions (see “A Process Illustration” section of this paper). Data collected from a large sample of youths and caregivers participating in community mental health services allowed us to establish the structural validity of engagement as a multidimensional construct, with support for a five-factor structure apparent across youths and caregivers and robust to differences in individual characteristics (e.g., youth age and race; Chorpita & Becker, Citation2022).

Separate from intervention research, more extensive measure development and application has been pursued by independent scholars for the in-depth study of specific engagement dimensions, most notably, alliance. For alliance, measures have been developed, tested, and refined over the course of the past 30 years, beginning with therapist- and youth-report questionnaires (e.g., DiGiuseppe et al., Citation1996; Shirk & Saiz, Citation1992). To supplement self-report measures and address some of their potential limitations (e.g., demand characteristics, developmental considerations), scholars have developed observational measures of alliance (e.g., Diamond et al., Citation1999; Faw et al., Citation2005; Karver et al., Citation2008; McLeod & Weisz, Citation2005; O’Keeffe et al., Citation2020). Having a suite of measurement strategies has facilitated in-depth study of alliance, yet meta-analytic reviews also raise concerns about how the lack of consensus about the definition and measurement of alliance influences the conclusions that can be drawn about its association with treatment outcomes (Karver et al., Citation2018; McLeod et al., Citation2021). Discourse about the imprecise measurement of other dimensions has been ongoing in the literature for more than a decade (for a review of in-session participation and homework, see Haine-Schlagel et al., Citation2022; for alliance, see Karver et al., Citation2018; Shirk et al., Citation2011; Shirk & Karver, Citation2003; for attendance see O’Keeffe & Midgley, Citation2022; Warnick et al., Citation2012).

Pioneering work related to the measurement of barriers that interfere with treatment attendance (Kazdin et al., Citation1997) laid the foundation for scores of studies exploring consumer perspectives about obstacles that interfere with help-seeking and treatment participation (e.g., Becker et al., Citation2012; Kazdin & Wassell, Citation1999; Vázquez et al., Citation2022). Other scholars have focused on developing measurement methods for detecting signals of low engagement or emerging concerns, such as through therapist report (e.g., Becker, Wu, et al., Citation2021; Gellatly et al., Citation2019) and behavioral observation methods (e.g., O’Keeffe et al., Citation2020; Wright, Brookman-Frazee et al., Citation2021). This is an important area of research because signs of low engagement can be subtle and covert dimensions of low engagement (e.g., weak alliance, poor expectancies) often precede decisions to withdraw from treatment (Aubuchon-Endsley & Callahan, Citation2009; Garcia & Weisz, Citation2002).

Scholars have also pursued measurement efforts to characterize the ways that therapists interact with youths and families (e.g., Gellatly et al., Citation2019) and the specific clinical procedures therapists use to facilitate engagement (e.g., Martinez & Haine-Schlagel, Citation2018; Martinez et al., Citation2017; E. G. Wu et al., Citation2022). Measurement methods also track behaviors that might interfere with client engagement (e.g., criticizes, misunderstands; Diamond et al., Citation1999; Karver et al., Citation2008; O’Keeffe et al., Citation2020) as well as how therapists repair the relationship following some sort of tension or professional misstep (e.g., O’Keeffe et al., Citation2020).

In sum, specialization of measurement has yielded important insights about certain dimensions of treatment engagement (e.g., alliance, attendance), yet the tradeoffs of measurement insularity include the relative scarcity of measurement of other dimensions and concerns about the variety of definitions and measures for any one dimension. Aligning measurement to represent engagement as a multidimensional, dynamic, and transactional phenomena and to represent theoretical advances will, in turn, enhance future iterations of conceptualization and theory and also improve the design and impact of engagement interventions.

Interventions

There are approximately 55 published randomized controlled trials testing engagement interventions related to children’s mental health services (Becker et al., Citation2018; Lakind et al., Citation2022). Like other aspects of the engagement literature, the interventions literature tends to be fragmented by engagement dimensions (e.g., interventions aimed at improving attendance at the first treatment session do not also target alliance). This fragmentation presents challenges because clients can experience different levels of engagement across different dimensions, and our current interventions thus require therapists to assemble engagement strategies in vivo based on their own judgment and exposure to the evidence base. In a departure from the typical stage model for developing and testing psychosocial interventions that begins with well-controlled efficacy trials, the initial tests of many engagement interventions were conducted within front-line service settings and involved general service populations (e.g., Coleman & Kaplan, Citation1990; McKay, Garcia et al., Citation1996; McKay, Nudelman, et al., Citation1996), thereby increasing the generalizability of the findings across diverse service populations and settings. Along similar lines, there are several valuable examples of independent efforts to address outstanding engagement needs for specific populations (e.g., depressed African American youth; Breland-Noble & The AAKOMA Project Adult Advisory Board, Citation2012; culturally diverse families participating in behavioral parent training; McCabe et al., Citation2020).

Research has revealed an array of procedures that work to improve treatment engagement in some way (e.g., appointment reminders, cultural acknowledgment, motivational enhancement, psychoeducation; Lindsey et al., Citation2014), and accordingly, recent efforts have begun to focus on better understanding what procedures work best for what dimension or aspect of engagement (Becker et al., Citation2015). For example, a review of 50 RCTs testing engagement interventions found that certain engagement procedures (e.g., psychoeducation) are associated with positive engagement outcomes across cognitive, behavioral, and social dimensions of engagement, whereas other engagement procedures have more focal associations with engagement outcomes along one specific dimension (e.g., appointment reminders might only improve attendance; asking about someone’s background and culture might only improve the relationship; Becker et al., Citation2018).

Some research has also investigated the timing of engagement interventions. A review of 12 engagement intervention studies by Nock and Ferriter (Citation2005) yielded guidance about ways to organize practices across the course of treatment. They found that most interventions could be classified as preparatory enhancement strategies (i.e., those for which engagement strategies are delivered only at the outset of treatment). This finding is significant because preparatory enhancement strategies (e.g., psychoeducation) presumably set the stage for some threshold of sufficient engagement at the outset of treatment. However, Nock and Ferriter suggested that continuous enhancement strategies that are delivered over the course of treatment (e.g., contingencies, telephone communication in between sessions) better reflect the dynamic nature of engagement, are focused on maintaining engagement over time, and might be useful for reducing or addressing engagement concerns that emerge over the course of treatment. This idea of designing engagement interventions that are matched to an engagement target or dimension and that are continuous across time is also reflected in person-centered approaches that assess youth or family perspectives about engagement or barriers at the outset of treatment and use this information to tailor responsive care (e.g., Becker et al., Citation2019; McCabe et al., Citation2020; McCabe & Yeh, Citation2009; Sanchez et al., Citation2022).

Many engagement interventions are also program-agnostic, meaning that they were developed independent of a specific therapeutic approach or treatment program, presumably supporting increased generalizability if practicing therapists had a way to know what was in the engagement evidence base. Whereas most EBTs for childhood problems are designed to include clinical procedures that target a specific clinical focus (e.g., anxiety, depression), they also commonly include several preparatory engagement procedures, most likely those that are considered best-suited for broad application across clients (e.g., rapport building, psychoeducation) (Chorpita & Daleiden, Citation2018; E. G. Wu et al., Citation2022). Research examining how therapists use manuals revealed that therapists return to those “preparatory” engagement strategies for more than one-third of cases, after they are otherwise out of the preparatory phase of the treatment (Park et al., Citation2015). Given concerns about treatment attrition, scholars have added focal engagement strategies to further enhance specific EBTs (e.g., Trauma-Focused CBT; Dorsey et al., Citation2014; Supporting Teens’ Academic Needs Daily (STAND); Sibley et al., Citation2016). Situating additional engagement strategies within EBTs is likely to increase their application, as research has shown that therapist selection and use of engagement procedures are largely guided by the protocol they are using (Martinez et al., Citation2017; E. G. Wu et al., Citation2022). At the same time, this insular approach to enhancing one EBT at a time does not allow treatment developers, or therapists, to leverage the entire evidence base on engagement. In its entirety, the evidence base on engagement interventions has many strengths, but further investment is needed to understand the complexity of how best to arrange these procedures, by studying how they work in the context of the general service landscape (e.g., studying what is in the engagement evidence base to address any of the challenges that arise in practice), rather than only in population-specific contexts (e.g., studying how to increase motivation within a substance use population).

A Process Illustration

We offer an illustration of our initial pursuits of these four priorities and our attempts to integrate our efforts across each.

Conceptualization

In our own work, we have organized our understanding of the engagement literature in terms of a multidimensional conceptualization. Specifically, we proposed the REACH framework (Becker et al., Citation2018) that corresponds to five dimensions of engagement: Relationship (e.g., therapeutic alliance; Shirk & Karver, Citation2003), Expectancy (e.g., beliefs that treatment will be helpful and that one can participate successfully in treatment; Nock & Kazdin, Citation2005), Attendance (e.g., presence at treatment sessions; Nock & Ferriter, Citation2005), Clarity (e.g., understanding about the treatment approach or the roles of each person involved in treatment; Shuman & Shapiro, Citation2002), and Homework, which reflects multiple participation behaviors (e.g., homework completion, in-session participation; Nock & Ferriter, Citation2005).

The REACH dimensions were rationally proposed (Becker & Chorpita, Citation2016) based on two initial literature reviews (e.g., Becker et al., Citation2015; Lindsey et al., Citation2014). We then conducted a systematic review of 50 randomized controlled trials testing engagement interventions in children’s mental health services (i.e., Becker et al., Citation2018), in which we identified a sample of effective engagement interventions and classified their discrete outcomes (within the REACH framework or otherwise), which demonstrated that the diverse ways in which the field operationalizes treatment engagement are easily consolidated within this framework. We then applied a distillation method to classify engagement procedures (i.e., “practice elements,” Chorpita & Daleiden, Citation2009; Chorpita et al., Citation2005), such as appointment reminders, psychoeducation, and instilling hope, across effective engagement interventions, thereby permitting us to summarize the common and unique procedures used across the engagement interventions literature (K. D. Becker et al., Citation2015, Citation2018). Distillation offers advantages as a literature synthesis approach beyond the typical method of identifying EBTs based on their discrete lines of research, including promoting a common language for describing the clinical features of each intervention across a taxonomically diverse literature (Chorpita et al., Citation2005) and facilitating synthesis of a literature in which there exist few formal protocols.

We then analyzed the data to identify practice elements common to interventions that were effective at increasing engagement within each REACH dimension. Practices such as psychoeducation were found to be relevant to all REACH dimensions, whereas other practices had unique associations (e.g., Relationship: cultural acknowledgment; Expectancy: motivational enhancement; see Becker et al., Citation2018). Thus, across the evidence base for engagement interventions, we extracted a multidimensional framework of treatment engagement as well as a model for matching engagement procedures with the dimensions they might be well-suited to address, which could then inform intervention development.

Theory

In our quest to build an intervention that would make as much of the evidence base as accessible as possible, we used two theories to guide our thinking. First, in their classic text, Malone and Crowston (Citation1994) defined coordination as managing dependencies among resources and activities to accomplish a goal. In mental health, for example, resources might include published research findings, manualized protocols, data collected about a client, an assessment report, a treatment plan, etc. Resources might also include people invested in youth mental health (e.g., therapists, supervisors, other service providers, youths, families). Activities can include writing an assessment report, treatment planning, delivering therapy, supervising, etc. Coordination organizes the dependencies by defining which resources are utilized (e.g., a supervisor and therapist meeting together to discuss an assessment report) for which activities (e.g., to review that report to plan together how to address the identified problem) and in what order (e.g., the plan made in supervision will precede a therapy session in which the plan is implemented). Thus, coordination theory prompted us to use the REACH framework as a consistent organizing vocabulary across all intervention resources and activities.

Second, there is an ideal flow and logic model for clinical decision-making that is represented by the Action Cycle component of Graham et al.’s (Citation2006) Knowledge to Action framework (KTA). The KTA framework articulates how research evidence is synthesized and molded into knowledge resources (e.g., manuals or other evidence summaries) for a therapist and the Action Cycle specifies a behavioral workflow that represents decision points at which therapists can interact with knowledge resources in practice. For example, problem identification is an early decision in which a therapist might interact with assessment information. Intervention selection is a subsequent decision in which a therapist might interact with intervention protocols or evidence summaries. Moreover, in a well-coordinated model, problem identification should precede the choice of a solution. This behavioral workflow of decisions is not guaranteed; rather, it must be managed independently within the service system, such as with policies, training, or management processes. Thus, the KTA framework prompted us to represent these clinical decisions of the Action Cycle in our intervention model, structure a workflow to guide intentional reflection about each decision in sequence, and ensure knowledge resources relevant to each decision were accessible when appropriate.

We were intentionally agnostic in terms of a specific psychological theory of engagement because our reliance on coordination theory and the KTA framework meant that the knowledge architecture of our intervention system should be able to accommodate the entire evidence base of engagement procedures, which each might reflect different theories or hypothesized mechanisms of change. Moreover, the architecture explicitly allows the introduction of engagement theory into the problem-solving sequence under appropriate conditions (e.g., when interventions are not getting the expected outcome; see Chorpita & Daleiden, Citation2014).

Measurement

Given the challenges with identifying engagement risk across a variety of dimensions, some quite subtle (e.g., Gearing et al., Citation2012; Hunsley et al., Citation1999), as well as with siloed instrumentation in the field, we chose to pursue a multidimensional measurement strategy. Specifically, we developed two consumer-focused self-report instruments for youths and caregivers to indicate their own level of engagement in youth mental health services. The initial versions of the My Thoughts about Therapy instruments for youths and caregivers (MTT-Y and MTT-CG, respectively) include 35 items, with 7 items representing each of the 5 REACH dimensions. Respondents rate their agreement with each item using a 4-point Likert-type scale (0 = strongly disagree to 3 = strongly agree). These measures are freely available in English and Spanish, along with a user’s guide and scoring program, at https://www.childfirst.ucla.edu/resources/.

Using these instruments, we recently empirically validated the multidimensional structure of treatment engagement. In a large sample of youths and/or their caregivers (n = 1,807), we demonstrated the empirical superiority of the 5-factor structure of the REACH framework relative to 1-factor and 4-factor models of treatment engagement, thereby providing evidence for the hypothesized multidimensionality of treatment engagement (Chorpita & Becker, Citation2022). We also demonstrated that the distinct dimensions of engagement were similar across different therapy participants (i.e., youths and caregivers), and that the factor structure was consistent across youth age, youth race, region, and caregiver language (Chorpita & Becker, Citation2022). Prior to this study, the multidimensional factor structure of treatment engagement had been presumed, but had not yet been confirmed, even in the adult services literature. We expect that as we and the field learn more about engagement, these and similar instruments will require enhancements and extensions, such as by representing more precise conceptualization (e.g., adding or editing items; adding dimensions), by conducting item-response analyses to identify items that predict subsequent engagement outcomes (e.g., attendance or attrition), or by creating briefer measures.

Intervention

We created the Reaching Families Engagement System (RFES; referred to as a coordinated knowledge system in our pilot study – Becker et al., Citation2019) that coordinates multiple evidence resources into a single system to support decisions consistent with Graham et al.’s (Citation2006) Action Cycle, including identification of engagement problems, selection of an intervention that is well-suited to the focal problem, preparation for delivering the intervention, delivery of the intervention, and evaluation of its effect on engagement (Becker et al., Citation2019). The RFES includes three knowledge resources to support each of these actions (identified in italics). First, scores from the MTT questionnaires that youths and caregivers complete about their engagement in services (identify, evaluate). Second, a worksheet used by therapists that (a) includes specific prompts representing each REACH dimension to elicit reflection about youth/caregiver engagement from the perspective of the therapist (identify) and (b) provides an explicit mapping of youth engagement problems to specific engagement practices (identify, select, prepare, evaluate) based on the associations we identified between REACH dimensions and engagement procedures in our literature review (Becker et al., Citation2018). Third, a library of brief guides that provide concise descriptions about how to use specific engagement procedures with a youth or caregiver (prepare, deliver).

The development of the RFES was guided by principles and activities consistent with the architecture of Managing and Adapting Practice (MAP; Chorpita & Daleiden, Citation2014, Citation2018). Following the MAP design principles (Chorpita & Daleiden, Citation2014), the RFES structures a purposeful, goal-directed, and self-correcting clinical reasoning process involving problem identification, selection, preparation, implementation, and evaluation in a recursive loop that continues until the engagement problem is resolved. These decisions and activities are consistent with a Deming cycle (Deming, Citation1993), a well-established decision-making process that is often referred to as a Plan-Do-Study-Act (PDSA) cycle. Research on the RFES thus far has demonstrated promising findings that the system supports the identification of engagement problems and selection of engagement procedures well-suited to that challenge (Becker et al., Citation2019), although the investigation of this system in larger trials with a wider variety of outcomes will be important.

Future Directions for the Science of Treatment Engagement

Our illustration is just one working example of a possible process of how integration across the four priorities can create synergy to advance discovery. Beyond this type of process, however, there are many ways to accelerate the science and practice of treatment engagement. Below we offer recommendations that, collectively, attempt to address gaps in the field and establish a set of guiding principles and shared concerns.

Explore Additional Dimensions of Engagement

Research appears to support five core dimensions of engagement: relationship/alliance, expectancies, attendance, understanding of therapy, and homework/session involvement (Chorpita & Becker, Citation2022). Because conceptualization informs theory, measurement, assessment, and intervention, identifying additional dimensions of engagement is an important next step. Possibilities include an affective dimension (e.g., emotions related to treatment such as relief or frustration) or a social network dimension that expands beyond the typical dyadic interactions reflected in the therapeutic alliance to represent the ways in which social norms, community stigma, or familial support for therapy encourage connections to therapy. Additional engagement dimensions would then require integration with current conceptualizations of engagement, elaboration of theory and measurement, and focus within intervention research. Given the substantive volume of research on consumer perspectives about therapy (e.g., Baker-Ericzén et al., Citation2013; Buckingham et al., Citation2016; Sylwestrzak et al., Citation2015; Wasson Simpson et al., Citation2022), a synthesis of the literature on consumer perspectives about therapy might be instrumental for elaborating existing engagement dimensions or identifying additional ones.

Develop a Structured Vocabulary to Represent Engagement Dimensions and Interventions

As is common in psychological science, there are a myriad of engagement-related terms, which impede efforts to synthesize concepts and findings across discrete models and lines of research (National Academies of Sciences, Engineering, and Medicine, Citation2022). Given the independent lines of research inquiry associated with different engagement dimensions and given that these dimensions are likely to be related in meaningful ways (e.g., lack of understanding of treatment rationale could affect homework completion or impact attendance), conceptual models as well as intervention approaches are likely to benefit from the application of one or more unifying terminology sets to the entire domain of engagement research. In the broader field, there are examples of organizing taxonomies and ontologies for classifying mental health problems (e.g., DSM, ICD), indexing published articles (i.e., Medical Subject Headings; MeSH), and characterizing behavior change theories and interventions (see Larsen et al., Citation2017) that facilitate a shared understanding and advance the field’s ability to synthesize evidence produced by a wide variety of research programs and approaches. Efforts to harmonize terminology could be fruitfully applied to dimensions of engagement (e.g., Haine-Schlagel & Walsh, Citation2015; King et al., Citation2014; Piotrowska et al., Citation2017; Pullmann et al., Citation2013; Staudt, Citation2007), specific engagement-related client behaviors (e.g., Chamberlain et al., Citation1984; Gellatly et al., Citation2019; McLeod & Weisz, Citation2005; O’Keeffe et al., Citation2020), specific engagement-related therapist behaviors (e.g., Karver et al., Citation2008; Martinez & Haine-Schlagel, Citation2018; O’Keeffe et al., Citation2020), and engagement intervention procedures (e.g., Becker et al., Citation2018; Pellecchia et al., Citation2018).

Deliberate attempts to create shared specifications of relevant constructs across the entire field of engagement science are likely to expose meaningful similarities and differences across discrete research endeavors. For example, some scholars might consider a client’s understanding about what therapy involves as a facet of alliance (e.g., Karver et al., Citation2008), whereas other scholars might conceptualize this type of understanding as a discrete cognitive dimension (e.g., K. D. Becker et al., Citation2018). Thus, one downstream benefit of explicitly attending to terminology is the potential to improve precision within and across each of the four integrated priorities. By revealing overlap, omissions, and underspecification across discrete research efforts, the application of a controlled vocabulary or terminology set can increase conceptual clarity and precision, which, in turn, advance our ability to clearly articulate associations among theoretical constructs, to develop methods that validly represent these constructs, and to specify our interventions clearly to test theory-driven hypotheses (Larsen et al., Citation2017).

Consider Reporting Standards to Increase Consistency Across Studies

As knowledge accumulates about treatment engagement, the synthesis across discrete studies with distinct methods, measures, and terms, becomes increasingly more complex. In psychology more broadly, efforts to increase the quality of reporting have been successful at making data from primary studies more interpretable in general and more usable for secondary synthesis in particular (e.g., Consolidated Standards of Reporting Trials [CONSORT]: Altman et al., Citation2001; Turner et al., Citation2012; Journal Article Reporting Standards [JARS]: APA Publications and Communications Board Working Group on Journal Article Reporting Standards, Citation2008). Consensus statements have been developed about reporting for specific types of studies, such as child and adolescent anxiety disorder intervention studies (i.e., Creswell et al., Citation2021). Reporting standards will likely vary based on the research question and methods. Given the ubiquity and ease of measuring attendance, and the need for continued measure development and/or refinement for the other dimensions, we offer three ideas for the application of reporting standards specific to attendance that could be implemented in the immediate future.

First, reporting standards could recommend reporting attrition and/or attendance rates for every study testing a youth mental health intervention. One study revealed that 30–50% of intervention studies of behavioral parent training did not report information about study attrition or attendance (Chacko et al., Citation2016); thus, this recommendation would increase the interpretability of each discrete study’s outcomes and intervention feasibility and impact. Second, reporting standards could recommend multiple ways for calculating and reporting attrition and attendance rates within the same study, thereby further increasing the interpretability of any one study’s rates as well as the synthesis across studies. This is important because research has shown that rates vary according to how attrition and attendance are operationalized and measured (Warnick et al., Citation2012). Third, when attrition and attendance are dependent variables, reporting standards could recommend that study authors conduct analyses with different operationalizations of the dependent variables to examine if and how operationalization affects results (e.g., risk factors for attrition might vary according to its operationalization; Warnick et al., Citation2012). This standard would not only enhance the interpretability of study findings and aid synthesis across studies but also contribute to the understanding of how measurement affects results and what operationalization is useful for what purpose (Warnick et al., Citation2012).

In addition, although attendance and attrition are pragmatically significant engagement indicators, they are the bare minimum that should be recommended by reporting standards. Similarly, psychology journals are the tip of the iceberg when it comes to applicability of these proposed reporting standards. For example, robust reporting recommendations could include each of the five engagement dimensions and be recommended in intervention studies in all of healthcare. Multidimensional reporting standards on a widespread basis would accelerate our understanding of the impact of interventions on an array of engagement outcomes as well as the extent to which these discrete engagement dimensions covary, not just within individual studies, not just within psychology, but across the 75 RCTs published per day in healthcare fields (Bastian et al., Citation2010). Moreover, multidimensional measurement could yield valuable information when an intervention did not produce the expected clinical effects. Knowing that an individual had limited understanding of the therapeutic rationale or that they did not complete therapy homework regularly might reveal potentially malleable targets for future intervention. In this vein, multidimensional measurement closely aligns with the logic behind experimental therapeutics initiatives, which attempt to understand why an intervention did or did not work and thus point to where future efforts should be directed to enhance impact and outcomes, that are widespread in healthcare and explicitly supported by the National Institute of Mental Health (Gordon, Citation2017). In addition, multidimensional measurement of engagement parallels calls made decades ago by leaders in the field for the multidimensional measurement of intervention outcomes (e.g., functioning, consumer perspectives, environmental contexts) that extended beyond clinical symptoms (Hoagwood et al., Citation1996; P. S. Jensen et al., Citation1996) and resulted in notable expansions in multidimensional reporting (Hoagwood et al., Citation2012; Krause et al., Citation2019).

Develop and Test Theories that Represent the Multidimensional, Dynamic, and Transactional Conceptualization of Engagement

Although all theories are incomplete representations, we can use existing research and theory to develop new theories with sufficient verisimilitude to provide a foundation for testing and amending our ideas (Meehl, Citation1990). In its simplest form, such a theory could put forth clearly specified constructs, articulate the associations among them (e.g., alliance and expectancies will be positively correlated; C. L. Patterson et al., Citation2014) and hypothesize the mechanism of association (e.g., as people develop connections with someone they view as caring and competent, they have increased optimism for success). A more elaborate theory might also include clinical outcomes and predict the magnitude of the effect of each dimension on outcomes based on what has been previously observed in research (e.g., alliance will have a stronger effect on outcomes than will expectations; Constantino et al., Citation2021; Karver et al., Citation2018). Given that engagement is dynamic, another iteration might specify temporal associations among dimensions (e.g., pre-treatment expectancies will be associated with mid-treatment alliance; Kirsch et al., Citation2018; change in alliance will predict later participation in therapeutic activities; McLeod et al., Citation2014), evaluate mediational effects (e.g., in-session rehearsal will mediate the effects of pre-treatment expectancies on outcomes; M. S. Wu et al., Citation2020), and examine the direction and reciprocity of effects between engagement and clinical symptoms (e.g., early alliance will predict subsequent clinical symptoms but early symptoms will not predict subsequent alliance; Labouliere et al., Citation2017).

Further elaborating the real-world phenomena that influence engagement dimensions is also an essential step in theory development. This involves extending beyond post hoc analyses of the associations between pre-treatment youth or therapist characteristics and engagement and instead building upon previous correlational and experimental research and articulating causal relationships that are manipulable within experimental designs. Elaborating and testing theories about what interventions impact different engagement dimensions, mechanisms of change, the thresholds at which engagement problems emerge, or the conditions that influence high or low engagement would significantly advance our understanding of engagement. For example, an evolving theory might predict that certain engagement procedures (e.g., psychoeducation, rapport building) would generally be useful at the outset of treatment to establish a minimum but sufficient level of alliance and expectancy, but that if new problems emerge, other, more robust engagement procedures (e.g., exploring a client’s specific identities or motivation) would be required to address these concerns.

Develop and Apply Measurement Methods that Represent the Multidimensional, Dynamic, and Transactional Conceptualization of Engagement

Further advances in the realms of conceptualization, theory, and intervention are predicated on measurement that adequately represents the conceptualization of engagement. Thus, an important step toward enhancing theory and the application of science in practice is to include measures representing each engagement dimension and to measure dimensions across time (cf. Hoagwood et al., Citation1996, in the context of mental health services). Using measures and methods that reflect the multidimensional and dynamic nature of engagement within the same study will yield insight about some of the questions deemed essential by our theories: what measures are well-suited to assess different engagement dimensions, how early different types of engagement problems can be detected, how different engagement dimensions change over time, what interventions bring about change on different dimensions, how different engagement dimensions relate to one another over time, and how each dimension is related to treatment outcome. In addition, multidimensional measurement across time within a single study would set up the conditions necessary to conduct mediational analyses that might be hypothesized in theory but are largely unexplored in the literature (Becker et al., Citation2018).

Although measuring multiple engagement dimensions within a single study is currently possible with existing methods and instruments, this approach would typically require using different instruments that each reflect a discrete engagement dimension. Given the issues introduced by method variance confounds (e.g., observation for one dimension, questionnaire another), it will be important to consider approaches that have some capacity for measuring multiple dimensions of engagement within a single measurement instrument for each informant. A uniform measurement approach would provide greater confidence that the results are not merely an artifact of different measurement strategies but instead are attributable to engagement as a construct.

Identification of candidate indicators to build new measures or “indicator libraries” can possibly be accelerated through natural language processing (NLP), which involves techniques to quantify words, phrases, and syntax into meaningful sets to promote comparison and synthesis. As has been done in behavioral medicine (e.g., Larsen & Bong, Citation2016), for example, NLP permits comparison across instruments to identify similar items and constructs. One could apply NLP to alliance measures, for example, to determine the facets of alliance represented by different measures (e.g., therapist alliance represents bond and task agreement whereas youth alliance represents an affective component; Ormhaug et al., Citation2015).

Aside from the in-depth work on alliance, much of what is currently known about engagement is based on coarse behavioral observation or global ratings, which do not easily represent engagement as a transactional phenomenon. Thus, an important future direction involves development of not only more granular multidimensional measures but also those that elicit perspectives from different individuals (e.g., youths, caregivers, therapists, case managers, clinical supervisors, etc.) regarding youth and caregiver engagement in services. A recent meta-analysis yielded moderate associations between youth-therapist and parent-therapist reports of dyadic alliance, with youths and parents reporting higher alliance than therapists (Roest et al., Citation2022). Obtaining information from different informants can reveal each respondent’s unique contexts and perspectives, as well as whether certain perspectives are more relevant for certain engagement outcomes. For example, studies suggest that youth-rated alliance is more strongly associated with treatment outcomes than is therapist-rated alliance (Murphy & Hutton, Citation2018; Ovenstad et al., Citation2022). Informant discrepancies provide rich and complementary perspectives that enhance our understanding of a phenomenon and that might be otherwise unnoticeable by eliciting a single perspective (De Los Reyes et al., Citation2022; Kraemer et al., Citation2003). Important research questions include: what information do therapists use to assess engagement, on what dimensions do therapist perspectives vary from those of youths or caregivers, and how do therapists adjust their clinical care when given feedback about engagement.

Build Pragmatic Detection and Monitoring Technologies

As measurement approaches mature, it will also be important to consider how to organize assessment for the purpose of ongoing risk identification and associated risk management. Given that therapists often have difficulty assessing engagement (e.g., Becker, Wu, et al., Citation2021; Hunsley et al., Citation1999), rapid, timely, and intermittent assessment is essential to detect engagement concerns before they escalate. Detection technology might include a questionnaire administered and scored within a digital platform that is completed by a youth or caregiver prior to or after a treatment session. Scores that indicate engagement concerns could be shared with the therapist to guide intervention, as well as tracked over time to monitor progress. This type of engagement monitoring and feedback could leverage decades of research demonstrating the value of measurement and feedback systems to clinical practice (e.g., Chorpita et al., Citation2008, Citation2016; Lambert, Citation2005; Lambert et al., Citation2003), including a meta-analysis that revealed that feedback on process indicators (e.g., alliance, in-session participation) produced greater effect sizes in clinical outcomes compared to feedback on progress indicators (e.g., reported symptoms) (Poston & Hanson, Citation2010). It is critical that any such approaches be efficient and pragmatic, which means future research will benefit from the application of such methods as Item Response Theory and adaptive testing to large sets of empirical indicators of engagement dimensions, as well as consideration of passive monitoring strategies, such as machine-assisted analysis of a wide variety of naturally occurring inputs (e.g., facial expression, attendance and arrival records, online homework completion or quality, client or therapist vocal intonation, chart note documentation, live dialogue in therapy events, etc.).

Build Responsive Intervention Systems

Research has demonstrated that therapists typically rely on a narrow subset of engagement procedures from the evidence base (Becker, Dickerson, et al., Citation2021) and use ecologically proximal supports to guide their selection and use of engagement strategies (e.g., procedures recommended in a treatment manual being used, as opposed to what the broader engagement literature might suggest; E. G. Wu et al., Citation2022). Thus, in the absence of a system of supports, it is naïve to expect therapists to maximize opportunities to promote engagement or to substantially reduce the impact of engagement challenges. Moreover, any such system must also be responsive to the substantial array of different possible clinical presentations of low engagement. Selecting only a handful of engagement procedures from the evidence base would be insufficient, instead representing a “tip of the iceberg” approach to responsive intervention (Becker et al., Citation2018, p. 18). Instead, to leverage the full evidence base of more than 40 years of engagement interventions research, it would be helpful to organize intervention resources into a common system with a unifying interface (Becker et al., Citation2018), perhaps along with a library of instructional resources for delivering these engagement procedures.

To capitalize on the connection between assessment and intervention, this system would require some harmonization across detection/monitoring technologies and intervention resources, such that there is a clear mapping of engagement targets and challenges to their indicated solutions, supporting therapists to know what to use when (Becker, Dickerson, et al., Citation2021). A responsive intervention system would also benefit from the capacity to integrate the continually growing and evolving evidence base and support therapist use of the various engagement procedures in that evidence base, so that they are best matched to the context at hand. Moreover, members of the workforce beyond the individual therapist could be leveraged to deliver select engagement procedures or components thereof (e.g., front office staff who provide appointment reminders could use additional engagement strategies to enhance these reminders; Donohue et al., Citation1998). As another example, informational brochures or videos could be designed to capitalize on engagement strategies as part of an organizational-level approach to enhancing treatment engagement.

Reconceptualize the “Engaging” Therapist

There are implicit premises about what it means to be effective at engaging youths and families in treatment, which are often revealed in a description of the traits or attributes of a therapist (e.g., warm, caring, thoughtful). This implicit notion that engagement may be dependent on the therapist’s traits inhibits a more deliberate inspection of which specific behaviors are important for which youths in which context. Moreover, a corresponding inference is that these traits are naturally-occurring baseline attributes of a given therapist, rather than reflective of deliberate and intentional behaviors used to engage youths and families in treatment and the transactional nature of therapist–client relationships (G. R. Patterson & Chamberlain, Citation1994). Although there is some natural variation across therapists in certain interpersonal characteristics, engagement represents a set of related competencies that can be developed in anyone through the teaching of specific behaviors (e.g., explaining the rationale for an intervention, expressing optimism, or modeling a new skill for a youth). The precise set of behavioral competencies and transactional or contextual conditions that can effectively engage youths and families will evolve as new research emerges. However, the science of engagement will benefit from adopting an explicit perspective that engaging behaviors and conditions represent an inspectable set of phenomena that can be dismantled, manipulated, or trained, rather than presumed to be merely trait-like or background features of the therapist in context.

Elevate Consumers and their Communities in Research and Efforts Related to Engagement

Although engagement interventions have been tested with success in front-line service contexts and with racially diverse samples (Becker et al., Citation2018), more attention is needed about including individuals in research who represent diversity across race, ethnicity, language, religion, gender and sexual orientation, socioeconomic status, and geographic region (Polo et al., Citation2019). Such initiatives should not only increase inclusion of groups of individuals whose numbers are grossly underrepresented in research but also amplify the voices and perspectives of individuals from diverse backgrounds. A substantial body of research has elicited youth and caregiver perspectives about obstacles that make it difficult for them to access and consistently participate in treatment (e.g., therapist turnover, feeling blamed or misunderstood by therapists, competing priorities, stigma, discrimination, scheduling, transportation, etc.; Bornheimer et al., Citation2018; Buckingham et al., Citation2016; Kazdin et al., Citation1997; Lindsey et al., Citation2013; McKay & Bannon, Citation2004). Finding solutions to these explicit challenges as experienced by mental health consumers is a significant priority because many existing interventions do not align with family priorities or concerns but instead are guided by a specific engagement target (e.g., rather than reducing stigma, an intervention might focus on increasing expectancies or alliance).

Research has identified community-level characteristics that are associated with reduced help-seeking and treatment engagement (e.g., Cooper et al., Citation2020; Ijadi-Maghsoodi et al., Citation2018; Price et al., Citation2022; Wadsworth et al., Citation2018); thus, social-ecological models offer promise for our four integrated priorities. Initiatives to theorize, measure, and intervene on community-level support for mental health services could complement present efforts to impact engagement within the dyadic relationship between therapists and clients and might provide avenues for connecting with the many youths who might otherwise never enroll in mental health services (Merikangas et al., Citation2010). Future research could apply multidimensional measurement of engagement to pre-treatment help-seeking or population-level perspectives about mental health services to identify dimensions that could serve as facilitators (e.g., strong relationships with faith leaders) or barriers (e.g., distrust of medical system) for enrollment in services.

This work will be advanced by connecting with important and untapped lines of research that could produce much synergy and if they could be integrated with engagement research, including research on stigma (e.g., Price & Hollinsaid, Citation2022), mental health literacy (e.g., A. Wright et al., Citation2006; Jorm, Citation2012), and direct to consumer marketing (e.g., Becker et al., Citation2020). Therapist perspectives are also of great value to the four integrated priorities. Research that examines therapist experiences with engaging youth and families (e.g., Becker, Dickerson, et al., Citation2021; Becker, Wu, et al., Citation2021; Eubanks, Burckell, et al., Citation2018) or with using specific engagement interventions (e.g., W. Chu et al., Citation2022; Haine-Schlagel et al., Citation2017) can shed light on the features of their professional judgment and habits that align with theory and consumer perspectives as well as other areas that might be supported through professional development.

Recognize, Prioritize, and Incentivize Treatment Engagement as an Intellectual Focus Independent of EBTs

Twenty years ago, implementation science was not recognized as a dedicated focus of expertise within clinical psychology. Rather, implementation was an important focus, but efforts fell under the purview of treatment developers to design implementation strategies for their specific EBT, which were largely siloed from the growing body of implementation research within our field, and the even larger evidence base on implementation outside of psychology. So too is our field trending in this way when it comes to treatment engagement. Many studies on treatment engagement have been conducted ad hoc as an aspect of intervention outcome studies for specific populations. A search on NIH Reporter revealed that much of the funded engagement research is also within the context of examining engagement for those receiving a specific intervention. Although these discrete, effects-in-context efforts can yield value, developing engagement interventions for discrete EBTs will not sufficiently advance science, let alone impact practice, if the field must wait for each EBT developer to design and test their own set of engagement strategies. An alternative vision is that, as has occurred with implementation science in psychology, the field would uncouple engagement and clinical interventions research and pursue a standalone area of engagement science, focusing broadly on the four priorities outlined above. Importantly, institutions would need to recognize the intellectual independence of treatment engagement, such as by explicitly recruiting engagement science experts, as has become more commonplace for those with implementation or health disparities expertise.

Coordinate Efforts in the Field to Advance these Priorities

Given expertise in the field within discrete lines of research, now is an optimal time for collaboration across parties invested in youth mental health – scientists, funders, professional organizations, publishers, and consumers – to pursue these recommendations and advance these four priorities. For example, terminology development requires coordination across invested parties to formally specify a shared vocabulary and definitions that will be used in science, funding announcements, and reporting standards to further accelerate integration of knowledge about treatment engagement across the field. Theory development requires deemphasizing statistical identification of effects (van Rooij & Baggio, Citation2021) and instead committing to robust explanatory paradigms (Lilienfeld, Citation2010; Proulx & Morey, Citation2021), which could be accelerated and elevated by collaboration to clarify concepts and measurement, hypothesize associations between concepts, prioritize research questions considered important by theory, and recommend methodological strategies for answering prioritized questions (Proulx et al., Citation2021). Models and recommendations for coordinating efforts are available in the literature (see Michie et al., Citation2018; National Academies of Sciences, Engineering, and Medicine, Citation2022).

Heed Diction

It is of course important to be cautious with potentially biased terms. Words such as compliance, adherence, and motivation are widely used in academic writing and federal reports. These terms might reflect a desire for an all-purpose term to represent complex phenomena, but they are problematic because they presume the superiority of an expert-identified course of treatment and situate accountability for treatment participation squarely on the shoulders of the mental health consumer (Nock & Ferriter, Citation2005; Staudt, Citation2007). Related labels, such as difficult, non-compliant, unmotivated, resistant, and hard to engage, that have penetrated the professional lexicon are even more problematic because they ignore research that shows that inconsistency or ambivalence about behavior change is a universal feature of normal behavior (Patterson & Chamberlain, Citation1994). Such language conveys a speaker’s internal and stable attributions about youths and families, exacerbate implicit bias against traditionally underserved populations, and inhibit action on the part of the therapist. Moving away from this language and toward language that reflects engagement as dynamic (e.g., Chu et al., Citation2014; Halfon et al., Citation2019) and transactional (Fjermestad et al., Citation2021; Ovenstad et al., Citation2020; O’Keeffe et al., Citation2020) will advance our thinking and hence our science. In our own work, we prefer to use the terms “engagement” to describe the general concept and “low engagement” to refer to circumstances when problems are apparent. Our strong preference, however, is to disambiguate the term “engagement” and refer to more granular and focal indicators.

Conclusion

The field owes a debt to pioneers in the field who, for 65 years, have studied patterns of attrition, analyzed interactions between clients and therapists, pursued deep understanding of therapeutic relationships and processes, examined barriers to treatment, designed interventions to improve engagement, and raised their voices about engagement and empowerment. These scholars knew that for services to help the most vulnerable populations, the field must establish favorable conditions for youths and families to make meaningful connections to therapy. These efforts paved the way for scores of others to pursue engagement research in a scientific context, which continues to lack recognition as a discrete discipline and that is disproportionately under-resourced relative to its relevance to having a robust and finished bridge between science and service.

Our reflection on this important work embodies two paradoxes. First, there have been so many critical efforts related to treatment engagement that a lengthy review to consolidate and make sense of them precluded an in-depth review of any one of them. Second, because there are already many scholars making significant contributions to the science of treatment engagement, we are at a time when we actually need even more people working in this area, and specifically, building a collaborative infrastructure for that community of scholars to work in a more cumulative and coordinated manner. The field cannot remain satisfied with the rudimentary span arising from our good investments in intervention and implementation science. Rather, to honor those investments, the field and its institutions must prioritize engagement science as well. This focus will require the same incentives that have accelerated other research initiatives, making it easier to collaborate and to advance and elevate these four integrated priorities we have outlined above. We look forward to a bridge from science to service that can work for all, even under the most taxing conditions.

Disclosure Statement

No potential conflict of interest was reported by the author(s).

Additional information

Funding

This work was supported, in part, by the William T. Grant Foundation. Award #187173: Coordinated Knowledge Systems: Connecting Evidence to Action to Engage Students in School Mental Health (PI: Chorpita; Co-PI: Becker). Award # 190304: Consistently Crucial but Invariably Ignored: Testing the Role of Coordination in the Use of Research Evidence (PI: Becker; Co-PI: Chorpita).

References

  • Ajzen, I. (1985). From intentions to actions: A theory of planned behavior. In J. Kuhl & J. Beckmann (Eds.), Action control (pp. 11–39). Springer. https://doi.org/10.1007/978-3-642-69746-3_2
  • Ajzen, I. (2011). The theory of planned behaviour: Reactions and reflections. Psychology & Health, 26(9), 1113–1127. https://doi.org/10.1080/08870446.2011.613995
  • Ajzen, I. (2015). The theory of planned behaviour is alive and well, and not ready to retire: A commentary on Sniehotta, Presseau, and Araújo-Soares. Health Psychology Review, 9(2), 131–137. https://doi.org/10.1080/17437199.2014.883474
  • Ajzen, I. (2020). The theory of planned behavior: Frequently asked questions. Human Behavior and Emerging Technologies, 2(4), 314–324. https://doi.org/10.1002/hbe2.195
  • Altman, D. G., Schulz, K. F., Moher, D., Egger, M., Davidoff, F., Elbourne, D., Gøtzsche, P. C., Lang, T. & CONSORT GROUP (Consolidated Standards of Reporting Trials. (2001). The revised CONSORT statement for reporting randomized trials: Explanation and elaboration. Annals of Internal Medicine, 134(8), 663–694. https://doi.org/10.7326/0003-4819-134-8-200104170-00012
  • APA Publications and Communications Board Working Group on Journal Article Reporting Standards. (2008). Reporting standards for research in psychology: Why do we need them? What might they be? The American Psychologist, 63(9), 839–851. https://doi.org/10.1037/0003-066X.63.9.839
  • Aubuchon-Endsley, N. L., & Callahan, J. L. (2009). The hour of departure: Predicting attrition in the training clinic from role expectancies. Training and Education in Professional Psychology, 3(2), 120–126. https://doi.org/10.1037/a0014455
  • Baekeland, F., & Lundwall, L. (1975). Dropping out of treatment: A critical review. Psychological Bulletin, 82(5), 738–783. https://doi.org/10.1037/h0077132
  • Baker-Ericzén, M. J., Jenkins, M. M., & Haine-Schlagel, R. (2013). Therapist, parent, and youth perspectives of treatment barriers to family-focused community outpatient mental health services. Journal of Child and Family Studies, 22(6), 854–868. https://doi.org/10.1007/s10826-012-9644-7
  • Barrett, M. S., Chua, W.-J., Crits-Christoph, P., Gibbons, M. B., & Thompson, D. (2008). Early withdrawal from mental health treatment: Implications for psychotherapy practice. Psychotherapy: Theory, Research, Practice, Training, 45(2), 247–267. https://doi.org/10.1037/0033-3204.45.2.247
  • Bastian, H., Glasziou, P., & Chalmers, I. (2010). Seventy-five trials and eleven systematic reviews a day: How will we ever keep up? PLoS Medicine, 7(9), e1000326. https://doi.org/10.1371/journal.pmed.1000326
  • Becker, K. D., Boustani, M., Gellatly, R., & Chorpita, B. F. (2018). Forty years of engagement research in children’s mental health services: Multidimensional measurement and practice elements. Journal of Clinical Child & Adolescent Psychology, 47(1), 1–23. https://doi.org/10.1080/15374416.2017.1326121
  • Becker, K. D., & Chorpita, B. (2016, August). Enhancing the design of engagement interventions to enhance the public health impact of mental health treatments for youth. In K. Becker ( Chair), Extending the reach and impact of science on clinical care for youth and families: Looking for new models for the old challenges [Symposium presentation]. The 23rd NIMH Conference on Mental Health Services Research: Harnessing Science to Strengthen the Public Health Impact, Bethesda, MD.
  • Becker, K. D., Dickerson, K., Boustani, M. M., & Chorpita, B. F. (2021). Knowing what to do and when to do it: Mental health professionals and the evidence base for treatment engagement. Administration and Policy in Mental Health and Mental Health Services Research, 48(2), 201–218. https://doi.org/10.1007/s10488-020-01067-6
  • Becker, K. D., Lee, B. R., Daleiden, E. L., Lindsey, M., Brandt, N. E., & Chorpita, B. F. (2015). The common elements of engagement in children’s mental health services: Which elements for which outcomes? Journal of Clinical Child & Adolescent Psychology, 44(1), 30–43. https://doi.org/10.1080/15374416.2013.814543
  • Becker, K. D., Mathis, G., Mueller, C. W., Issari, K., Atta, S. S., & Okado, I. (2012). Barriers to treatment in an ethnically diverse sample of families enrolled in a community-based domestic violence intervention. Journal of Aggression, Maltreatment & Trauma, 21(8), 829–850. https://doi.org/10.1080/10926771.2012.708013
  • Becker, K. D., Park, A. L., Boustani, M. M., & Chorpita, B. F. (2019). A pilot study to examine the feasibility and acceptability of a coordinated intervention design to address treatment engagement challenges in school mental health services. Journal of School Psychology, 76, 78–88. https://doi.org/10.1016/j.jsp.2019.07.013
  • Becker, K. D., Wu, E. G., Hukill, A., Brandt, N., & Chorpita, B. F. (2021). How do mental health providers assess treatment engagement of youth and caregivers? Journal of Child and Family Studies, 30(10), 2527–2538. https://doi.org/10.1007/s10826-021-02042-x
  • Becker, S. J., Helseth, S. A., Tavares, T. L., Squires, D. D., Clark, M. A., Zeithaml, V. A., & Spirito, A. (2020). User-informed marketing versus standard description to drive demand for evidence-based therapy: A randomized controlled trial. The American Psychologist, 75(8), 1038–1051. https://doi.org/10.1037/amp0000635
  • Beutler, L. E. (1991). Have all won and must all have prizes? Revisiting Luborsky et al.’s verdict. Journal of Consulting and Clinical Psychology, 59(2), 226–232. https://doi.org/10.1037/0022-006X.59.2.226
  • Bickman, L., Heflinger, C. A., Northrup, D., Sonnichsen, S., & Schilling, S. (1998). Long term outcomes to family caregiver empowerment. Journal of Child and Family Studies, 7(3), 269–282. https://doi.org/10.1023/A:1022937327049
  • Bornheimer, L. A., Acri, M. C., Gopalan, G., & McKay, M. M. (2018). Barriers to service utilization and child mental health treatment attendance among poverty-affected families. Psychiatric Services, 69(10), 1101–1104. https://doi.org/10.1176/appi.ps.201700317
  • Breland-Noble, A. M., & The AAKOMA Project Adult Advisory Board. (2012). Community and treatment engagement for depressed African American youth: The AAKOMA FLOA pilot. Journal of Clinical Psychology in Medical Settings, 19(1), 41–48. https://doi.org/10.1007/s10880-011-9281-0
  • Buckingham, S. L., Brandt, N. E., Becker, K. D., Gordon, D., & Cammack, N. (2016). Collaboration, empowerment, and advocacy: Consumer perspectives about treatment engagement. Journal of Child and Family Studies, 25(12), 3702–3715. https://doi.org/10.1007/s10826-016-0507-5
  • Caro-Bautista, J., Villa-Estrada, F., Gómez-González, A., Lupiáñez-Pérez, I., Morilla-Herrera, J. C., Kaknani-Uttumchandani, S., García-Mayor, S., & Morales-Asencio, J. M. (2021). Effectiveness of a diabetes education program based on tailored interventions and theory of planned behaviour: Cluster randomized controlled trial protocol. Journal of Advanced Nursing, 77(1), 427–438. https://doi.org/10.1111/jan.14580
  • Carson, N. J., Stewart, M., Lin, J. Y., & Alegria, M. (2011). Use and quality of mental health services for Haitian youth. Ethnicity & Health, 16(6), 567–582. https://doi.org/10.1080/13557858.2011.586024
  • Chacko, A., Jensen, S. A., Lowry, L. S., Cornwell, M., Chimklis, A., Chan, E., Lee, D., & Pulgarin, B. (2016). Engagement in behavioral parent training: Review of the literature and implications for practice. Clinical Child and Family Psychology Review, 19(3), 204–215. https://doi.org/10.1007/s10567-016-0205-2
  • Chamberlain, P., Patterson, G., Reid, J., Kavanagh, K., & Forgatch, M. (1984). Observation of client resistance. Behavior Therapy, 15(2), 144–155. https://doi.org/10.1016/S0005-7894(84)80016-7
  • Chang, J. P., Orimoto, T. E., Burgess, A., Choy, S. K. J., & Nakamura, B. J. (2019). The theory of planned behavior applied to consumer engagement in evidence-based services. Journal of Child and Family Studies, 28(11), 2963–2976. https://doi.org/10.1007/s10826-019-01472-y
  • Chorpita, B. F. (2003). The frontier of evidence-based practice. In A. E. Kazdin & J. R. Weisz (Eds.), Evidence-based psychotherapies for children and adolescents (pp. 42–59). The Guilford Press.
  • Chorpita, B. F., & Becker, K. D. (2022). Dimensions of treatment engagement among youth and caregivers: Structural validity of the REACH framework. Journal of Consulting and Clinical Psychology, 90(3), 258–271. https://doi.org/10.1037/ccp0000711
  • Chorpita, B. F., Bernstein, A., Daleiden, E. L., & The Research Network on Youth Mental Health. (2008). Driving with roadmaps and dashboards: Using information resources to structure the decision models in service organizations. Administration and Policy in Mental Health and Mental Health Services Research, 35(1–2), 114–123. https://doi.org/10.1007/s10488-007-0151-x
  • Chorpita, B. F., & Daleiden, E. L. (2009). Mapping evidence-based treatments for children and adolescents: Application of the distillation and matching model to 615 treatments from 322 randomized trials. Journal of Consulting and Clinical Psychology, 77(3), 566–579. https://doi.org/10.1037/a0014565
  • Chorpita, B. F., & Daleiden, E. L. (2014). Structuring the collaboration of science and service in pursuit of a shared vision. Journal of Clinical Child & Adolescent Psychology, 43(2), 323–338. https://doi.org/10.1080/15374416.2013.828297
  • Chorpita, B. F., & Daleiden, E. L. (2018). Coordinated strategic action: Aspiring to wisdom in mental health service systems. Clinical Psychology: Science and Practice, 25(4). https://doi.org/10.1111/cpsp.12264
  • Chorpita, B. F., Daleiden, E. L., & Bernstein, A. D. (2016). At the intersection of health information technology and decision support: Measurement feedback systems … and beyond. Administration and Policy in Mental Health and Mental Health Services Research, 43(3), 471–477. https://doi.org/10.1007/s10488-015-0702-5
  • Chorpita, B. F., Daleiden, E. L., Park, A. L., Ward, A. M., Levy, M. C., Cromley, T., Chiu, A. W., Letamendi, A. M., Tsai, K. H., & Krull, J. L. (2017). Child STEPs in California: A cluster randomized effectiveness trial comparing modular treatment with community implemented treatment for youth with anxiety, depression, conduct problems, or traumatic stress. Journal of Consulting and Clinical Psychology, 85(1), 13–25. https://doi.org/10.1037/ccp0000133
  • Chorpita, B. F., Daleiden, E. L., & Weisz, J. R. (2005). Identifying and selecting the common elements of evidence based interventions: A distillation and matching model. Mental Health Services Research, 7(1), 5–20. https://doi.org/10.1007/s11020-005-1962-6
  • Chu, B. C., Skriner, L. C., & Zandberg, L. J. (2014). Trajectory and predictors of alliance in cognitive behavioral therapy for youth anxiety. Journal of Clinical Child & Adolescent Psychology, 43(5), 721–734. https://doi.org/10.1080/15374416.2013.785358
  • Chu, W., Becker, K. D., Boustani, M. M., Park, A. L., & Chorpita, B. F. (2022). Is it easy to use and useful? Mental health professionals’ perspectives inform development of a novel treatment engagement system for youth mental health services. Cognitive and Behavioral Practice. Advance online publication. https://doi.org/10.1016/j.cbpra.2021.11.003
  • Cohen, J. A., Mannarino, A. P., & Iyengar, S. (2011). Community treatment of posttraumatic stress disorder for children exposed to intimate partner violence: A randomized controlled trial. Archives of Pediatrics & Adolescent Medicine, 165(1), 16–21. https://doi.org/10.1001/archpediatrics.2010.247
  • Coleman, D. J., & Kaplan, M. S. (1990). Effects of pretherapy videotape preparation on child therapy outcomes. Professional Psychology, Research and Practice, 21(3), 199–203. https://doi.org/10.1037/0735-7028.21.3.199
  • Constantino, M. J., Coyne, A. E., Goodwin, B. J., Vîslă, A., Flückiger, C., Muir, H. J., & Gaines, A. N. (2021). Indirect effect of patient outcome expectation on improvement through alliance quality: A meta-analysis. Psychotherapy Research, 31(6), 711–725. https://doi.org/10.1080/10503307.2020.1851058
  • Cook, B. L., Barry, C. L., & Busch, S. H. (2013). Racial/ethnic disparity trends in children’s mental health care access and expenditures from 2002 to 2007. Health Services Research, 48(1), 129–149. https://doi.org/10.1111/j.1475-6773.2012.01439.x
  • Cooper, D. K., Wieling, E., Domenech Rodríguez, M. M., Garcia–huidobro, D., Baumann, A., Mejia, A., Le, H., Cardemil, E. V., & Acevedo–polakovich, I. D. (2020). Latinx mental health scholars’ experiences with cultural adaptation and implementation of systemic family interventions. Family Process, 59(2), 492–508. https://doi.org/10.1111/famp.12433
  • Courneya, K. S., Conner, M., & Rhodes, R. E. (2006). Effects of different measurement scales on the variability and predictive validity of the “two-component” model of the theory of planned behavior in the exercise domain. Psychology & Health, 21(5), 557–570. https://doi.org/10.1080/14768320500422857
  • Coutinho, J., Ribeiro, E., Hill, C., & Safran, J. (2011). Therapists’ and clients’ experiences of alliance ruptures: A qualitative study. Psychotherapy Research, 21(5), 525–540. https://doi.org/10.1080/10503307.2011.587469
  • Creswell, C., Nauta, M. H., Hudson, J. L., March, S., Reardon, T., Arendt, K., Bodden, D., Cobham, V. E., Donovan, C., Halldorsson, B., In–albon, T., Ishikawa, S., Johnsen, D. B., Jolstedt, M., Jong, R., Kreuze, L., Mobach, L., Rapee, R. M., Spence, S. H., … Kendall, P. C. (2021). Research review: Recommendations for reporting on treatment trials for child and adolescent anxiety disorders – An international consensus statement. Journal of Child Psychology and Psychiatry, 62(3), 255–269. https://doi.org/10.1111/jcpp.13283
  • Daykin, A., Clement, C., Gamble, C., Kearney, A., Blazeby, J., Clarke, M., Lane, J. A., & Shaw, A. (2018). ‘Recruitment, recruitment, recruitment’ – The need for more focus on retention: A qualitative study of five trials. Trials, 19(1), 76. https://doi.org/10.1186/s13063-018-2467-0
  • de Haan, A. M., Boon, A. E., de Jong, J. T. V. M., Hoeve, M., & Vermeiren, R. R. J. M. (2013). A meta-analytic review on treatment dropout in child and adolescent outpatient mental health care. Clinical Psychology Review, 33(5), 698–711. https://doi.org/10.1016/j.cpr.2013.04.005
  • De Los Reyes, A., Wang, M., Lerner, M. D., Makol, B. A., Fitzpatrick, O. M., & Weisz, J. R. (2022). The operations triad model and youth mental health assessments: Catalyzing a paradigm shift in measurement validation. Journal of Clinical Child & Adolescent Psychology, 1–36. https://doi.org/10.1080/15374416.2022.2111684
  • Deming, W. (1993). The new economics. MIT Press.
  • Diamond, G. M., Liddle, H. A., Hogue, A., & Dakof, G. A. (1999). Alliance-building interventions with adolescents in family therapy: A process study. Psychotherapy: Theory, Research, Practice, Training, 36(4), 355–368. https://doi.org/10.1037/h0087729
  • DiGiuseppe, R., Linscott, J., & Jilton, R. (1996). Developing the therapeutic alliance in child-adolescent psychotherapy. Applied and Preventive Psychology, 5(2), 85–100. https://doi.org/10.1016/S0962-1849(96)80002-3
  • Dixon, L. J., & Linardon, J. (2020). A systematic review and meta-analysis of dropout rates from dialectical behaviour therapy in randomized controlled trials. Cognitive Behaviour Therapy, 49(3), 181–196. https://doi.org/10.1080/16506073.2019.1620324
  • Donohue, B., Azrin, N. H., Lawson, H., Friedlander, J., Teichner, G., & Rindsberg, J. (1998). Improving initial session attendance of substance abusing and conduct disordered adolescents: A controlled study. Journal of Child & Adolescent Substance Abuse, 8(1), 1–13. https://doi.org/10.1300/J029v08n01_01
  • Dorsey, S., Pullmann, M. D., Berliner, L., Koschmann, E., McKay, M., & Deblinger, E. (2014). Engaging foster parents in treatment: A randomized trial of supplementing trauma-focused cognitive behavioral therapy with evidence-based engagement strategies. Child Abuse & Neglect, 38(9), 1508–1520. https://doi.org/10.1016/j.chiabu.2014.03.020
  • Dumas, J. E., Begle, A. M., French, B., & Pearl, A. (2010). Effects of monetary incentives on engagement in the pace parenting program. Journal of Clinical Child & Adolescent Psychology, 39(3), 302–313. https://doi.org/10.1080/15374411003691792
  • Eronen, M. I., & Bringmann, L. F. (2021). The theory crisis in psychology: How to move forward. Perspectives on Psychological Science, 16(4), 779–788. https://doi.org/10.1177/1745691620970586
  • Eubanks, C. F., Burckell, L. A., & Goldfried, M. R. (2018). Clinical consensus strategies to repair ruptures in the therapeutic alliance. Journal of Psychotherapy Integration, 28(1), 60–76. https://doi.org/10.1037/int0000097
  • Eubanks, C. F., Muran, J. C., & Safran, J. D. (2018). Alliance rupture repair: A meta-analysis. Psychotherapy, 55(4), 508–519. https://doi.org/10.1037/pst0000185
  • Eyberg, S. M., & Johnson, S. M. (1974). Multiple assessment of behavior modification with families: Effects of contingency contracting and order of treated problems. Journal of Consulting and Clinical Psychology, 42(4), 594–606. https://doi.org/10.1037/h0036723
  • Farber, B. A. (1983). Psychotherapists’ perceptions of stressful patient behavior. Professional Psychology, Research and Practice, 14(5), 697–705. https://doi.org/10.1037/0735-7028.14.5.697
  • Faw, L., Hogue, A., Johnson, S., Diamond, G. M., & Liddle, H. A. (2005). The adolescent therapeutic alliance scale (ATAS): Initial psychometrics and prediction of outcome in family-based substance abuse prevention counseling. Psychotherapy Research, 15(1–2), 141–154. https://doi.org/10.1080/10503300512331326994
  • Fixsen, D., Naoom, S., Blase, K., Friedman, R., & Wallace, F. (2005). Implementation research: A synthesis of the literature. University of South Florida, Louis de la Parte Florida Mental Health Institute, National Implementation Research Network. https://nirn.fpg.unc.edu/resources/implementation-research-synthesis-literature
  • Fjermestad, K. W., Føreland, Ø., Oppedal, S. B., Sørensen, J. S., Vognild, Y. H., Gjestad, R., Öst, L.-G., Bjaastad, J. F., Shirk, S. S., & Wergeland, G. J. (2021). Therapist alliance-building behaviors, alliance, and outcomes in cognitive behavioral treatment for youth anxiety disorders. Journal of Clinical Child & Adolescent Psychology, 50(2), 229–242. https://doi.org/10.1080/15374416.2019.1683850
  • Fleischman, M. J. (1979). Using parenting salaries to control attrition and cooperation in therapy. Behavior Therapy, 10(1), 111–116. https://doi.org/10.1016/S0005-7894(79)80014-3
  • Fried, E. I. (2020). Theories and models: What they are, what they are for, and what they are about. Psychological Inquiry, 31(4), 336–344. https://doi.org/10.1080/1047840X.2020.1854011
  • Garcia, J. A., & Weisz, J. R. (2002). When youth mental health care stops: Therapeutic relationship problems and other reasons for ending youth outpatient treatment. Journal of Consulting and Clinical Psychology, 70(2), 439–443. https://doi.org/10.1037/0022-006X.70.2.439
  • Garland, A. F., Brookman-Frazee, L., Hurlburt, M. S., Accurso, E. C., Zoffness, R. J., Haine-Schlagel, R., & Ganger, W. (2010). Mental health care for children with disruptive behavior problems: A view inside therapists’ offices. Psychiatric Services, 61(8), 788–795. https://doi.org/10.1176/ps.2010.61.8.788
  • Gearing, R. E., Schwalbe, C. S., & Short, K. D. (2012). Adolescent adherence to psychosocial treatment: Mental health clinicians’ perspectives on barriers and promoters. Psychotherapy Research, 22(3), 317–326. https://doi.org/10.1080/10503307.2011.653996
  • Gellatly, R., Brookman-Frazee, L., Barnett, M., Gonzalez, J. C., Kim, J. J., & Lau, A. S. (2019). Therapist reports of EBP client engagement challenges in sessions with diverse youth and families in community mental health settings. Child & Youth Care Forum, 48(1), 55–75. https://doi.org/10.1007/s10566-018-9472-z
  • Georgiades, K., Paksarian, D., Rudolph, K. E., & Merikangas, K. R. (2018). Prevalence of mental disorder and service use by immigrant generation and race/ethnicity among U.S. adolescents. Journal of the American Academy of Child & Adolescent Psychiatry, 57(4), 280–287.e2. https://doi.org/10.1016/j.jaac.2018.01.020
  • Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999). Evaluating the public health impact of health promotion interventions: The RE-AIM framework. American Journal of Public Health, 89(9), 1322–1327. https://doi.org/10.2105/AJPH.89.9.1322
  • Gordon, J. (2017, March 20). An experimental therapeutic approach to psychosocial interventions. NIMH. https://www.nimh.nih.gov/about/director/messages/2017/an-experimental-therapeutic-approach-to-psychosocial-interventions
  • Graham, I. D., Logan, J., Harrison, M. B., Straus, S. E., Tetroe, J., Caswell, W., & Robinson, N. (2006). Lost in knowledge translation: Time for a map? The Journal of Continuing Education in the Health Professions, 26(1), 13–24. https://doi.org/10.1002/chp.47
  • Greenhalgh, T., Robert, G., Macfarlane, F., Bate, P., & Kyriakidou, O. (2004). Diffusion of innovations in service organizations: Systematic review and recommendations. The Milbank Quarterly, 82(4), 581–629. https://doi.org/10.1111/j.0887-378X.2004.00325.x
  • Gross, D., Johnson, T., Ridge, A., Garvey, C., Julion, W., Treysman, A. B., Breitenstein, S., & Fogg, L. (2011). Cost-effectiveness of childcare discounts on parent participation in preventive parent training in low-income communities. The Journal of Primary Prevention, 32(5–6), 283–298. https://doi.org/10.1007/s10935-011-0255-7
  • Guo, S., Kataoka, S. H., Bear, L., & Lau, A. S. (2014). Differences in school-based referrals for mental health care: Understanding racial/ethnic disparities between Asian American and Latino youth. School Mental Health, 6(1), 27–39. https://doi.org/10.1007/s12310-013-9108-2
  • Haine-Schlagel, R., Dickson, K. S., Lind, T., Kim, J. J., May, G. C., Walsh, N. E., Lazarevic, V., Crandal, B. R., & Yeh, M. (2022). Caregiver participation engagement in child mental health prevention programs: A systematic review. Prevention Science, 23(2), 321–339. https://doi.org/10.1007/s11121-021-01303-x
  • Haine-Schlagel, R., Mechammil, M., & Brookman-Frazee, L. (2017). Stakeholder perspectives on a toolkit to enhance caregiver participation in community-based child mental health services. Psychological Services, 14(3), 373–386. https://doi.org/10.1037/ser0000095
  • Haine-Schlagel, R., & Walsh, N. E. (2015). A review of parent participation engagement in child and family mental health treatment. Clinical Child and Family Psychology Review, 18(2), 133–150. https://doi.org/10.1007/s10567-015-0182-x
  • Halfon, S., Özsoy, D., & Çavdar, A. (2019). Therapeutic alliance trajectories and associations with outcome in psychodynamic child psychotherapy. Journal of Consulting and Clinical Psychology, 87(7), 603–616. https://doi.org/10.1037/ccp0000415
  • Hardeman, W., Prevost, A. T., Parker, R. A., & Sutton, S. (2013). Constructing multiplicative measures of beliefs in the theory of planned behaviour. British Journal of Health Psychology, 18(1), 122–138. https://doi.org/10.1111/j.2044-8287.2012.02095.x
  • Harpaz-Rotem, I., Leslie, D., & Rosenheck, R. A. (2004). Treatment retention among children entering a new episode of mental health care. Psychiatric Services, 55(9), 1022–1028. https://doi.org/10.1176/appi.ps.55.9.1022
  • Haslbeck, J. M. B., Ryan, O., Robinaugh, D. J., Waldorp, L. J., & Borsboom, D. (2021). Modeling psychopathology: From data models to formal theories. Psychological Methods. https://doi.org/10.1037/met0000303
  • Hoagwood, K. E., Atkins, M., Kelleher, K., Peth-Pierce, R., Olin, S., Burns, B., Landsverk, J., & Horwitz, S. M. (2018). Trends in children’s mental health services research funding by the National Institute of Mental Health from 2005 to 2015: A 42% reduction. Journal of the American Academy of Child & Adolescent Psychiatry, 57(1), 10–13. https://doi.org/10.1016/j.jaac.2017.09.433
  • Hoagwood, K. E., Jensen, P. S., Acri, M. C., Olin, S. S., Lewandowski, R. E., & Herman, R. J. (2012). Outcome domains in child mental health research since 1996: Have they changed and why does it matter? Journal of the American Academy of Child & Adolescent Psychiatry, 51(12), 1241–1260.e2. https://doi.org/10.1016/j.jaac.2012.09.004
  • Hoagwood, K. E., Purtle, J., Spandorfer, J., Peth-Pierce, R., & Horwitz, S. M. (2020). Aligning dissemination and implementation science with health policies to improve children’s mental health. The American Psychologist, 75(8), 1130–1145. https://doi.org/10.1037/amp0000706
  • Hoagwood, K., Jensen, P. S., Petti, T., & Burns, B. J. (1996). Outcomes of mental health care for children and adolescents: I. A comprehensive conceptual model. Journal of the American Academy of Child & Adolescent Psychiatry, 35(8), 1055–1063. https://doi.org/10.1097/00004583-199608000-00017
  • Holmes, D. S., & Urie, R. G. (1975). Effects of preparing children for psychotherapy. Journal of Consulting and Clinical Psychology, 43(3), 311–318. https://doi.org/10.1037/h0076735
  • Horvath, P. (1990). Treatment expectancy as a function of the amount of information presented in therapeutic rationales. Journal of Clinical Psychology, 46(5), 636–642. https://doi.org/10.1002/1097-4679(199009)46:5<636:AID-JCLP2270460516>3.0.CO;2-U
  • Hunsley, J., Aubry, T. D., Verstervelt, C. M., & Vito, D. (1999). Comparing therapist and client perspectives on reasons for psychotherapy termination. Psychotherapy: Theory, Research, Practice, Training, 36(4), 380–388. https://doi.org/10.1037/h0087802
  • Ijadi-Maghsoodi, R., Bonnet, K., Feller, S., Nagaran, K., Puffer, M., & Kataoka, S. (2018). Voices from minority youth on help-seeking and barriers to mental health services: Partnering with school-based health centers. Ethnicity & Disease, 28(Supp), 437–444. https://doi.org/10.18865/ed.28.S2.437
  • Institute of Medicine. (2001). Crossing the quality chasm: A new health system for the 21st century. The National Academies Press. https://doi.org/10.17226/10027
  • Jensen, P. S., & Hoagwood, K. E. (Eds.). (2008). Improving children’s mental health through parent empowerment: A guide to assisting families. Oxford University Press.
  • Jensen, P. S., Hoagwood, K. E., & Petti, T. (1996). Outcomes of mental health care for children and adolescents: II. Literature review and application of a comprehensive model. Journal of the American Academy of Child & Adolescent Psychiatry, 35(8), 1064–1077. https://doi.org/10.1097/00004583-199608000-00018
  • Jensen, T. K., Holt, T., Ormhaug, S. M., Egeland, K., Granly, L., Hoaas, L. C., Hukkelberg, S. S., Indregard, T., Stormyren, S. D., & Wentzel Larsen, T. (2014). A randomized effectiveness study comparing trauma-focused cognitive behavioral therapy with therapy as usual for youth. Journal of Clinical Child & Adolescent Psychology, 43(3), 356–369. https://doi.org/10.1080/15374416.2013.822307
  • Joireman, J., & Lange, P. (2015). How to publish high-quality research. American Psychological Association.
  • Jorm, A. F. (2012). Mental health literacy: Empowering the community to take action for better mental health. The American Psychologist, 67(3), 231–243. https://doi.org/10.1037/a0025957
  • Karver, M. S., De Nadai, A. S., Monahan, M., & Shirk, S. R. (2018). Meta-analysis of the prospective relation between alliance and outcome in child and adolescent psychotherapy. Psychotherapy, 55(4), 341–355. https://doi.org/10.1037/pst0000176
  • Karver, M., Shirk, S., Handelsman, J. B., Fields, S., Crisp, H., Gudmundsen, G., & McMakin, D. (2008). Relationship processes in youth psychotherapy: Measuring alliance, alliance-building behaviors, and client involvement. Journal of Emotional and Behavioral Disorders, 16(1), 15–28. https://doi.org/10.1177/1063426607312536
  • Kazdin, A. E., Holland, L., & Crowley, M. (1997). Family experience of barriers to treatment and premature termination from child therapy. Journal of Consulting and Clinical Psychology, 65(3), 453–463. https://doi.org/10.1037/0022-006X.65.3.453
  • Kazdin, A. E., & Krouse, R. (1983). The impact of variations in treatment rationales on expectancies for therapeutic change. Behavior Therapy, 14(5), 657–671. https://doi.org/10.1016/S0005-7894(83)80058-6
  • Kazdin, A. E., & Wassell, G. (1999). Barriers to treatment participation and therapeutic change among children referred for conduct disorder. Journal of Clinical Child Psychology, 28(2), 160–172. https://doi.org/10.1207/s15374424jccp2802_4
  • Kefauver-Harris Drug Amendments. (1962). 76 Stat.780 (October 10, 1962) PL 87-781; 28 Fed. Reg. 179 (January 8, 1963); 28 Fed. Reg. 5048 (May 20, 1963); 28 Fed. Reg. 10972 (October 11, 1963). https://www.govinfo.gov/content/pkg/STATUTE-76/pdf/STATUTE-76-Pg780.pdf
  • Kelleher, K. J., & Gardner, W. (2017). Out of sight, out of mind—Behavioral and developmental care for rural children. The New England Journal of Medicine, 376(14), 1301–1303. https://doi.org/10.1056/NEJMp1700713
  • Kelly, P. J., Leung, J., Deane, F. P., & Lyons, G. C. B. (2016). Predicting client attendance at further treatment following drug and alcohol detoxification: Theory of planned behaviour and implementation intentions: Predicting treatment attendance. Drug and Alcohol Review, 35(6), 678–685. https://doi.org/10.1111/dar.12332
  • King, G., Currie, M., & Petersen, P. (2014). Child and parent engagement in the mental health intervention process: A motivational framework. Child and Adolescent Mental Health, 19(1), 2–8. https://doi.org/10.1111/camh.12015
  • Kirsch, V., Keller, F., Tutus, D., & Goldbeck, L. (2018). Treatment expectancy, working alliance, and outcome of trauma-focused cognitive behavioral therapy with children and adolescents. Child and Adolescent Psychiatry and Mental Health, 12(1), 16. https://doi.org/10.1186/s13034-018-0223-6
  • Kraemer, H. C., Measelle, J. R., Ablow, J. C., Essex, M. J., Boyce, W. T., & Kupfer, D. J. (2003). A new approach to integrating data from multiple informants in psychiatric assessment and research: Mixing and matching contexts and perspectives. The American Journal of Psychiatry, 160(9), 1566–1577. https://doi.org/10.1176/appi.ajp.160.9.1566
  • Krause, K. R., Bear, H. A., Edbrooke-Childs, J., & Wolpert, M. (2019). Review: What outcomes count? Outcomes measured for adolescent depression between 2007 and 2017. Journal of the American Academy of Child & Adolescent Psychiatry, 58(1), 61–71. https://doi.org/10.1016/j.jaac.2018.07.893
  • Labouliere, C. D., Reyes, J. P., Shirk, S., & Karver, M. (2017). Therapeutic alliance with depressed adolescents: Predictor or outcome? Disentangling temporal confounds to understand early improvement. Journal of Clinical Child & Adolescent Psychology, 46(4), 600–610. https://doi.org/10.1080/15374416.2015.1041594
  • Lakind, D., Bradley, W. J., Patel, A., Chorpita, B. F., & Becker, K. D. (2022). A multidimensional examination of the measurement of treatment engagement: Implications for children’s mental health services and research. Journal of Clinical Child & Adolescent Psychology, 51(4), 453–468. https://doi.org/10.1080/15374416.2021.1941057
  • Lambert, M. J. (2005). Emerging methods for providing clinicians with timely feedback on treatment effectiveness: An introduction. Journal of Clinical Psychology, 61(2), 141–144. https://doi.org/10.1002/jclp.20106
  • Lambert, M. J., Whipple, J. L., Hawkins, E. J., Vermeersch, D. A., Nielsen, S. L., & Smart, D. W. (2003). Is it time for clinicians to routinely track patient outcome? A meta-analysis. Clinical Psychology: Science and Practice, 10(3), 288–301. https://doi.org/10.1093/clipsy.bpg025
  • Lareyre, O., Gourlan, M., Stoebner Delbarre, A., & Cousson-Gélie, F. (2021). Characteristics and impact of theory of planned behavior interventions on smoking behavior: A systematic review of the literature. Preventive Medicine, 143, 106327. https://doi.org/10.1016/j.ypmed.2020.106327
  • Larsen, K. R., & Bong, C. H. (2016). A tool for addressing construct identity in literature reviews and meta-analyses. MIS Quarterly, 40(3), 529–551. https://doi.org/10.25300/MISQ/2016/40.3.01
  • Larsen, K. R., Michie, S., Hekler, E. B., Gibson, B., Spruijt-Metz, D., Ahern, D., Cole Lewis, H., Ellis, R. J. B., Hesse, B., Moser, R. P., & Yi, J. (2017). Behavior change interventions: The potential of ontologies for advancing science and practice. Journal of Behavioral Medicine, 40(1), 6–22. https://doi.org/10.1007/s10865-016-9768-0
  • Levitt, E. E. (1957). A comparison of “remainers” and “defectors” among child clinic patients. Journal of Consulting Psychology, 21(4), 316. https://doi.org/10.1037/h0045043
  • Levitt, E. E. (1958). A comparative judgmental study of “defection” from treatment at a child guidance clinic. Journal of Clinical Psychology, 14(4), 429–432. https://doi.org/10.1002/1097-4679(195810)14:4<429:AID-JCLP2270140424>3.0.CO;2-U
  • Lilienfeld, S. O. (2010). Can psychology become a science? Personality and Individual Differences, 49(4), 281–288. https://doi.org/10.1016/j.paid.2010.01.024
  • Lindsey, M. A., Brandt, N. E., Becker, K. D., Lee, B. R., Barth, R. P., Daleiden, E. L., & Chorpita, B. F. (2014). Identifying the common elements of treatment engagement interventions in children’s mental health services. Clinical Child and Family Psychology Review, 17(3), 283–298. https://doi.org/10.1007/s10567-013-0163-x
  • Lindsey, M. A., Chambers, K., Pohle, C., Beall, P., & Lucksted, A. (2013). Understanding the behavioral determinants of mental health service use by urban, under-resourced black youth: Adolescent and caregiver perspectives. Journal of Child and Family Studies, 22(1), 107–121. https://doi.org/10.1007/s10826-012-9668-z
  • Malone, T. W., & Crowston, K. (1994). The interdisciplinary study of coordination. ACM Computing Surveys, 26(1), 87–119. https://doi.org/10.1145/174666.174668
  • Mankarious, E., & Kothe, E. (2015). A meta-analysis of the effects of measuring theory of planned behaviour constructs on behaviour within prospective studies. Health Psychology Review, 9(2), 190–204. https://doi.org/10.1080/17437199.2014.927722
  • Marrast, L., Himmelstein, D. U., & Woolhandler, S. (2016). Racial and ethnic disparities in mental health care for children and young adults: A national study. International Journal of Health Services, 46(4), 810–824. https://doi.org/10.1177/0020731416662736
  • Martinez, J. I., & Haine-Schlagel, R. (2018). Observational assessment of engagement strategies to promote parent homework planning in community-based child mental health treatment: A pilot study. Journal of Child and Family Studies, 27(6), 1968–1980. https://doi.org/10.1007/s10826-018-1030-7
  • Martinez, J. I., Lau, A. S., Chorpita, B. F., & Weisz, J. R. (2017). Psychoeducation as a mediator of treatment approach on parent engagement in child psychotherapy for disruptive behavior. Journal of Clinical Child & Adolescent Psychology, 46(4), 573–587. https://doi.org/10.1080/15374416.2015.1038826
  • McCabe, K., & Yeh, M. (2009). Parent–child interaction therapy for Mexican Americans: A randomized clinical trial. Journal of Clinical Child & Adolescent Psychology, 38(5), 753–759. https://doi.org/10.1080/15374410903103544
  • McCabe, K. M., Yeh, M., & Zerr, A. A. (2020). Personalizing behavioral parent training interventions to improve treatment engagement and outcomes for culturally diverse families. Psychology Research and Behavior Management, 13, 41–53. https://doi.org/10.2147/PRBM.S230005
  • McKay, M., McCadam, K., & Gonzales, J. (1996). Addressing the barriers to mental health services for inner city children and their caretakers. Community Mental Health Journal, 32(4), 353–361. https://doi.org/10.1007/BF02249453
  • McKay, M. M., & Bannon, W. M., Jr. (2004). Engaging families in child mental health services. Child and Adolescent Psychiatric Clinics of North America, 13(4), 905–921. https://doi.org/10.1016/j.chc.2004.04.001
  • McKay, M. M., Garcia, T., Scally, J., & Martinez, L. (1996). A collaborative group approach for urban parents. Groupwork: An Interdisciplinary Journal for Working with Groups, 9(1), 15–26.
  • McKay, M. M., Nudelman, R., McCadam, K., & Gonzales, J. (1996). Evaluating a social work engagement approach to involving inner-city children and their families in mental health care. Research on Social Work Practice, 6(4), 462–472. https://doi.org/10.1177/104973159600600404
  • McKay, M. M., Stoewe, J., McCadam, K., & Gonzales, J. (1998). Increasing access to child mental health services for urban children and their caregivers. Health & Social Work, 23(1), 9–15. https://doi.org/10.1093/hsw/23.1.9
  • McLeod, B. D., Cecilione, J., Jensen Doss, A., Southam-Gerow, M. A., & Kendall, P. C. (2021). Reliability, factor structure, and validity of an observer-rated alliance scale with youth. Psychological Assessment, 33(10), 1013–1023. https://doi.org/10.1037/pas0001036
  • McLeod, B. D., Islam, N. Y., Chiu, A. W., Smith, M. M., Chu, B. C., & Wood, J. J. (2014). The relationship between alliance and client involvement in CBT for child anxiety disorders. Journal of Clinical Child & Adolescent Psychology, 43(5), 735–741. https://doi.org/10.1080/15374416.2013.850699
  • McLeod, B. D., & Weisz, J. R. (2005). The therapy process observational coding system-alliance scale: Measure characteristics and prediction of outcome in usual clinical practice. Journal of Consulting and Clinical Psychology, 73(2), 323–333. https://doi.org/10.1037/0022-006X.73.2.323
  • Meehl, P. E. (1978). Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology. Journal of Consulting and Clinical Psychology, 46(4), 806–834. https://doi.org/10.1037/0022-006X.46.4.806
  • Meehl, P. E. (1990). Appraising and amending theories: The strategy of Lakatosian defense and two principles that warrant it. Psychological Inquiry, 1(2), 108–141. https://doi.org/10.1207/s15327965pli0102_1
  • Merikangas, K. R., He, J., Burstein, M., Swanson, S. A., Avenevoli, S., Cui, L., Benjet, C., Georgiades, K., & Swendsen, J. (2010). Lifetime prevalence of mental disorders in U.S. adolescents: Results from the national comorbidity survey replication–adolescent supplement (NCS-A). Journal of the American Academy of Child & Adolescent Psychiatry, 49(10), 980–989. https://doi.org/10.1016/j.jaac.2010.05.017
  • Merikangas, K. R., He, J., Burstein, M., Swendsen, J., Avenevoli, S., Case, B., Georgiades, K., Heaton, L., Swanson, S., & Olfson, M. (2011). Service utilization for lifetime mental disorders in U.S. adolescents: Results of the national comorbidity survey–adolescent supplement (NCS-A). Journal of the American Academy of Child & Adolescent Psychiatry, 50(1), 32–45. https://doi.org/10.1016/j.jaac.2010.10.006
  • Michie, S., Carey, R. N., Johnston, M., Rothman, A. J., de Bruin, M., Kelly, M. P., & Connell, L. E. (2018). From theory-inspired to theory-based interventions: A protocol for developing and testing a methodology for linking behaviour change techniques to theoretical mechanisms of action. Annals of Behavioral Medicine, 52(6), 501–512. https://doi.org/10.1007/s12160-016-9816-6
  • Murphy, R., & Hutton, P. (2018). Practitioner review: Therapist variability, patient–reported therapeutic alliance, and clinical outcomes in adolescents undergoing mental health treatment – a systematic review and meta–analysis. Journal of Child Psychology and Psychiatry, 59(1), 5–19. https://doi.org/10.1111/jcpp.12767
  • Nakamura, B. J., Mueller, C. W., Higa McMillan, C., Okamura, K. H., Chang, J. P., Slavin, L., & Shimabukuro, S. (2014). Engineering youth service system infrastructure: Hawaii’s continued efforts at large-scale implementation through knowledge management strategies. Journal of Clinical Child & Adolescent Psychology, 43(2), 179–189. https://doi.org/10.1080/15374416.2013.812039
  • National Academies of Sciences, Engineering, and Medicine. (2022). Ontologies in the behavioral sciences: Accelerating research and the spread of knowledge. The National Academies Press. https://doi.org/10.17226/26464
  • National Institute of Mental Health. (1998). Bridging science and service: A report by the national advisory mental health council’s clinical treatment and services research workgroup. https://www.nimh.nih.gov/about/advisory-boards-and-groups/namhc/reports/bridging-science-and-service-a-report-by-the-national-advisory-mental-health-councils-clinical-treatment-and-services-research-workgroup
  • National Institute of Mental Health. (2001). Blueprint for change: Research on child and adolescent mental health. https://www.nimh.nih.gov/about/advisory-boards-and-groups/namhc/reports/blueprint-for-change-research-on-child-and-adolescent-mental-health
  • Nock, M. K., & Ferriter, C. (2005). Parent management of attendance and adherence in child and adolescent therapy: A conceptual and empirical review. Clinical Child and Family Psychology Review, 8(2), 149–166. https://doi.org/10.1007/s10567-005-4753-0
  • Nock, M. K., & Kazdin, A. E. (2005). Randomized controlled trial of a brief intervention for increasing participation in parent management training. Journal of Consulting and Clinical Psychology, 73(5), 872–879. https://doi.org/10.1037/0022-006X.73.5.872
  • Norris, L. A., Rifkin, L. S., Olino, T. M., Piacentini, J., Albano, A. M., Birmaher, B., Ginsburg, G., Walkup, J., Compton, S. N., Gosch, E., & Kendall, P. C. (2019). Multi-informant expectancies and treatment outcomes for anxiety in youth. Child Psychiatry & Human Development, 50(6), 1002–1010. https://doi.org/10.1007/s10578-019-00900-w
  • O’Keeffe, S., Martin, P., & Midgley, N. (2020). When adolescents stop psychological therapy: Rupture–repair in the therapeutic alliance and association with therapy ending. Psychotherapy, 57(4), 471–490. https://doi.org/10.1037/pst0000279
  • O’Keeffe, S., & Midgley, N. (2022). A commentary on ‘dropout from randomised controlled trials of psychological treatments for depression in children and youth: A systematic review and meta-analyses. Journal of Affective Disorders, 299, 142–143. https://doi.org/10.1016/j.jad.2021.11.064
  • Olin, S. S., Hoagwood, K. E., Rodriguez, J., Ramos, B., Burton, G., Penn, M., Crowe, M., Radigan, M., & Jensen, P. S. (2010). The application of behavior change theory to family-based services: Improving parent empowerment in children’s mental health. Journal of Child and Family Studies, 19(4), 462–470. https://doi.org/10.1007/s10826-009-9317-3
  • Ormhaug, S. M., Shirk, S. R., & Wentzel Larsen, T. (2015). Therapist and client perspectives on the alliance in the treatment of traumatized adolescents. European Journal of Psychotraumatology, 6(1), 27705. https://doi.org/10.3402/ejpt.v6.27705
  • Ovenstad, K. S., Jensen, T. K., & Ormhaug, S. M. (2022). Four perspectives on traumatized youths’ therapeutic alliance: Correspondence and outcome predictions. Psychotherapy Research, 32(6), 820–832. https://doi.org/10.1080/10503307.2021.2011983
  • Ovenstad, K. S., Ormhaug, S. M., Shirk, S. R., & Jensen, T. K. (2020). Therapists’ behaviors and youths’ therapeutic alliance during trauma-focused cognitive behavioral therapy. Journal of Consulting and Clinical Psychology, 88(4), 350–361. https://doi.org/10.1037/ccp0000465
  • Park, A. L., Chorpita, B. F., Regan, J., Weisz, J. R., & The Research Network on Youth Mental Health. (2015). Integrity of evidence-based practice: Are providers modifying practice content or practice sequencing? Administration and Policy in Mental Health and Mental Health Services Research, 42(2), 186–196. https://doi.org/10.1007/s10488-014-0559-z
  • Patterson, C. L., Anderson, T., & Wei, C. (2014). Clients’ pretreatment role expectations, the therapeutic alliance, and clinical outcomes in outpatient therapy: Clients’ pretreatment role expectations. Journal of Clinical Psychology, 70(7), 673–680. https://doi.org/10.1002/jclp.22054
  • Patterson, G. R., & Chamberlain, P. (1994). A functional analysis of resistance during parent training therapy. Clinical Psychology: Science and Practice, 1(1), 53–70. https://doi.org/10.1111/j.1468-2850.1994.tb00006.x
  • Patterson, G. R., & Forgatch, M. S. (1985). Therapist behavior as a determinant for client noncompliance: A paradox for the behavior modifier. Journal of Consulting and Clinical Psychology, 53(6), 846–851. https://doi.org/10.1037/0022-006X.53.6.846
  • Pekarik, G. (1985). Coping with dropouts. Professional Psychology, Research and Practice, 16(1), 114–123. https://doi.org/10.1037/0735-7028.16.1.114
  • Pellecchia, M., Nuske, H. J., Straiton, D., McGhee Hassrick, E., Gulsrud, A., Iadarola, S., Vejnoska, S. F., Bullen, B., Haine-Schlagel, R., Kasari, C., Mandell, D. S., Smith, T., & Stahmer, A. C. (2018). Strategies to engage underrepresented parents in child intervention services: A review of effectiveness and co-occurring use. Journal of Child and Family Studies, 27(10), 3141–3154. https://doi.org/10.1007/s10826-018-1144-y
  • Pellerin, K. A., Costa, N. M., Weems, C. F., & Dalton, R. F. (2010). An examination of treatment completers and non-completers at a child and adolescent community mental health clinic. Community Mental Health Journal, 46(3), 273–281. https://doi.org/10.1007/s10597-009-9285-5
  • Piotrowska, P. J., Tully, L. A., Lenroot, R., Kimonis, E., Hawes, D., Moul, C., Frick, P. J., Anderson, V., & Dadds, M. R. (2017). Mothers, fathers, and parental systems: A conceptual model of parental engagement in programmes for child mental health - connect, attend, participate, enact (CAPE). Clinical Child and Family Psychology Review, 20(2), 146–161. https://doi.org/10.1007/s10567-016-0219-9
  • Piselli, A., Halgin, R. P., & MacEwan, G. H. (2011). What went wrong? Therapists’ reflections on their role in premature termination. Psychotherapy Research, 21(4), 400–415. https://doi.org/10.1080/10503307.2011.573819
  • Polo, A. J., Makol, B. A., Castro, A. S., Colón-Quintana, N., Wagstaff, A. E., & Guo, S. (2019). Diversity in randomized clinical trials of depression: A 36-year review. Clinical Psychology Review, 67, 22–35. https://doi.org/10.1016/j.cpr.2018.09.004
  • Poston, J. M., & Hanson, W. E. (2010). Meta-analysis of psychological assessment as a therapeutic intervention. Psychological Assessment, 22(2), 203–212. https://doi.org/10.1037/a0018679
  • PracticeWise. (2022, Fall). PracticeWise evidence-based services (PWEBS) database. https://www.practicewise.com/
  • Price, M. A., & Hollinsaid, N. L. (2022). Future directions in mental health treatment with stigmatized youth. Journal of Clinical Child & Adolescent Psychology, 1–16. https://doi.org/10.1080/15374416.2022.2109652
  • Price, M. A., Weisz, J. R., McKetta, S., Hollinsaid, N. L., Lattanner, M. R., Reid, A. E., & Hatzenbuehler, M. L. (2022). Meta-analysis: Are psychotherapies less effective for black youth in communities with higher levels of anti-Black racism? Journal of the American Academy of Child & Adolescent Psychiatry, 61(6), 754–763. https://doi.org/10.1016/j.jaac.2021.07.808
  • Prochaska, J. O., Norcross, J. C., & Saul, S. F. (2020). Generating psychotherapy breakthroughs: Transtheoretical strategies from population health psychology. The American Psychologist, 75(7), 996–1010. https://doi.org/10.1037/amp0000568
  • Proulx, T., & Morey, R. D. (2021). Beyond statistical ritual: Theory in psychological science. Perspectives on Psychological Science, 16(4), 671–681. https://doi.org/10.1177/17456916211017098
  • Pullmann, M. D., Ague, S., Johnson, T., Lane, S., Beaver, K., Jetton, E., & Rund, E. (2013). Defining engagement in adolescent substance abuse treatment. American Journal of Community Psychology, 52(3–4), 347–358. https://doi.org/10.1007/s10464-013-9600-8
  • Purtle, J., Peters, R., & Brownson, R. C. (2015). A review of policy dissemination and implementation research funded by the National Institutes of Health, 2007–2014. Implementation Science, 11(1), 1. https://doi.org/10.1186/s13012-015-0367-1
  • Rich, B. A., Hensler, M., Rosen, H. R., Watson, C., Schmidt, J., Sanchez, L., O’brien, K., & Alvord, M. K. (2014). Attrition from therapy effectiveness research among youth in a clinical service setting. Administration and Policy in Mental Health and Mental Health Services Research, 41(3), 343–352. https://doi.org/10.1007/s10488-013-0469-5
  • Robinaugh, D. J., Haslbeck, J. M. B., Ryan, O., Fried, E. I., & Waldorp, L. J. (2021). Invisible hands and fine calipers: A call to use formal theory as a toolkit for theory construction. Perspectives on Psychological Science, 16(4), 725–743. https://doi.org/10.1177/1745691620974697
  • Robinson, K. A., Dinglas, V. D., Sukrithan, V., Yalamanchilli, R., Mendez-Tellez, P. A., Dennison-Himmelfarb, C., & Needham, D. M. (2015). Updated systematic review identifies substantial number of retention strategies: Using more strategies retains more study participants. Journal of Clinical Epidemiology, 68(12), 1481–1487. https://doi.org/10.1016/j.jclinepi.2015.04.013
  • Roest, J. J., Welmers Van de Poll, M. J., Van der Helm, G., Stams, G., & Hoeve, M. (2022). A meta-analysis on differences and associations between alliance ratings in child and adolescent psychotherapy. Journal of Clinical Child & Adolescent Psychology, 1–19. https://doi.org/10.1080/15374416.2022.2093210
  • Ross, A. O., & Lacey, H. M. (1961). Characteristics of terminators and remainers in child guidance treatment. Journal of Consulting Psychology, 25(5), 420–424. https://doi.org/10.1037/h0042380
  • Saloner, B., Carson, N., & Cook, B. L. (2014). Episodes of mental health treatment among a nationally representative sample of children and adolescents. Medical Care Research and Review, 71(3), 261–279. https://doi.org/10.1177/1077558713518347
  • Sanchez, A. L., Jent, J., Aggarwal, N. K., Chavira, D., Coxe, S., Garcia, D., La Roche, M., & Comer, J. S. (2022). Person-centered cultural assessment can improve child mental health service engagement and outcomes. Journal of Clinical Child & Adolescent Psychology, 51(1), 1–22. https://doi.org/10.1080/15374416.2021.1981340
  • Schaeffer, C. M., Swenson, C. C., & Powell, J. S. (2021). Multisystemic therapy - building stronger families (MST-BSF): Substance misuse, child neglect, and parenting outcomes from an 18-month randomized effectiveness trial. Child Abuse & Neglect, 122, 105379. https://doi.org/10.1016/j.chiabu.2021.105379
  • Scheeringa, M. S., Weems, C. F., Cohen, J. A., Amaya-Jackson, L., & Guthrie, D. (2011). Trauma-focused cognitive-behavioral therapy for posttraumatic stress disorder in three-through six year-old children: A randomized clinical trial. Journal of Child Psychology and Psychiatry, 52(8), 853–860. https://doi.org/10.1111/j.1469-7610.2010.02354.x
  • Schleider, J. L., & Weisz, J. R. (2018). Parent expectancies and preferences for mental health treatment: The roles of emotion mind-sets and views of failure. Journal of Clinical Child & Adolescent Psychology, 47(sup1), S480–496. https://doi.org/10.1080/15374416.2017.1405353
  • Schoenwald, S. K., & Hoagwood, K. (2001). Effectiveness, transportability, and dissemination of interventions: What matters when? Psychiatric Services, 52(9), 1190–1197. https://doi.org/10.1176/appi.ps.52.9.1190
  • Schraeder, K. E., & Reid, G. J. (2015). Why wait? The effect of wait-times on subsequent help-seeking among families looking for children’s mental health services. Journal of Abnormal Child Psychology, 43(3), 553–565. https://doi.org/10.1007/s10802-014-9928-z
  • Sherman, M. L., Barnum, D. D., Buhman-Wiggs, A., & Nyberg, E. (2009). Clinical intake of child and adolescent consumers in a rural community mental health center: Does wait-time predict attendance? Community Mental Health Journal, 45(1), 78–84. https://doi.org/10.1007/s10597-008-9153-8
  • Shirk, S. R. (2004). Dissemination of youth ESTs: Ready for prime time? Clinical Psychology: Science and Practice, 11(3), 308–312. https://doi.org/10.1093/clipsy.bph086
  • Shirk, S. R., & Karver, M. (2003). Prediction of treatment outcome from relationship variables in child and adolescent therapy: A meta-analytic review. Journal of Consulting and Clinical Psychology, 71(3), 452–464. https://doi.org/10.1037/0022-006X.71.3.452
  • Shirk, S. R., Karver, M. S., & Brown, R. (2011). The alliance in child and adolescent psychotherapy. Psychotherapy, 48(1), 17–24. https://doi.org/10.1037/a0022181
  • Shirk, S. R., & Peterson, E. (2013). Gaps, bridges, and the bumpy road to improving clinic–based therapy for youth. Clinical Psychology: Science and Practice, 20(1), 107–113. https://doi.org/10.1111/cpsp.12026
  • Shirk, S. R., & Saiz, C. C. (1992). Clinical, empirical, and developmental perspectives on the therapeutic relationship in child psychotherapy. Development and Psychopathology, 4(4), 713–728. https://doi.org/10.1017/S0954579400004946
  • Shuman, A. L., & Shapiro, J. P. (2002). The effects of preparing parents for child psychotherapy on accuracy of expectations and treatment attendance. Community Mental Health Journal, 38(1), 3–16. https://doi.org/10.1023/A:1013908629870
  • Sibley, M. H., Graziano, P. A., Kuriyan, A. B., Coxe, S., Pelham, W. E., Rodriguez, L., Sanchez, F., Derefinko, K., Helseth, S., & Ward, A. (2016). Parent–teen behavior therapy + motivational interviewing for adolescents with ADHD. Journal of Consulting and Clinical Psychology, 84(8), 699–712. https://doi.org/10.1037/ccp0000106
  • Simon, H. A. (1988). The science of design: Creating the artificial. Design Issues, 4(1/2), 67. https://doi.org/10.2307/1511391
  • Simons, A. D., Marti, C. N., Rohde, P., Lewis, C. C., Curry, J., & March, J. (2012). Does homework “matter” in cognitive behavioral therapy for adolescent depression? Journal of Cognitive Psychotherapy, 26(4), 390–404. https://doi.org/10.1891/0889-8391.26.4.390
  • Simons, L. G., Sutton, T. E., Simons, R. L., Gibbons, F. X., & Murry, V. M. (2016). Mechanisms that link parenting practices to adolescents’ risky sexual behavior: A test of six competing theories. Journal of Youth and Adolescence, 45(2), 255–270. https://doi.org/10.1007/s10964-015-0409-7
  • Skinner, B. F. (1938). The behavior of organisms: An experimental analysis. Appleton-Century.
  • Sniehotta, F. F., Presseau, J., & Araújo-Soares, V. (2014). Time to retire the theory of planned behaviour. Health Psychology Review, 8(1), 1–7. https://doi.org/10.1080/17437199.2013.869710
  • Sniehotta, F. F., Presseau, J., & Araújo-Soares, V. (2015). On the development, evaluation and evolution of health behaviour theory. Health Psychology Review, 9(2), 176–189. https://doi.org/10.1080/17437199.2015.1022902
  • Southam-Gerow, M. A., Daleiden, E. L., Chorpita, B. F., Bae, C., Mitchell, C., Faye, M., & Alba, M. (2014). Mapping Los Angeles County: Taking an evidence-informed model of mental health care to scale. Journal of Clinical Child & Adolescent Psychology, 43(2), 190–200. https://doi.org/10.1080/15374416.2013.833098
  • Staudt, M. (2007). Treatment engagement with caregivers of at-risk children: Gaps in research and conceptualization. Journal of Child and Family Studies, 16(2), 183–196. https://doi.org/10.1007/s10826-006-9077-2
  • Sylwestrzak, A., Overholt, C. E., Ristau, K. I., & Coker, K. L. (2015). Self-reported barriers to treatment engagement: Adolescent perspectives from the national comorbidity survey-adolescent supplement (NCS-A). Community Mental Health Journal, 51(7), 775–781. https://doi.org/10.1007/s10597-014-9776-x
  • Trafimow, D. (2015). On retiring the TRA/TPB without retiring the lessons learned: A commentary on Sniehotta, Presseau and Araújo-Soares. Health Psychology Review, 9(2), 168–171. https://doi.org/10.1080/17437199.2014.884932
  • Turner, L., Shamseer, L., Altman, D. G., Schulz, K. F., & Moher, D. (2012). Does use of the CONSORT statement impact the completeness of reporting of randomised controlled trials published in medical journals? A Cochrane review. Systematic Reviews, 1(1), 60. https://doi.org/10.1186/2046-4053-1-60
  • van Rooij, I., & Baggio, G. (2021). Theory before the test: How to build high-verisimilitude explanatory theories in psychological science. Perspectives on Psychological Science, 16(4), 682–697. https://doi.org/10.1177/1745691620970604
  • Vázquez, A. L., Culianos, D., Flores, C. M. N., Alvarez, M. D. L. C., Barrett, T. S., & Domenech Rodríguez, M. M. (2022). Psychometric evaluation of a barriers to mental health treatment questionnaire for Latina/o/x caregivers of children and adolescents. Child & Youth Care Forum, 51(4), 847–864. https://doi.org/10.1007/s10566-021-09656-8
  • Wadsworth, M. E., Ahlkvist, J. A., McDonald, A., & Tilghman-Osborne, E. M. (2018). Future directions in research and intervention with youths in poverty. Journal of Clinical Child & Adolescent Psychology, 47(6), 1023–1038. https://doi.org/10.1080/15374416.2018.1485108
  • Wamser-Nanney, R., & Steinzor, C. E. (2016). Characteristics of attrition among children receiving trauma-focused treatment. Psychological Trauma: Theory, Research, Practice, and Policy, 8(6), 745–754. https://doi.org/10.1037/tra0000143
  • Wamser-Nanney, R., & Steinzor, C. E. (2017). Factors related to attrition from trauma-focused cognitive behavioral therapy. Child Abuse & Neglect, 66, 73–83. https://doi.org/10.1016/j.chiabu.2016.11.031
  • Warnick, E. M., Gonzalez, A., Robin Weersing, V., Scahill, L., & Woolston, J. (2012). Defining dropout from youth psychotherapy: How definitions shape the prevalence and predictors of attrition: Defining dropout. Child and Adolescent Mental Health, 17(2), 76–85. https://doi.org/10.1111/j.1475-3588.2011.00606.x
  • Wasson Simpson, K. S., Gallagher, A., Ronis, S. T., Miller, D. A. A., & Tilleczek, K. C. (2022). Youths’ perceived impact of invalidation and validation on their mental health treatment journeys. Administration and Policy in Mental Health and Mental Health Services Research, 49(3), 476–489. https://doi.org/10.1007/s10488-021-01177-9
  • Weersing, V. R., & Weisz, J. R. (2002). Community clinic treatment of depressed youth: Benchmarking usual care against CBT clinical trials. Journal of Consulting and Clinical Psychology, 70(2), 299–310. https://doi.org/10.1037/0022-006X.70.2.299
  • Weisz, J. R., Jensen Doss, A., & Hawley, K. M. (2006). Evidence-based youth psychotherapies versus usual clinical care: A meta-analysis of direct comparisons. The American Psychologist, 61(7), 671–689. https://doi.org/10.1037/0003-066X.61.7.671
  • Weisz, J. R., Weiss, B., & Donenberg, G. R. (1992). The lab versus the clinic: Effects of child and adolescent psychotherapy. The American Psychologist, 47(12), 1578–1585. https://doi.org/10.1037/0003-066X.47.12.1578
  • Weisz, J. R., Weiss, B., Han, S. S., Granger, D. A., & Morton, T. (1995). Effects of psychotherapy with children and adolescents revisited: A meta-analysis of treatment outcome studies. Psychological Bulletin, 117(3), 450–468. https://doi.org/10.1037/0033-2909.117.3.450
  • Wergeland, G. J. H., Fjermestad, K. W., Marin, C. E., Haugland, B. S.-M., Silverman, W. K., Öst, L.-G., Havik, O. E., & Heiervang, E. R. (2015). Predictors of dropout from community clinic child CBT for anxiety disorders. Journal of Anxiety Disorders, 31, 1–10. https://doi.org/10.1016/j.janxdis.2015.01.004
  • Wright, A., McGorry, P. D., Harris, M. G., Jorm, A. F., & Pennell, K. (2006). Development and evaluation of a youth mental health community awareness campaign – the compass strategy. BMC Public Health, 6(1), 215. https://doi.org/10.1186/1471-2458-6-215
  • Wright, B., Brookman-Frazee, L., Kim, J. J., Gellatly, R., Kuckertz, M., & Lau, A. S. (2021). Observed engagement in community implemented evidence-based practices for children and adolescents: Implications for practice delivery. Journal of Clinical Child & Adolescent Psychology, 1–15. https://doi.org/10.1080/15374416.2021.1955366
  • Wright, I., Mughal, F., Bowers, G., & Meiser-Stedman, R. (2021). Dropout from randomised controlled trials of psychological treatments for depression in children and youth: A systematic review and meta-analyses. Journal of Affective Disorders, 281, 880–890. https://doi.org/10.1016/j.jad.2020.11.039
  • Wu, E. G., Becker, K. D., Kim, R. E., Martinez, J. I., Gamarra, J. M., & Chorpita, B. F. (2022). How do treatment protocols affect the use of engagement practices in youth mental health services? Administration and Policy in Mental Health and Mental Health Services Research, 49(6), 943–961. https://doi.org/10.1007/s10488-022-01210-5
  • Wu, M. S., Caporino, N. E., Peris, T. S., Pérez, J., Thamrin, H., Albano, A. M., Kendall, P. C., Walkup, J. T., Birmaher, B., Compton, S. N., & Piacentini, J. (2020). The impact of treatment expectations on exposure process and treatment outcome in childhood anxiety disorders. Research on Child and Adolescent Psychopathology, 48(1), 79–89. https://doi.org/10.1007/s10802-019-00574-x
  • Yasinski, C., Hayes, A. M., Alpert, E., McCauley, T., Ready, C. B., Webb, C., & Deblinger, E. (2018). Treatment processes and demographic variables as predictors of dropout from trauma-focused cognitive behavioral therapy (TF-CBT) for youth. Behaviour Research and Therapy, 107, 10–18. https://doi.org/10.1016/j.brat.2018.05.008
  • Zilcha-Mano, S., & Errázuriz, P. (2017). Early development of mechanisms of change as a predictor of subsequent change and treatment outcome: The case of working alliance. Journal of Consulting and Clinical Psychology, 85(5), 508–520. https://doi.org/10.1037/ccp0000192
  • Zlotnick, E., Strauss, A. Y., Ellis, P., Abargil, M., Tishby, O., & Huppert, J. D. (2020). Reevaluating ruptures and repairs in alliance: Between- and within-session processes in cognitive–behavioral therapy and short-term psychodynamic psychotherapy. Journal of Consulting and Clinical Psychology, 88(9), 859–869. https://doi.org/10.1037/ccp0000598